-- Logs begin at Fri 2022-10-28 08:59:39 UTC, end at Fri 2022-10-28 11:42:17 UTC. -- Oct 28 09:33:15.092798 n-d-zed-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 09:33:15.103175 n-d-zed-1 devstack@keystone.service[88439]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 09:33:15.105864 n-d-zed-1 devstack@keystone.service[88439]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:33:15 2022] *** Oct 28 09:33:15.106021 n-d-zed-1 devstack@keystone.service[88439]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:33:15.106141 n-d-zed-1 devstack@keystone.service[88439]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:33:15.106247 n-d-zed-1 devstack@keystone.service[88439]: nodename: n-d-zed-1 Oct 28 09:33:15.106343 n-d-zed-1 devstack@keystone.service[88439]: machine: x86_64 Oct 28 09:33:15.106447 n-d-zed-1 devstack@keystone.service[88439]: clock source: unix Oct 28 09:33:15.106548 n-d-zed-1 devstack@keystone.service[88439]: pcre jit disabled Oct 28 09:33:15.106653 n-d-zed-1 devstack@keystone.service[88439]: detected number of CPU cores: 4 Oct 28 09:33:15.106761 n-d-zed-1 devstack@keystone.service[88439]: current working directory: / Oct 28 09:33:15.106866 n-d-zed-1 devstack@keystone.service[88439]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:33:15.106976 n-d-zed-1 devstack@keystone.service[88439]: your processes number limit is 47680 Oct 28 09:33:15.107081 n-d-zed-1 devstack@keystone.service[88439]: your memory page size is 4096 bytes Oct 28 09:33:15.107185 n-d-zed-1 devstack@keystone.service[88439]: detected max file descriptor number: 2048 Oct 28 09:33:15.107295 n-d-zed-1 devstack@keystone.service[88439]: lock engine: pthread robust mutexes Oct 28 09:33:15.107553 n-d-zed-1 devstack@keystone.service[88439]: thunder lock: enabled Oct 28 09:33:15.107853 n-d-zed-1 devstack@keystone.service[88439]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 09:33:15.108048 n-d-zed-1 devstack@keystone.service[88439]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:33:15.147506 n-d-zed-1 devstack@keystone.service[88439]: Python main interpreter initialized at 0x562cd360b9c0 Oct 28 09:33:15.147506 n-d-zed-1 devstack@keystone.service[88439]: python threads support enabled Oct 28 09:33:15.147506 n-d-zed-1 devstack@keystone.service[88439]: your server socket listen backlog is limited to 100 connections Oct 28 09:33:15.147506 n-d-zed-1 devstack@keystone.service[88439]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:33:15.147915 n-d-zed-1 devstack@keystone.service[88439]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:33:15.147915 n-d-zed-1 devstack@keystone.service[88439]: *** Operational MODE: preforking *** Oct 28 09:33:15.148326 n-d-zed-1 devstack@keystone.service[88439]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:33:15.148326 n-d-zed-1 devstack@keystone.service[88439]: spawned uWSGI master process (pid: 88439) Oct 28 09:33:15.150307 n-d-zed-1 devstack@keystone.service[88439]: spawned uWSGI worker 1 (pid: 88451, cores: 1) Oct 28 09:33:15.150307 n-d-zed-1 devstack@keystone.service[88439]: spawned uWSGI worker 2 (pid: 88452, cores: 1) Oct 28 09:33:15.150307 n-d-zed-1 devstack@keystone.service[88439]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:33:15.149125 n-d-zed-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 28 09:33:19.468078 n-d-zed-1 devstack@keystone.service[88452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:33:19.468078 n-d-zed-1 devstack@keystone.service[88452]: from cryptography.utils import int_from_bytes Oct 28 09:33:19.468894 n-d-zed-1 devstack@keystone.service[88451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:33:19.468894 n-d-zed-1 devstack@keystone.service[88451]: from cryptography.utils import int_from_bytes Oct 28 09:33:19.468894 n-d-zed-1 devstack@keystone.service[88451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:33:19.468894 n-d-zed-1 devstack@keystone.service[88451]: from cryptography.utils import int_from_bytes Oct 28 09:33:19.469445 n-d-zed-1 devstack@keystone.service[88452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:33:19.469445 n-d-zed-1 devstack@keystone.service[88452]: from cryptography.utils import int_from_bytes Oct 28 09:33:19.518616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:33:19.518808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:33:19.518902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:33:19.518987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:33:19.519057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] command line args: [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:33:19.519121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] command line args: [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:33:19.519251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:33:19.519340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:33:19.519403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ================================================================================ {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:33:19.519466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ================================================================================ {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:33:19.519662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] admin_token = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.519750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] admin_token = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.519904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] config_dir = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.519990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] config_dir = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] config_source = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] config_source = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] debug = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] debug = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.520922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.521674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_config_append = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_config_append = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.522968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_dir = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_dir = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_file = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_file = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.523922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.524890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.525958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.526962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] publish_errors = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] publish_errors = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.527945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] standard_threads = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] standard_threads = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.528932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] use_journal = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] use_journal = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.529931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] use_json = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] use_json = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] use_stderr = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] use_stderr = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] use_syslog = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] use_syslog = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:33:19.530970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.530970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.531988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.532952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.533890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.534959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.535965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.536919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.537051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.537174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.537296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.537444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.538922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.539987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.540931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.541937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.542963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.543885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.544983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.545980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.546946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.547905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.548991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.549943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.550994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.551989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.552987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.553882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.554943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.555938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.556890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.external = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.external = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.557894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.password = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.password = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] auth.token = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] auth.token = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.558965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.559902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.560998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.561939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.562875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.563952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.564780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.565987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.566944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.567923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.568876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.569946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.570886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.571953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.572960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.573918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.574976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.575996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.576948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.577890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.578973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.579919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.580858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.581922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.582934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.583953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.584058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.584156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.584742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.584847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.584972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.585101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.585203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.585302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.585961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.586921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.587982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.588988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.589834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] role.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.590956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] role.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] role.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] role.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.591907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.592984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.593913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.594993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.595901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.596808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.597970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.598931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.599897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.600969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.connection = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.601998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.connection = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.602981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.603933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.604881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:33:19.605873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.605992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.606215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:33:19.606386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:33:19.636188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.636413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.636501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.636623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.636713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.636888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.645146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.645395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.674057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.674238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.674378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.674461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.729280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.729715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.778578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.778805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.779439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.779678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.937147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.937382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.937609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.937830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.937943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.938891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.939074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.963811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.963993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.964851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.965019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.965113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.965219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.965317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.977405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.977565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.990862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:19.991735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:33:20.008426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.008636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:33:20.008954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.009048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.009124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:33:20.009215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:33:20.009456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.009538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.009649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:33:20.009732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.009921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.010005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.010181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.010264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.010440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.010699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.019787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.020792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.021112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.028152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.028605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.031055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.031341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.031509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.031635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.031794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.031923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.032928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.033877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.034029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.034300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.056943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.057528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.058428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.058720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.059020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.059353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.063409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.063695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.063970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.064065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.064254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.064535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.070626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.070916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.071175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.071464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.076765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.077089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.077316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.077403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.077621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.077734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.077910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.077995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.078853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.079019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.079294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.094722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.095003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.095140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.095424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.098869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.099226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.102223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.102489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.102574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.102790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.106712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.107414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.109943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.110585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.113205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.113508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.113793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.113875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.114932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.115225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.130894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.131234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.131395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.131540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.131689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.131801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.131962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.132226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.138612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.139114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.140166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.140650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.141731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.142013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.142195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.142486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.144677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.144977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.145236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.145321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.145520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.145642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.145810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.145932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.146099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.146503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.157529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.157814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.158118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.158890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.159044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.159271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.159354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.159567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.159855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.174638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.175089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.177555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.178510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.180958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.181411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.182513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.183003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.183987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.184275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.184493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.184671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.184764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.185192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.191027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.191735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.192744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.193213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.195714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.196849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.197098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.204434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.204727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.204824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.205036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.205121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.205329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.212394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.212646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:33:20.212732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.212950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.213866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.214975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.215968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.216050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.216227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:33:20.250391 n-d-zed-1 devstack@keystone.service[88452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562cd360b9c0 pid: 88452 (default app) Oct 28 09:33:20.250525 n-d-zed-1 devstack@keystone.service[88451]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562cd360b9c0 pid: 88451 (default app) Oct 28 09:33:20.253687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b478c6-141b-45e4-a10f-1c4996751f55 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.253976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b478c6-141b-45e4-a10f-1c4996751f55 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.254250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b478c6-141b-45e4-a10f-1c4996751f55 None None] PATH_INFO: `/v3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.258976 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:27.018125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.018647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.018647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.023484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:27.029018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.029495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.029636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.099826 n-d-zed-1 devstack@keystone.service[88452]: INFO dbcounter [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] Registered counter for database keystone Oct 28 09:33:27.119370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG oslo_db.sqlalchemy.engines [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:33:27.125619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writer thread running {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:33:27.307749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG passlib.handlers.bcrypt [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:33:27.308054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG passlib.handlers.bcrypt [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:33:27.368407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:27.370044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:27.533979 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 09:33:28.105511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.175903 n-d-zed-1 devstack@keystone.service[88451]: INFO dbcounter [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] Registered counter for database keystone Oct 28 09:33:28.197976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG oslo_db.sqlalchemy.engines [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:33:28.204175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writer thread running {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:33:28.324661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3635-e6be-4996-8ec5-0555ed88c3ab None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.329002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.329637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.329923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.330184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.339265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.392402 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:33:28.392640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee711b6-3225-4740-9ada-e68b131fd751 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.403939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:33:28.410191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.427560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6a83-a5a9-4a38-b6f6-1c4e2eee43c8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.432671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.433849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.434135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.434410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] PATH_INFO: `/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.436021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] RBAC: Authorizing `identity:get_project(project_id=04a62e1ae96e4c8e9b9228e06dc65dee)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.493153 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:33:28.493562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a7b0-e48c-4352-886b-6685dc81bb63 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.499255 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:30.668119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9293-4394-483c-807e-33819b63e53d None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.668694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9293-4394-483c-807e-33819b63e53d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.668694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9293-4394-483c-807e-33819b63e53d None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.672764 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:30.678405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.678829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.679467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.700056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:30.701689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:30.709567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 09:33:30.981257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f9293-4394-483c-807e-33819b63e53d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.994008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f9293-4394-483c-807e-33819b63e53d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.998244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.998837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.999118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.999391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.006917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.008717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698200-94a3-4872-8177-f612bb7dc038 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.017387 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:33:31.022834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.032006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338571a-a7b4-4e2c-97aa-7b11b3c5832f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.036392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.037051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.037336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.037609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.039435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.041294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37692134-090c-4107-b895-44e03e832dd5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.042827 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:33.273724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2483a-f56d-487c-a123-9a5d6d902333 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.274287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2483a-f56d-487c-a123-9a5d6d902333 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.274476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2483a-f56d-487c-a123-9a5d6d902333 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.275920 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:33.281825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.282392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.282392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.291831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fa2e-a9b8-474b-821e-bd3a66d5611c None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.292114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fa2e-a9b8-474b-821e-bd3a66d5611c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.292384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fa2e-a9b8-474b-821e-bd3a66d5611c None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.293770 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:33.301572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.301856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.302134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.302228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:33.303428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:33.345981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG passlib.handlers.bcrypt [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:33:33.346373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG passlib.handlers.bcrypt [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:33:33.391084 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:33.395921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:33.397556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:33.497879 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:33.660281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.684830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.761498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.766204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d9b24-519f-4756-ba1c-a50deda69009 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.804518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.805180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.805456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.805726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.817077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:33.826216 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:33.827379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:33.828348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:33.833199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.864216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00206f8b-da05-4b05-8613-97aefebad949 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.867301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.904706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.905610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.905897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.906171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.916138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.934454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d4fa4-8525-47e0-be48-ac3bfbfcd765 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.968922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.969529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.969803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.970072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.970736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:33.971035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.972479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.975591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.977156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.984992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:33.990601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.078464 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:33:34.084424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.088129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.093830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ced84-ac03-4783-a628-7efe00d31bf5 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.128046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.128601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.128882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.129191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.130321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.131818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.134153 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:34.139332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.153873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.184178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8aa14-1814-42b8-bb51-5b03183096ac None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.218521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.219367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.219645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.219915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.237266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6a5e-c5b5-4c93-827f-c59ed82162a6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.238088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.239593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:34.259479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:34.260594 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:34.261463 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:34.261463 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:34.261463 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:34.261463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:34.266493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.274345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.274976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.275250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.275527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.276626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.278094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.279617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:34.285292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.322330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.365666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.365962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762efca9-b474-4bdc-be00-ebad3daa7f30 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.385149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c69d-3fab-4a9c-84e1-b35ad34cc319 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.399810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.400420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.400694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.400986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.401627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:34.401921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.403311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588e0a-98e7-4e61-b25e-c53c2ebbc606 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.419321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.419929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.420214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.420482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.420829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:34.421233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.domain.id=default, user.id=b2e4136eee3b43878593830db499a951) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:34.421537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.422985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c4c8-fa41-4b46-854f-7e5a18112f96 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.430333 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/role_assignments?user.id=b2e4136eee3b43878593830db499a951&scope.domain.id=default&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:37.027168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8f97-7ac4-440a-98f3-4cd325a56a1e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.027708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8f97-7ac4-440a-98f3-4cd325a56a1e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.027708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8f97-7ac4-440a-98f3-4cd325a56a1e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.029091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:37.035579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d788-e366-4b94-91b3-87ba8bf85c4b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.036072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d788-e366-4b94-91b3-87ba8bf85c4b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.036529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d788-e366-4b94-91b3-87ba8bf85c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.079001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1bb2d788-e366-4b94-91b3-87ba8bf85c4b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:37.080850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1bb2d788-e366-4b94-91b3-87ba8bf85c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:37.232500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:37.353606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46a55-2cbe-4323-9281-147914b7aae3 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.353890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46a55-2cbe-4323-9281-147914b7aae3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.354064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46a55-2cbe-4323-9281-147914b7aae3 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.355581 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:37.371185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8f7e-6580-403c-9ef8-30cae171a2dc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.371501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8f7e-6580-403c-9ef8-30cae171a2dc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.371739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e8f7e-6580-403c-9ef8-30cae171a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.395409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b78e8f7e-6580-403c-9ef8-30cae171a2dc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:37.397020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b78e8f7e-6580-403c-9ef8-30cae171a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:37.502302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:37.527816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f83b-f9ed-4bdc-89f9-1479f7ab4030 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.528119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f83b-f9ed-4bdc-89f9-1479f7ab4030 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.528355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f83b-f9ed-4bdc-89f9-1479f7ab4030 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.529823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:37.535601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.536185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.536673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.546539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:37.561972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:37.563176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:37.662954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:37.749017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432f83b-f9ed-4bdc-89f9-1479f7ab4030 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:37.886185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432f83b-f9ed-4bdc-89f9-1479f7ab4030 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:37.908814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:37.934056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:37.934616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.935028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.935303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.951882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:37.953407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:37.972327 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:37.973323 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:37.974126 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:37.974126 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:37.974126 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:37.974126 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:37.981090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.042697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.180464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff74e0-b704-403a-9ae8-97a3aa133cbe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.227596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.228148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.228429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.228702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.230534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:38.230889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.232349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.236540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.263260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:38.264508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.279924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd157-c0a4-4cbd-abe2-888e40e8c118 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.325367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.326335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.326840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.327302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.328195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.329900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc79c-42d7-4f17-874e-96ee652f4cd5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.379324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c6a5-dcc5-4776-8e6d-b5eab75a7cd4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.413604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.414724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.415003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.415272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.426249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-70f260fd-f664-4eca-b234-b3c55149bfa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:38.431734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:38.432570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:38.433403 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:38.434033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5704cd-b559-4ed0-8998-b8967b1a6a15 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.434299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5704cd-b559-4ed0-8998-b8967b1a6a15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.434572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5704cd-b559-4ed0-8998-b8967b1a6a15 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.435805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:38.440553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5704cd-b559-4ed0-8998-b8967b1a6a15 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 15/32] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Oct 28 09:33:38 2022] POST /identity/v3/roles => generated 219 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a9ce-e0fb-4435-9385-a8edd862d363 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a9ce-e0fb-4435-9385-a8edd862d363 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a9ce-e0fb-4435-9385-a8edd862d363 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:38.477812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a9ce-e0fb-4435-9385-a8edd862d363 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.510704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.521173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.596998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5704cd-b559-4ed0-8998-b8967b1a6a15 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.633927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a9ce-e0fb-4435-9385-a8edd862d363 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.646242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.647036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.647414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.647792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.649282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.651329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc30343-3c5e-4a71-95e4-8435a70f3cf8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.680369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.681129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.681446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.681797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.683403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:38.683403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.685749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e77b-4ae0-4cd0-9de4-5d6483280105 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.700482 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:38.701836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408e8f-d76a-41c6-b688-25921525d317 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.702127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408e8f-d76a-41c6-b688-25921525d317 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.702403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408e8f-d76a-41c6-b688-25921525d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.724379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9408e8f-d76a-41c6-b688-25921525d317 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:38.725941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9408e8f-d76a-41c6-b688-25921525d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:38.796822 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:38.798049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ddec5-27eb-45b1-bc08-9205c9df5502 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.798339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ddec5-27eb-45b1-bc08-9205c9df5502 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.798613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ddec5-27eb-45b1-bc08-9205c9df5502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.803014 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:33:38 2022] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:38.810831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c74e-68c8-497a-8706-f8a06182603b None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.811441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c74e-68c8-497a-8706-f8a06182603b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.811876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c74e-68c8-497a-8706-f8a06182603b None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.813884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 19/37] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:38.819096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c74e-68c8-497a-8706-f8a06182603b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.821097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bb0ddec5-27eb-45b1-bc08-9205c9df5502 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:38.822666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb0ddec5-27eb-45b1-bc08-9205c9df5502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:38.850927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.941569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:38.943798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.944504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.944955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.956375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c74e-68c8-497a-8706-f8a06182603b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.966342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.972192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:38.974032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:39.027856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.028599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.029673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.029673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.030611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.032351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.034250 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 20/39] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:39.039754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.063230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:39.079409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.186827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.211406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebee2f-c419-4438-8b4b-3daa19bb7e55 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.259253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.260595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.261181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.261601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.262440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.264681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.284367 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Oct 28 09:33:39 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:39.286151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429a8f5-c707-4e96-949e-b4c3c1cd08a8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.313904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.338348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.339745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.340189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.340521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.342679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.344245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.347017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 21/42] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:39.353242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.410195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.446862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8105e9d-b5b7-47ea-9711-dcb32919166e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.480427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc81c5-e35f-4967-a7aa-29ec5dbe7979 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.489669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.490284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.490566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.490833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.491519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.493018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.505492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.516932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Oct 28 09:33:39 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:39.516932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.531638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.532424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.532703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.533228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] PATH_INFO: `/v3/domains/default/users/b2e4136eee3b43878593830db499a951/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.535523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b2e4136eee3b43878593830db499a951, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.537443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.559880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 22/44] 10.222.0.16 () {58 vars in 1361 bytes} [Fri Oct 28 09:33:39 2022] PUT /identity/v3/domains/default/users/b2e4136eee3b43878593830db499a951/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:39.658557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf41b60-d81a-41be-ab93-3247319550e5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.701088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.702192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.702689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.703205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.705170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.706980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677fa9-e9cf-4c83-9e02-ddc43f70e842 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.709022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:39.715630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.829355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1e6b-57bd-4bde-8d38-ba1b8e21e166 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.830913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.864802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.865357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.865635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.865907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.866574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.868575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9da79-598a-4b91-9787-7ed5ce204fc5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.895159 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:33:39 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:41.784081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804057-8720-44fc-89d0-32852bc9f512 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.784725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804057-8720-44fc-89d0-32852bc9f512 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.784725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804057-8720-44fc-89d0-32852bc9f512 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.786022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:41.792128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f62e-8a4c-4340-b265-591d8c53b2e2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.792633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f62e-8a4c-4340-b265-591d8c53b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.792722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f62e-8a4c-4340-b265-591d8c53b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.811713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9a45f62e-8a4c-4340-b265-591d8c53b2e2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:41.813318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a45f62e-8a4c-4340-b265-591d8c53b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:41.886107 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:42.159749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e804057-8720-44fc-89d0-32852bc9f512 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.172740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed599-8694-4fd8-9670-864090be745a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.173083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed599-8694-4fd8-9670-864090be745a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.173511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed599-8694-4fd8-9670-864090be745a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.174864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 25/49] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:42.182366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.182664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.182987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.204994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:42.206345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:42.242613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:42.280443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e804057-8720-44fc-89d0-32852bc9f512 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.290822 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 26/50] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:42.323811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.324450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.324736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.325045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.337415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:42.344519 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:42.345593 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:42.346372 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:42.351578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.368199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:42.457477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0c80-e9ab-4ba5-b11f-3efe96977104 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.495681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.496509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.496870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.497173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.498111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:42.498553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.500285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.510501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:42.518227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.575517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.668766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:42.695694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e3-ef1a-4627-acbc-4b5cd7c8c08d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.732752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.733337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.733618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.734161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.735024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.736481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.738113 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:42.741451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d9a7-ae94-485a-b0e8-8dbbd2f51854 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.744347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.775671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:42.784101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.784922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.785228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.786324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.787729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.789223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.790832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:42.797775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.859731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36521e-cb0e-409c-bd26-794d6e36a484 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.908828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.909843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.910271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.910552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.911260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.913548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.917097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f23478-5062-405d-8d56-63d72c5ba6e0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.938308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:42.953924 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 29/55] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Oct 28 09:33:42 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:42.956065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.956753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.957082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.957337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.958655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.960112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba469-2eb9-469d-9b16-359eb927d24e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.961826 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 27/56] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:42.968084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:43.091039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e236e91-dd7d-43bb-966f-19a37c467276 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:43.133012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:43.133692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:43.133971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:43.134362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:43.135014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.domain.id=default, user.id=b2e4136eee3b43878593830db499a951) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:43.135352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:43.136836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f27c-c87e-4bb7-81f3-bed835788f40 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:43.143636 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 30/57] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/role_assignments?user.id=b2e4136eee3b43878593830db499a951&scope.domain.id=default&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:45.193440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba235-2c53-4dbf-88dd-ef4635e52cae None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.194512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba235-2c53-4dbf-88dd-ef4635e52cae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.194974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba235-2c53-4dbf-88dd-ef4635e52cae None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.196859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:45.204586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.205269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.205269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.223734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:45.224955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:45.280076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.292416 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:45.566274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba235-2c53-4dbf-88dd-ef4635e52cae None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.632725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.673547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba235-2c53-4dbf-88dd-ef4635e52cae None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.709120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.709754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.710034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.710306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.711544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.713587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786c9fa-248e-4e61-8a7a-9e42f5f33704 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.715230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:45.721689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.855612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439fdc-930f-47c2-87e4-072277062fa3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.901417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.902332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.902830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.903313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.904502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.907149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3536-fb91-4308-9e66-f7c78f3bd4f6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.947558 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:45 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:49.824388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8182-e135-41ef-96ea-54f7b7e6ad6e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.824388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8182-e135-41ef-96ea-54f7b7e6ad6e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.824388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8182-e135-41ef-96ea-54f7b7e6ad6e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.824388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:49.830020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fca42-7b73-472d-a9c1-78f4c0c8e1fa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.830461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fca42-7b73-472d-a9c1-78f4c0c8e1fa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.830562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fca42-7b73-472d-a9c1-78f4c0c8e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.842938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f80f6-bbcd-4236-b68e-75d0dd6a9ed4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.845266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f80f6-bbcd-4236-b68e-75d0dd6a9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.845751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f80f6-bbcd-4236-b68e-75d0dd6a9ed4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.847305 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:49.859086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-843fca42-7b73-472d-a9c1-78f4c0c8e1fa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:49.860644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-843fca42-7b73-472d-a9c1-78f4c0c8e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:49.872489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929efc6d-11e2-47f4-a349-defe7fb77080 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.873108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929efc6d-11e2-47f4-a349-defe7fb77080 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.873584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929efc6d-11e2-47f4-a349-defe7fb77080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.899765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-929efc6d-11e2-47f4-a349-defe7fb77080 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:49.907072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-929efc6d-11e2-47f4-a349-defe7fb77080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:49.942776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.001114 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 33/64] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:50.031564 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:50.149270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10225-3a33-4c92-8c51-362db8fb9706 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.150724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10225-3a33-4c92-8c51-362db8fb9706 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.151370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10225-3a33-4c92-8c51-362db8fb9706 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.153162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 34/66] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:50.159188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594dd1e-344f-469a-9425-6a86b5565882 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.159878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594dd1e-344f-469a-9425-6a86b5565882 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.160524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594dd1e-344f-469a-9425-6a86b5565882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.193988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d594dd1e-344f-469a-9425-6a86b5565882 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:50.195989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d594dd1e-344f-469a-9425-6a86b5565882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:50.209426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f969e2-f7bb-4e37-8226-950623c8c32a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.210159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f969e2-f7bb-4e37-8226-950623c8c32a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.210802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f969e2-f7bb-4e37-8226-950623c8c32a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.213204 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 35/67] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:50.223357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.224084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.224722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.245374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:50.247045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:50.276494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.290283 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 33/68] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:50.291374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5605-595c-4408-a6a3-864f0bb43aeb None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.291628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5605-595c-4408-a6a3-864f0bb43aeb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.291899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5605-595c-4408-a6a3-864f0bb43aeb None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.293179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 34/69] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:50.298653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.299148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.299593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.319363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:50.321236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:50.333934 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:50.393904 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 35/71] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:50.403192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.515379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbdff6-9f07-425c-a391-346eb976b94e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.523949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.566845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.567491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.567776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.568047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.591355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:50.596375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:50.597277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:50.598035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:50.605128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.638164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.715652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa6f4-4533-462e-9c0b-f51fd39be69f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.743622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.755620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.756237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.756520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.756795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.757500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:50.757812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.759673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.768866 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:50.773952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.777757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833aa13-936a-4492-ad33-dbbb962297f7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.812769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.813440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.813720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.814007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.824234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:50.829128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:50.830580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:50.831426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.858695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.879138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b275-142a-4fca-9792-faef08cfb383 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.912648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.913308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.913581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.913848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.924827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:50.930172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:50.931072 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:50.932104 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:50.932961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b792-5df4-4826-a662-4826fa992299 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.933036 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:50.933036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.967023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.967566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.967883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.968190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.969323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.970791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.972330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:50.973202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.980556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.033614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ed57-e8dc-4753-b7fa-751f1fcd4904 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.067695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.070369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.071128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.071428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.071696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.074652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58d9a-43ba-48ac-9630-5d80a5024051 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.086577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.088556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.090369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.090961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.108620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.109367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.109650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.109927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.120785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:51.125795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:51.126819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:51.127658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:51.128287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.204445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3524-7002-4cb8-b9e5-d546796ba4d9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.206211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.238621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70a306-42b8-47b4-a6bb-3dbb7fe379b1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.239537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.240153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.240428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.240704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.241391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.241691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.243047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.251787 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.256646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.273956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.274608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.274890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.275164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.275831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.276137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.277583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.285758 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.289767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.308676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.356223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dccd-9c4c-4e96-a924-adc82b21763e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.392387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46609d-eaee-481d-a290-e7129d021563 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.393470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.394096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.394372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.394640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.395311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.396808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.425762 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 40/81] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:51 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:51.426604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.440959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.441730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.442064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.442412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.452532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.525531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.526977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.547694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.551270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ce4-2edc-441c-80c9-c0c06d008a79 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.591547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.592213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.592497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.592777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.593503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.593815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.595263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.605161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 41/82] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.608953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.664950 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:51.665757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.715910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.740736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947739-3853-4cac-89b3-731494db8a21 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.789024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.789704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.790024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.790302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.791444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50dd2-7d83-411c-9c42-f573f76f227b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.791549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.793161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.795890 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.800494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.811558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.837791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.839106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.839531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.840031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.841412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.843075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.845078 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.845596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.922912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb756-8220-4d70-96c3-8de08a91c7ba None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.962454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.963130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.963441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.963894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.964973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.966480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.968532 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.969116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.990251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.996612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982a3c-fddd-427f-afaf-6fce7ecf48fa None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.035156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.036129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.036455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.036739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.038122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.039710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.042024 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.042859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.105551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.121303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4531-e15e-4975-bf65-e441ff925294 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.179825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af363-ac6a-473d-8333-46e155149e50 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.181878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.183237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.183827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.185536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.235627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.236289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.236558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.236834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.295957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.298599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.319516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.321606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.327368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.395989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.438531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:52.439725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.471057 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 45/89] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:52.471057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.572985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217725-ecf6-410b-ac38-323867591b24 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.589364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6ff7-4b4c-4ace-bb43-54626017b0a7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.592276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.611032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.611653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.611936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.612207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.632733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.633833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.634382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.634868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.635965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:52.636470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.638163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.644597 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.645825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.667245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.690983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.692513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.765118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e3dc-8fc1-4291-afe8-99cb51a769d7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.804761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.805881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.806428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.806895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.808395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.810181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.812714 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.813771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.877196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 45/92] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:52.878119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.910321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.933905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cce03-a23b-4f79-9f00-c9f99f68777a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.945619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.975621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.976622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.977139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.977611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] PATH_INFO: `/v3/projects/841e762fed63481fb57f874bd3e9362b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.979631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=841e762fed63481fb57f874bd3e9362b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.981349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.983446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/projects/841e762fed63481fb57f874bd3e9362b => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.984494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.072998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2cb56-d38e-4cd1-9774-00778b881d8a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.109082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e280e-6bfd-4ee4-8e24-d1585098c7d1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.122148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.122780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.123115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.123396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.124130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.124441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.128447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.148302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.149195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.200575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.201647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.202126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.202595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.204004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.205700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.213286 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.214564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.253092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.268824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.297902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5db25c-b6a5-496f-9f2a-d402d1cd42a6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.347241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.347897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.348183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.348459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.349253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=841e762fed63481fb57f874bd3e9362b, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.349567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.351053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe742229-4224-4801-93f3-57cc84a1b68d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.367136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=841e762fed63481fb57f874bd3e9362b&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.416317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82e10-ded1-4caa-901f-09fbe03a5df8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.467363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.468259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.468694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.469151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.470058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=b2e4136eee3b43878593830db499a951) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.470627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.472280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e0686-bed9-4a73-8b00-b23bf3bfe50b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.482488 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/role_assignments?user.id=b2e4136eee3b43878593830db499a951&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.958721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad6-9cfb-4a1c-8db6-8344e08a2540 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.959211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad6-9cfb-4a1c-8db6-8344e08a2540 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.959716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad6-9cfb-4a1c-8db6-8344e08a2540 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.961321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:53.967365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5898-a392-43bb-a573-b5ae68d382c7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.968274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5898-a392-43bb-a573-b5ae68d382c7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.968769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5898-a392-43bb-a573-b5ae68d382c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.992645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c35f5898-a392-43bb-a573-b5ae68d382c7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:53.994835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c35f5898-a392-43bb-a573-b5ae68d382c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:54.091334 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:54.122726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1b62-72b7-4c47-9c9a-8786fd9d91e6 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.123704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1b62-72b7-4c47-9c9a-8786fd9d91e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.124177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1b62-72b7-4c47-9c9a-8786fd9d91e6 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.125770 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 49/100] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:54.131354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.131946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.132416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.155069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:54.156586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:54.167796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:54.235390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 52/101] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:54.391742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1b62-72b7-4c47-9c9a-8786fd9d91e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.509876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1b62-72b7-4c47-9c9a-8786fd9d91e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.545549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.546197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.546478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.546750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.558420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:54.563485 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:54.564388 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:54.565169 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 50/102] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:54.574282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.663056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.684657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:54.759986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cffedf-0eed-4a93-abbe-38500928ed7c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.816297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.817885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.818188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.818467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.819156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] RBAC: Adding query filter params (name=reader) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:54.819464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:54.821152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:54.841345 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 53/103] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:54.847611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.861922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:54.883694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40ec2-2074-4f53-8551-5b3b960c5613 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.962251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.962972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.963260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.963535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.965723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:54.967196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:54.971406 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:54.974555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.055270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6523-8d2e-4c7d-b837-09b6ff6e3eec None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.109202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.142263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.142918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.143198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.143473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] PATH_INFO: `/v3/users/598a9a80239b4961a49ef1a4d78e3d0c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.144864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2547-5349-4fc8-b27e-d5cb28863d18 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.186502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] RBAC: Authorizing `identity:get_user(user_id=598a9a80239b4961a49ef1a4d78e3d0c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.188003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.190078 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/users/598a9a80239b4961a49ef1a4d78e3d0c => generated 289 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:55.195727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.206212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.206850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.207134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.207410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.208088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.209635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.254844 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 52/106] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:33:54 2022] POST /identity/v3/projects => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:55.321154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.374687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49818d9-7b6f-40b7-8883-1cfa200ce6b5 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.422216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.422857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.423145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.423423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.520512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.522054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.601980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.648446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:55.654423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.779527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73be03-941a-4c90-ac3f-04a8e126f6ee None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.817285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.825009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.825668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.825952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.826232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.827401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.828859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281146-0592-4c2c-a11e-28d13c62abdb None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.830748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 53/108] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:55.836648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.945795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2c8b-0f18-4a2d-908f-b9b280c3fe7b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.985973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.986601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.986884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.987159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.987908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=598a9a80239b4961a49ef1a4d78e3d0c) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:55.988219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.989717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50d98-0386-4161-8ab3-4c4ce278da1a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.996102 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/role_assignments?user.id=598a9a80239b4961a49ef1a4d78e3d0c&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:56.146350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d98-ca3b-495c-b771-fc3bff92518b None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.146845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d98-ca3b-495c-b771-fc3bff92518b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.146845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d98-ca3b-495c-b771-fc3bff92518b None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.148594 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 54/110] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:56.154523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c6e1-14b5-4460-9071-3f690f7dd57d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.155012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c6e1-14b5-4460-9071-3f690f7dd57d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.155224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c6e1-14b5-4460-9071-3f690f7dd57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.186129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3df4c6e1-14b5-4460-9071-3f690f7dd57d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:56.187371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3df4c6e1-14b5-4460-9071-3f690f7dd57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:56.218314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:56.286938 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:56.423003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15278d4-d646-4094-9693-5a67cb3f4a55 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.423287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15278d4-d646-4094-9693-5a67cb3f4a55 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.423494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15278d4-d646-4094-9693-5a67cb3f4a55 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.425166 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 55/112] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:56.430222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.430740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.431195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.457972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:56.459478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:56.550005 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:56.758170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15278d4-d646-4094-9693-5a67cb3f4a55 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.902197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15278d4-d646-4094-9693-5a67cb3f4a55 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.944767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.946047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.946532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.947053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.973543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:56.979065 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:56.979927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:56.980709 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:56.983004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 56/114] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:56.989010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.106485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.125324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.138264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab17ae-19a0-411a-a6a3-60fe5b79b8fe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.210607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.211236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.211487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.211920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.212813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:57.213270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.214804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7659b-079a-454d-ac5b-05d6f05d82de None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.216088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.231999 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 59/115] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:57.236950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7896ae-57a5-4a5f-9bda-a4410bc0a256 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.236950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7896ae-57a5-4a5f-9bda-a4410bc0a256 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.236950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7896ae-57a5-4a5f-9bda-a4410bc0a256 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.236950 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 60/116] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:57.244932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7896ae-57a5-4a5f-9bda-a4410bc0a256 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.281258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435cf9f-1bbf-4726-aeaa-c2b882ae4ff2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.323061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.323683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.323954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.324219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.346199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6e42f1fb-9c6d-4e7f-89bc-9b27c8003c18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:57.351112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:57.351959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:33:57.352737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 57/117] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:57.354691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.354691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.354691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.389246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:57.390841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:57.436835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7896ae-57a5-4a5f-9bda-a4410bc0a256 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.473659 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:57.474651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.482303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.483240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.483713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.484174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.486084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.488206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd332-d494-4519-ba8f-c910db72608f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.490717 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:57.492306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613d44-617a-4844-a5e2-90533d72e31f None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.493263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613d44-617a-4844-a5e2-90533d72e31f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.493755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613d44-617a-4844-a5e2-90533d72e31f None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.495234 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 62/120] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:57.498519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613d44-617a-4844-a5e2-90533d72e31f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.539578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.552557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.667029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a64280-f40f-4bb8-98c7-8412031e18a4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.712493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613d44-617a-4844-a5e2-90533d72e31f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.734407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.735031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.735315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.735590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.736267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:57.736573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.739104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b108-e018-4209-a97c-78bc8e3592d5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.752347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 59/121] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:57.753824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.754177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.754524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.776373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.777427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.777911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.778360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.779849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.781743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.783858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:57.785150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.798129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:57.799365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:57.890993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.891399 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 60/123] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:57.893185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.928041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa5cb9-7226-4942-a736-ad32a3e153c2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.937919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.011994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd888d-c9a2-4f21-a2c6-34108efa758c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.028543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.029351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.029702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.030075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.031261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.041357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.043158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.044415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.056336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.057112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.057445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.057717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.060530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, user_id=a4535d070e134ce68ed8ab7ee4c3c88a, role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.062062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.092105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 61/125] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:57 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:58.094643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.248472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664da2-85cb-4bf1-9c4d-d302feba2c1c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.270277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.287890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35520-cd5c-4d39-8113-f586cf96467f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.296220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.297877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.298417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.298913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.316315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:58.326116 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:58.327047 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:33:58.327829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:58.328936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.329300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.329637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.329916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] PATH_INFO: `/v3/projects/841e762fed63481fb57f874bd3e9362b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.331278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=841e762fed63481fb57f874bd3e9362b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.331491 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:58.332613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.332716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.338415 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/projects/841e762fed63481fb57f874bd3e9362b => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.339498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.374568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.484963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934317-d6cc-4405-b745-ae541a63a1a0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.509510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c21b16-2b25-4529-a35c-321ed1b9790a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.523561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.524188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.524563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.524839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.526077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:58.526383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.528036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.538499 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.539461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.561112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.562435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.562925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.563606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.583317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:58.585724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-2523233d-8583-45e5-80f7-c4481333a171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:58.592421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:58.593837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:33:58.594626 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:58.595310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a2f-8242-4443-93cf-81e8ea071d9a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.599350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a2f-8242-4443-93cf-81e8ea071d9a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.599350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a2f-8242-4443-93cf-81e8ea071d9a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.599350 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 67/130] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:58.605698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6a2f-8242-4443-93cf-81e8ea071d9a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.751847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4670a-491e-4e34-b8c0-d5d4a4cc93df None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.757512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.805443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6a2f-8242-4443-93cf-81e8ea071d9a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.839728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.842300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.844327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.844878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] PATH_INFO: `/v3/projects/841e762fed63481fb57f874bd3e9362b/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.849516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] RBAC: Authorizing `identity:create_grant(project_id=841e762fed63481fb57f874bd3e9362b, user_id=a4535d070e134ce68ed8ab7ee4c3c88a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.851000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.868875 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 64/131] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:58 2022] PUT /identity/v3/projects/841e762fed63481fb57f874bd3e9362b/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:58.869847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.870527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.871478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.872006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.872580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.874233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.876073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff09315-66a2-4014-bf03-4dd595faea7a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.878168 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.880031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7ad2-c656-45a9-baf6-55247ba944f5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.880628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7ad2-c656-45a9-baf6-55247ba944f5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.881154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7ad2-c656-45a9-baf6-55247ba944f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.903101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e2ee7ad2-c656-45a9-baf6-55247ba944f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:58.904954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2ee7ad2-c656-45a9-baf6-55247ba944f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:58.979214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.988472 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 69/133] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:58.990332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f88a09-97db-494a-98de-98f46b6e0221 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.990905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f88a09-97db-494a-98de-98f46b6e0221 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.991394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f88a09-97db-494a-98de-98f46b6e0221 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.993190 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 70/134] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:58.995858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f88a09-97db-494a-98de-98f46b6e0221 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.007989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7001e-f055-46b1-bb4d-3a61c804a3df None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.136986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.137643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.137930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.138209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.140082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:59.140672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.142555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9ecf-380e-46f2-a167-847dc19325c6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.154695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 65/135] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.163017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.163017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.163017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.177915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.200304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:59.202379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:59.256255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f88a09-97db-494a-98de-98f46b6e0221 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.326505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.327163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.327454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.327725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.329370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.330785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.333020 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 71/136] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.333946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.338644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 66/137] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:59.340267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.441407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.470865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12904c5b-06c2-430d-ac44-adee43780f88 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.490603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a75e2-4f58-4d45-9afe-87fa65487a6b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.542565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.543210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.543491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.543763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.544874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.545517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.545787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.546054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.547152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.548594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.550948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.552404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.553147 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 67/138] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.553999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.555093 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 72/139] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.555714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.569376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.675232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a420fa-a6c4-480a-86f6-c80393bea4b4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.707187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d568-bf69-4de6-9ec0-33a448edd279 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.711186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.711795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.712071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.712343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.713086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.714526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.738269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 73/140] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:59 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:59.739028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.745142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.745836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.746121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.746400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.748499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, user_id=a4535d070e134ce68ed8ab7ee4c3c88a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.750204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.779516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 68/141] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:59 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/a4535d070e134ce68ed8ab7ee4c3c88a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:59.780585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.799321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.849056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.926308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569b33-4f79-4b41-85ec-1091e48f4508 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.994917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.996617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.996896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.998543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.999888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.001629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.003336 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 74/142] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.005561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fdfb-4c02-4f9a-9c4f-aad1dfd6df20 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.019134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.074604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.075505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.075967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.076386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.098205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:00.106702 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:00.107927 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:00.109039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 69/143] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:00.115249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.188800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297bb34-2096-4667-b110-d398f91acc9c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.201956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.224429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.236418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.237532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.238042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.238493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/b2e4136eee3b43878593830db499a951/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.245426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, user_id=b2e4136eee3b43878593830db499a951, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.247301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.249285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e505e-8748-4721-ad22-5c3224647e6a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.269464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 75/144] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:00 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/b2e4136eee3b43878593830db499a951/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:34:00.304807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.305493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.305772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.306048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.306840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:00.307159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.308595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.318582 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 70/145] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.326094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.476337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab2cea-d5fe-4ae6-91d8-ee538ee3b6af None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.522448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.523316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.523740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.524181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] PATH_INFO: `/v3/users/598a9a80239b4961a49ef1a4d78e3d0c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.526145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] RBAC: Authorizing `identity:get_user(user_id=598a9a80239b4961a49ef1a4d78e3d0c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.527785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.530055 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 76/146] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/users/598a9a80239b4961a49ef1a4d78e3d0c => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.535588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.667564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc9c6-2ce6-4858-9103-15113e8c08e0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.697369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.705807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.706915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.707464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.707748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.709311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.710832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458015e-ed11-45a7-8f06-729fdc69c22a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.712780 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 71/147] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.719184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.793632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.843445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a70ec-4938-4861-8c75-7695c78b8393 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.880688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.881392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.881712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.881987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/598a9a80239b4961a49ef1a4d78e3d0c/roles/6f9ac96918ec42bc840e6cde97bc6cd9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.883971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, user_id=598a9a80239b4961a49ef1a4d78e3d0c, role_id=6f9ac96918ec42bc840e6cde97bc6cd9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.885566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868c91-8da7-4714-9df8-0f6640c303e4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.903193 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:00 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/users/598a9a80239b4961a49ef1a4d78e3d0c/roles/6f9ac96918ec42bc840e6cde97bc6cd9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:00.932960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6aa6a-2b40-4ebe-b92b-e6faf9d16346 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.933279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6aa6a-2b40-4ebe-b92b-e6faf9d16346 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.933512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6aa6a-2b40-4ebe-b92b-e6faf9d16346 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.935134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 72/149] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:00.944419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.944419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.944419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.966522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:00.968076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:01.058774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:01.424597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6aa6a-2b40-4ebe-b92b-e6faf9d16346 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.579530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6aa6a-2b40-4ebe-b92b-e6faf9d16346 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.651211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.652277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.652763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.653247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.676116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:01.685993 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:01.686922 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:01.687769 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:01.688366 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:01.697205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.781145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.850582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60af7-4358-40b1-9e7d-ff457f0acf08 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.892852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.893523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.893805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.894081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.894777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:01.895074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.896598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.906713 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:01.912581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.986468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.034671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5bf5-2b6e-4e8a-b3b2-a47ac3bbfcb8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.077083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.077778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.078110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.078448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.082111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.085136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.093448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:02.094656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.287225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a952f-aefb-41e2-9e42-d81de9b0b1f4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.316308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.363514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.364506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.365035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.365512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.522639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.525339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea5e60-f687-4471-aa5b-c6792ae3ec99 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.766220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:02.773068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.823041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b811a4-a66b-4b66-ad53-7790c67b262a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.823497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b811a4-a66b-4b66-ad53-7790c67b262a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.823959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b811a4-a66b-4b66-ad53-7790c67b262a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.826791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 81/155] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:02.835559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.835920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.836379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.880428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:02.882433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:02.900361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.065469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 82/156] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:03.082556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3fbb-71e7-4003-b2c6-169ce75f896c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.139758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.167391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.169032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.169840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.170587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.177778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.180848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.184263 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 75/157] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:03.190970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:03.397121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d62e8-3d6d-4c50-9106-614aeff4126c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.469041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.470036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.470519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.470993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.472468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:03.473040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.476002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.487518 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 83/158] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:03 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:04.024880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.146885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fb0e-21c4-4051-aa1f-a0ce0c108056 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.192021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.192665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.192970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.193307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.210268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:04.215781 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:04.217459 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:04.219088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 76/159] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:04.231949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.252153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:04.465339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242082-c93d-40d9-94fe-261ea9923a93 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.542391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.543401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.543886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.544365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.545601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:04.546128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:04.548784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.571257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 84/160] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:04.580327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.658028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:04.721107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872369-f7bf-472f-8870-a40aa2543660 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.762102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.762747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.763026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.763296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.764536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:04.766127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.767979 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 77/161] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:04.777008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.918355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:04.962511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318339e7-d92c-4fb5-857f-b648c9f105b6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:05.008723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:05.009247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.009530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.009771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.111533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:05.113010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaed6a6-f192-43a4-aaa2-2a6e0e14b184 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:05.214261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:05.255180 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 85/162] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:05.265030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:05.363083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe702-9515-4767-bd1e-e73d39f7b260 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.363374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe702-9515-4767-bd1e-e73d39f7b260 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.363702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe702-9515-4767-bd1e-e73d39f7b260 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.369420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 86/163] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:05.390443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d235af-ae23-4c05-897e-cae34e897bd8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.390847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d235af-ae23-4c05-897e-cae34e897bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.391034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d235af-ae23-4c05-897e-cae34e897bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.417554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394052-ea03-42a1-81b5-1bf3040a563c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:05.427932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-23d235af-ae23-4c05-897e-cae34e897bd8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:05.429174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-23d235af-ae23-4c05-897e-cae34e897bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:05.451267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:05.462356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:05.463019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.463387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.463712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] PATH_INFO: `/v3/projects/841e762fed63481fb57f874bd3e9362b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.465509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] RBAC: Authorizing `identity:get_project(project_id=841e762fed63481fb57f874bd3e9362b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:05.467124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:05.471145 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 78/164] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:05 2022] GET /identity/v3/projects/841e762fed63481fb57f874bd3e9362b => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:05.481490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:05.587210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 87/165] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:05.643262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe993583-fed5-403e-8d7a-c36809022143 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:05.685844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:05.686498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.686775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.687039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.688079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=841e762fed63481fb57f874bd3e9362b, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:05.688490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:05.690106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72099b-6072-49ec-9039-602a991028c1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:05.697343 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 79/166] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:05 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=841e762fed63481fb57f874bd3e9362b&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:06.010582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303e289-96d9-444b-85b8-d74bce9d699b None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.010841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303e289-96d9-444b-85b8-d74bce9d699b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.011114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303e289-96d9-444b-85b8-d74bce9d699b None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.012707 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 88/167] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.020609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f14f0-3689-462a-b629-ea415e0d554b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.021004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f14f0-3689-462a-b629-ea415e0d554b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.021243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f14f0-3689-462a-b629-ea415e0d554b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.046091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ca5f14f0-3689-462a-b629-ea415e0d554b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.047317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca5f14f0-3689-462a-b629-ea415e0d554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.099710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.121608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 80/168] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:06.143937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303e289-96d9-444b-85b8-d74bce9d699b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.372717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.389145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303e289-96d9-444b-85b8-d74bce9d699b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:06.397571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39adc-7c88-4ed5-89fb-1ba81eaa2de8 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.398353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39adc-7c88-4ed5-89fb-1ba81eaa2de8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.398353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39adc-7c88-4ed5-89fb-1ba81eaa2de8 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.399554 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 81/169] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.405429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.405698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.406009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.437361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.438567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.498311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:06.499859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.500635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.501409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.532448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 82/170] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:06.533221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.534596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8aa81bb7-73b5-4a57-8c20-09d8ad76dcdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:06.543258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:06.545029 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:06.546615 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:06.554095 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 89/171] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:06.558981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb33-aca5-4bd4-a438-67da5bbb2bd3 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.559549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb33-aca5-4bd4-a438-67da5bbb2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.561793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb33-aca5-4bd4-a438-67da5bbb2bd3 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.566317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 90/172] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.574232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434eb33-aca5-4bd4-a438-67da5bbb2bd3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.664122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861b6c-b141-462f-bb44-59397667cb2f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:06.678357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.697359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434eb33-aca5-4bd4-a438-67da5bbb2bd3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:06.701792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:06.702433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.702709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.702978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.715348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-f08b871c-3109-48c3-874e-338f1c46fab9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:06.720548 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:06.721661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:06.722683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 83/173] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:06.723483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae21a4f-66ab-4732-b37b-7145c8fdd114 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.723483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae21a4f-66ab-4732-b37b-7145c8fdd114 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.723483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae21a4f-66ab-4732-b37b-7145c8fdd114 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.728959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 84/174] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.728959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21200d8-e342-4f43-bd19-31c675a099d8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.728959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21200d8-e342-4f43-bd19-31c675a099d8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.728959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21200d8-e342-4f43-bd19-31c675a099d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.741701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:06.742318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.742592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.742862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.743556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:06.743854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:06.745918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431476c-c9a2-4d42-9a5f-8d6a50ce10a0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:06.749225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d21200d8-e342-4f43-bd19-31c675a099d8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.750412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d21200d8-e342-4f43-bd19-31c675a099d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.754770 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 91/175] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:06.755884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39dde-a0cb-4cc6-8b82-92d3178a7ac5 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.756169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39dde-a0cb-4cc6-8b82-92d3178a7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.756435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39dde-a0cb-4cc6-8b82-92d3178a7ac5 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.757804 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 92/176] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.758351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a39dde-a0cb-4cc6-8b82-92d3178a7ac5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.786324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.832239 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:06.835332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597903da-690b-47f6-b481-c632c081ed0d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.835332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597903da-690b-47f6-b481-c632c081ed0d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.835332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597903da-690b-47f6-b481-c632c081ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.853149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-597903da-690b-47f6-b481-c632c081ed0d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.854364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-597903da-690b-47f6-b481-c632c081ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.879635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a39dde-a0cb-4cc6-8b82-92d3178a7ac5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:06.916284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:06.917347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.917717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.917996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.918782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:06.919094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:06.920460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7da15-4aba-4067-b68d-fd84fd5e7a90 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:06.923567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 86/178] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:06.924422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597903da-690b-47f6-b481-c632c081ed0d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.937496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 93/179] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:06.937496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.937496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.937496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.954262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.955566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.964536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.041365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:07.041365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.068280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.071069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597903da-690b-47f6-b481-c632c081ed0d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.128062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.128698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.129261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.129537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] PATH_INFO: `/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.131097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] RBAC: Authorizing `identity:get_user(user_id=a4535d070e134ce68ed8ab7ee4c3c88a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.132542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.135029 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 87/181] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/users/a4535d070e134ce68ed8ab7ee4c3c88a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.137011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.185884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980f03c-d628-491d-978a-9fe2d90ea219 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.227473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.228120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.228397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.228669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.239371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:07.244297 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:07.245731 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:07.246553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 95/182] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:07.247207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.266690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.270293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5014-ec39-400d-9637-19978a78a39f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.307859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.308615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.308894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.309193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] PATH_INFO: `/v3/users/598a9a80239b4961a49ef1a4d78e3d0c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.310502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] RBAC: Authorizing `identity:get_user(user_id=598a9a80239b4961a49ef1a4d78e3d0c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.311814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.313454 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 88/183] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/users/598a9a80239b4961a49ef1a4d78e3d0c => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.318911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.324578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.356246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b5b21-21e2-4d57-a9b2-6477f113b0de None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.389744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.390390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.390655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.390910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.392031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.393523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.395092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 96/184] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.395862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.423442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8f869-6baa-48fd-8995-62d35c057d34 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.458621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.459144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.459423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.459682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.494652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.496259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c3f-17b6-4f7c-a19b-c17fd3db269a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.530159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.531630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.532327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.532985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.533268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.533537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.541464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.544837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:07.549941 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:07.550966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:07.551776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 97/185] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:07.553880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.634981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 89/186] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:07.636442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.663828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b922b-71e7-42be-a092-2d07c8a43a42 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.698755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.699360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.699632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.699899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.700557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.700854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.702212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.702348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.710674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 98/187] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.711406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.741579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59891f-2576-4f39-919a-7cd273fb195a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.770586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.775040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.775646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.775928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.776753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.810337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920e5d-6dd0-42bf-9237-6e1c0d40c1c4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.843246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.843882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.844158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.844427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.844532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.846026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.855577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:07.860885 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:07.862014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:07.863187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 99/188] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:07.865494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.918814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.953544 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 90/189] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:07.959129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.970397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03800-dfc4-4899-81c4-9d3eb786e9a0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.992450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.005116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.005732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.006008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.006278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.006928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.008378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.029868 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 100/190] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:07 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:08.042076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.063787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc149-fedd-4929-bc41-fa7f72c598c9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.105622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.107052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.107524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.107966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.108862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:08.110080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.112027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.126522 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 91/191] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.127258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.163454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.170430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20307f-5598-473b-89f7-f24fa5a16dc6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.211379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.211379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.211679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.211898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.213083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.215073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.217420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 101/192] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.218096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.252052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430abba-4756-4af4-b9c2-37d4f03b8b54 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.270441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.295428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.296078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.297029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.297160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.313904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.315457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.317185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 92/193] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.317959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.342549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4804d9-0509-4da6-aaf4-269bcd675299 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.384591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.385414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.385864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.386192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.386921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:08.387280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.388674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.398021 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 102/194] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.398839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.428966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.447645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0222c-8757-48c4-a99e-a9fc1c1c31bf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.492104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.492742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.493119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.493392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.494542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.496733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.498975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 93/195] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.499779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.525461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72ae9-9e68-44ba-aef8-0ba4f4c9ee29 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.540022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.566065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.566811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.567161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.567502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] PATH_INFO: `/v3/users/b2e4136eee3b43878593830db499a951` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.568812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] RBAC: Authorizing `identity:get_user(user_id=b2e4136eee3b43878593830db499a951)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.570387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.572548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 103/196] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/users/b2e4136eee3b43878593830db499a951 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.574559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.635078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259795-6315-417b-a285-f66ea298a536 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.682511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.683140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.683421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.683695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.684428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=a4535d070e134ce68ed8ab7ee4c3c88a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:08.684737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.686231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.692835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 94/197] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/role_assignments?user.id=a4535d070e134ce68ed8ab7ee4c3c88a&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.693737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.721782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.723109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506eb31-4305-44ca-b066-73f32e76f41c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.805013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.805560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.805838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.806110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.902101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.920591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2bcb9-c13f-44f7-9562-a9ffd68db434 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.933326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.935355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.965219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.965858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.966134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.966399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.967673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.969277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.971086 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 95/198] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.971945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.063748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 104/199] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:09.069255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.086988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.102414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b8dec-6b8d-4ce0-b0f4-6c31ce6a994c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.148120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.148733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.149037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.149303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.150154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=598a9a80239b4961a49ef1a4d78e3d0c) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:09.150458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.151940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.162632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 96/200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/role_assignments?user.id=598a9a80239b4961a49ef1a4d78e3d0c&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:09.162632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.178250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.223066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0117438-0ba2-424b-97cf-f5d410ba02c8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.282400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b35ed-7326-49f2-9166-820c5dcb61eb None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.283518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.284513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.285132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.285619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.325327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.325874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.326149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.326413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.353322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.413002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.414561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.453812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.456041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.548839 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 97/201] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:09.549759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.587010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.629414 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 105/202] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:09.631196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.637587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.701537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715aaf6-17ba-4621-a6c1-b56b50fb8903 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.741943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.742572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.742848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.743116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.747390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.749454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.751451 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 98/203] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:09.752232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.777452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f62dca-a401-4b05-ad5c-23f81ab3cb78 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.826491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.827486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.828014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.828731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.830692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.832963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.835742 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 106/204] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:09.836853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.871979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faac-d383-4fd8-be64-d46b4cfbde37 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.895493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.907164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.914198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.914839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.915116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.915385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.916694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.919207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.921211 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 99/205] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:09.922234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.979933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496545e-6baa-416b-9799-461710dfbd9e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:10.026388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:10.027798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.028491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.028988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.030148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=7bfafc56ede4493e898153f770f20a8a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:10.031004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.032721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.041564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 107/206] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/role_assignments?user.id=7bfafc56ede4493e898153f770f20a8a&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:10.043225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:10.058620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868bbed-0fbb-405c-8353-393de3e38d3d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:10.162361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:10.162993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.163273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.163540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.164290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=7bfafc56ede4493e898153f770f20a8a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:10.164598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.166196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44e06-3bfb-424e-813e-7634fdd0bec7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.187001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 100/207] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/role_assignments?user.id=7bfafc56ede4493e898153f770f20a8a&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:10.218784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e5aa-8f79-4e52-87dc-9a954ec61ad3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:10.233393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:10.283613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:10.284618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.285136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.285642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.286728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49, user.id=b2e4136eee3b43878593830db499a951) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:10.287282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.289061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661da1d-a805-4c7c-b0f4-5a381ffdfe62 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.300323 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 108/208] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:10 2022] GET /identity/v3/role_assignments?user.id=b2e4136eee3b43878593830db499a951&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:10.613310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade56d8-e334-48e9-95ff-730559c94175 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.613816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade56d8-e334-48e9-95ff-730559c94175 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.613890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade56d8-e334-48e9-95ff-730559c94175 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.615233 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 101/209] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:10.621999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5450eb-edb1-4f71-9d4a-acfd0193dcd2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.623362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5450eb-edb1-4f71-9d4a-acfd0193dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.624014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5450eb-edb1-4f71-9d4a-acfd0193dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.652466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aa5450eb-edb1-4f71-9d4a-acfd0193dcd2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:10.653837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa5450eb-edb1-4f71-9d4a-acfd0193dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:10.733965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:10.799034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b7-2fd0-44e0-aa1c-49eaa13aa825 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.799355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b7-2fd0-44e0-aa1c-49eaa13aa825 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.799581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b7-2fd0-44e0-aa1c-49eaa13aa825 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.801247 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 102/211] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:10.806914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.807192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.807462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.828517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:10.829788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:10.906554 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:11.028816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c6b7-2fd0-44e0-aa1c-49eaa13aa825 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.090844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.155701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c6b7-2fd0-44e0-aa1c-49eaa13aa825 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.176522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.197006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.197891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.198163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.198492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.209714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:11.213153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:11.216110 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:11.217262 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:11.218706 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:11.225885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.303211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34be7b6-229e-44a4-8f9e-3bcb352a79df None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.352681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b1f98-c668-4844-af90-93a1efac4847 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.360175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.360842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.361158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.361432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.362675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.365206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.368659 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:11.374407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.375550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.402904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.403536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.403816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.404090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.404776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:11.405136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.406649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.416420 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 104/215] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:11.422938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.505756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.509193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f4259-6c9c-4acb-9439-33943d5a595e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.547581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.548457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.548569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.548770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.549550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.551022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.572323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ced7-0ef0-4b6f-9249-82c045f0ddc4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.578670 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 112/216] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:11 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:11.624313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.625060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.625329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.625652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] PATH_INFO: `/v3/users/d18cc67ad52a42079c6da1f4c135b72f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.642981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] RBAC: Authorizing `identity:get_user(user_id=d18cc67ad52a42079c6da1f4c135b72f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.644561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.646724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 105/217] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/users/d18cc67ad52a42079c6da1f4c135b72f => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:11.652629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.769773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9844d-7cc9-45d5-aa4e-958566b7ea6d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.806555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.807175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.807448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.807765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.834461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.882300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.883777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.992832 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 113/218] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:12.002459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.064821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.180023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc1d69-e5c7-42cf-ba46-77fc1b6868dc None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.235495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.236129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.236400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.236667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.237893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.239321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c49cc9-886e-433a-a905-616d680ff7b3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.240973 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 106/219] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:12.249751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.325864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.389896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b3b55-a54a-4b5d-bcf3-d6815c3e5367 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.463416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.464514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.465024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.465483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.466826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=d18cc67ad52a42079c6da1f4c135b72f) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:12.467354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.470069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af586055-5874-4ade-aad1-3d243c0e9c84 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.484475 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 114/220] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/role_assignments?user.id=d18cc67ad52a42079c6da1f4c135b72f&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:12.544406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34055a-d801-4cc5-9068-e9c9da23d50f None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.544736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34055a-d801-4cc5-9068-e9c9da23d50f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.544966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34055a-d801-4cc5-9068-e9c9da23d50f None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.546499 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 107/221] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:12.563814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef52f5c-fd0f-4945-8ae6-325e1fc14ca6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.564284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef52f5c-fd0f-4945-8ae6-325e1fc14ca6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.564745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef52f5c-fd0f-4945-8ae6-325e1fc14ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.611103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aef52f5c-fd0f-4945-8ae6-325e1fc14ca6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:12.613230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aef52f5c-fd0f-4945-8ae6-325e1fc14ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:12.760577 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 115/222] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:12.831590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2726-8aa4-4f7b-abbc-9f420881c215 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.832110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2726-8aa4-4f7b-abbc-9f420881c215 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.832110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2726-8aa4-4f7b-abbc-9f420881c215 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.833821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 108/223] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:12.839998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.840202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.840474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.859092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:12.860289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:12.915254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.938941 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 116/224] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:13.242436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2726-8aa4-4f7b-abbc-9f420881c215 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.261185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.409317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.414525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2726-8aa4-4f7b-abbc-9f420881c215 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.452440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.453111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.453390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.453660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.467037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:13.472161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:13.473056 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:13.474062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 109/225] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:13.480126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.499162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6bb4d-8040-440c-98cc-e43438807823 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.567013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.568021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.568516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.569004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.595935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72d8d-61cc-4618-9a4d-ecd0f384204f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.598902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:13.607213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:13.608158 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:13.608998 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 117/226] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:13.616104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.669760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.670395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.670674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.670944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.671639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:13.671942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.673427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.689237 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 110/227] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:13.700108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.705270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.749370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.816094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a31c-8081-4144-97dc-c7ab2a3b6928 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.890517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36639e-95a3-4f87-862d-233f8a4ee623 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.900314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.900960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.901243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.901510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.902302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:13.902608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.904006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.920008 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 118/228] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:13.929884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.945309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.945961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.946239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.946509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.950655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.952113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.954093 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 111/229] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:13.959814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:14.072198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:14.092698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c744e-1755-4b79-bae1-381feea879a4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:14.136696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4807c2-c4f7-4e62-bc5f-e89b231e4f6b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:14.138596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:14.139473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.140538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.142302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.143956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:14.144511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:14.146848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:14.150036 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 112/230] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:14.157972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:14.201531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:14.202550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.203073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.203581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.204974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:14.207058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:14.209182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 119/231] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:14.221305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:14.378432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09063d1-703f-48cb-9b8a-bf78153b4d61 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:14.415948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3ab4-d656-4f5f-add6-fe1b928be7f9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:14.423717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:14.425206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.425659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.426206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/7bfafc56ede4493e898153f770f20a8a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.429431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user_id=7bfafc56ede4493e898153f770f20a8a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:14.431252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b78156-2f35-465d-ad00-4c20a87cc5e7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:14.451575 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 113/232] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:14 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/7bfafc56ede4493e898153f770f20a8a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:14.453405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9373-f32e-4948-b059-7fd48f1dac84 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.453921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9373-f32e-4948-b059-7fd48f1dac84 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.454411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9373-f32e-4948-b059-7fd48f1dac84 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.454910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:14.455563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.455843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.456172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.456825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 114/233] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:14.457710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:14.459187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dab2c-8f40-4beb-a5c7-69e51ec524e2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:14.469322 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 120/234] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:14 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:14.470595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9373-f32e-4948-b059-7fd48f1dac84 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:14.471839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bc42-4a66-4b23-aaa0-250b12cda169 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.472152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bc42-4a66-4b23-aaa0-250b12cda169 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.472404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991bc42-4a66-4b23-aaa0-250b12cda169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.504364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a991bc42-4a66-4b23-aaa0-250b12cda169 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:14.509298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:14.509708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a991bc42-4a66-4b23-aaa0-250b12cda169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:14.588607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:14.639407 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 121/235] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:14.685387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9373-f32e-4948-b059-7fd48f1dac84 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:14.730714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:14.731421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.731698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.731967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/7bfafc56ede4493e898153f770f20a8a/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.735720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user_id=7bfafc56ede4493e898153f770f20a8a, role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:14.737256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424e675-2ced-4ca7-9273-85f38c785891 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:14.757367 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 115/236] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:14 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/7bfafc56ede4493e898153f770f20a8a/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:14.842306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80425-ae06-4c71-b49c-a97b21cc368a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.842845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80425-ae06-4c71-b49c-a97b21cc368a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.842845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80425-ae06-4c71-b49c-a97b21cc368a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.844277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 122/237] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:14.862909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.863249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.863456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.886739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:14.887962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:14.971127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a80425-ae06-4c71-b49c-a97b21cc368a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:14.993556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 116/238] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:15.145708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a80425-ae06-4c71-b49c-a97b21cc368a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.192022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.192687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.192978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.193246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.207658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8b3713e0-0163-43ca-b5fc-4c1079218cb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:15.212525 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:15.213479 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:15.214997 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 123/239] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:15.219701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.239937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.300946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3af67-0303-4dec-a912-c7aa99473dad None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.301273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3af67-0303-4dec-a912-c7aa99473dad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.301497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3af67-0303-4dec-a912-c7aa99473dad None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.303797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 124/240] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:15.312589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3af67-0303-4dec-a912-c7aa99473dad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.346300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.346683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db624f-1023-43c3-9e05-970fd62df553 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.383927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.384549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.384880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.385131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.385808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:15.386640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.388259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93e99f-0aa9-4e98-b419-549d2ed70e05 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.397344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 117/241] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:15.398673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.398907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.399178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.425337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:15.426553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:15.436544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3af67-0303-4dec-a912-c7aa99473dad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.477699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.478618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.479114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.479520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.481503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.483196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.485106 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 125/242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:15.486021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.497438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.508934 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 118/243] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:15.508934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.625716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df90b0-a5f5-40bf-a570-36779e62c70a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.627889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.668287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.669207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.669843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.671011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] PATH_INFO: `/v3/users/0e0e1a02db3e4eba953c33467ae98f6c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.692756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81665-13ff-46f3-9a10-b92a336237ee None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.704727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] RBAC: Authorizing `identity:get_user(user_id=0e0e1a02db3e4eba953c33467ae98f6c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.706657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.708928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 126/244] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/users/0e0e1a02db3e4eba953c33467ae98f6c => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:15.715895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.743081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.743924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.744199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.746606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.747210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.748734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.786103 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 119/245] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:15 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:15.881571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df6ac-874d-4621-aa56-a1c9c3080315 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.900827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.950939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.952037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.952520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.953075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.981466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.026199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.036563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.038583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.096761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f3d71-2791-4596-a5bb-a07b61096463 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.146677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.147589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.147830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.148099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.158379 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 127/246] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:16.160276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:16.164930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:16.172073 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:16.173033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:16.173837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 120/247] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:16.179421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.256230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.319392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf23ee-c7a7-4e27-9703-d5aeaf2e305e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.320338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e705-a099-4ed7-a229-2b8b94551d83 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.337594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.366417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.367101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.367305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.367575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.368250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.368537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.372299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.372721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.373593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.374260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.374705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.376395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.378564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.382880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 128/248] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:16.385919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 121/249] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.393203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.396612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.533488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a5bf-ea6b-4fef-b604-3c86650f7158 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.546061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712597a-e9b4-46ba-ba10-8bdd98e09d36 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.567807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.587042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.587042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.587042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.587042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] PATH_INFO: `/v3/users/d18cc67ad52a42079c6da1f4c135b72f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.588194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] RBAC: Authorizing `identity:get_user(user_id=d18cc67ad52a42079c6da1f4c135b72f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.591943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.596290 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 129/250] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/users/d18cc67ad52a42079c6da1f4c135b72f => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.601791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.603349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.604199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.604678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.605666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.607768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=0e0e1a02db3e4eba953c33467ae98f6c) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.608298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.610075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.622040 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 122/251] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/role_assignments?user.id=0e0e1a02db3e4eba953c33467ae98f6c&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.741300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f5543-dc69-4fa3-bb74-420e989f6c93 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.784579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.785702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.786187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.786660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.788137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.789866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df086728-b270-4978-b0fd-135aa1f76c4b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.792186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 130/252] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:16.797821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.877466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.961324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b749-9253-475f-aad7-7f484c60b077 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.009481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.010159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.010435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.010702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/d18cc67ad52a42079c6da1f4c135b72f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.012724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user_id=d18cc67ad52a42079c6da1f4c135b72f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.014226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be23c55-f4e0-46fa-825a-f3c5cc57a1d6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.037229 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 123/253] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:16 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/d18cc67ad52a42079c6da1f4c135b72f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:17.219336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cde9c-e836-43b5-9496-e174751e6431 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.219873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cde9c-e836-43b5-9496-e174751e6431 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.219873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cde9c-e836-43b5-9496-e174751e6431 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.221553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 131/254] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:17.227547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351f8-f2bf-4235-b47f-a28c639beaec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.227884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351f8-f2bf-4235-b47f-a28c639beaec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.228162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a351f8-f2bf-4235-b47f-a28c639beaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.251664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-95a351f8-f2bf-4235-b47f-a28c639beaec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:17.252872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-95a351f8-f2bf-4235-b47f-a28c639beaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:17.332289 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 124/255] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:17.616171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cde9c-e836-43b5-9496-e174751e6431 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.703632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.705937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070fc8-38b2-478e-af03-b8d58b1554f7 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.706259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070fc8-38b2-478e-af03-b8d58b1554f7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.706561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070fc8-38b2-478e-af03-b8d58b1554f7 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.708077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 125/256] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:17.724165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.724464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.724697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.753935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:17.755467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:17.787933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cde9c-e836-43b5-9496-e174751e6431 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.821273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.885776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.886397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.886705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.886974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.942097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:17.947112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:17.948020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:17.949818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 132/257] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:17.958175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.978567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 126/258] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:18.145020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b064fc-ac28-46c8-bc21-c24b865a4499 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.170619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.198153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.199908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.200413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.200883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.201839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:18.202338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.203937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.218037 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:18.223954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.356988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0c86-c12b-417c-baef-c00e599121f1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.405643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.406288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.406560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.406829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.408010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.409484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.411292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 127/260] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:18.416838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.462678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.539647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.633258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b28e5c-a786-4609-a173-56fe4c8285e4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.693882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.694420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.694813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.695083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.712039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b79e-cd6c-49d2-9ea0-e8fae4744e07 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.791041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.794852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.795760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.796262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.801276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.818730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:18.824390 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:18.825326 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:18.826205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:18.829558 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 128/261] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:18.835468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.836046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.837056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.997111 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 134/262] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:19.002718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:19.015604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:19.027886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb42f80-8d79-45ed-82ff-20c6ec6d3463 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:19.091803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:19.092413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.092688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.093004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.094251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:19.094555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:19.096519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:19.109705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 129/263] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:19.116147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:19.148290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:19.175133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a3ba-1fc4-4580-9ff8-90f3029cb93e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:19.235814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:19.236472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.236749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.237041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.242960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:19.244460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:19.247698 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 135/264] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:19 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:19.266880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:19.316413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da6a8-6780-4cd3-8239-5fe67c9ec200 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:19.386939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:19.387578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.387853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.388117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] PATH_INFO: `/v3/users/7bfafc56ede4493e898153f770f20a8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.389451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] RBAC: Authorizing `identity:get_user(user_id=7bfafc56ede4493e898153f770f20a8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:19.390902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:19.394759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 130/265] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:19 2022] GET /identity/v3/users/7bfafc56ede4493e898153f770f20a8a => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:19.399882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:19.445413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:19.470859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0870-7118-4e0d-9058-83775b1d1814 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:19.548389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579372-7784-4845-a2cb-56eecb2b4b04 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:19.555006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:19.555739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.556088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.556431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.557270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=7bfafc56ede4493e898153f770f20a8a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:19.557645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:19.559876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:19.575595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 136/266] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:19 2022] GET /identity/v3/role_assignments?user.id=7bfafc56ede4493e898153f770f20a8a&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:19.587556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:19.588317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.588692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.589100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.669067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:19.670594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f657-e15f-4e94-bc4a-4048ed43bb6c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:19.696692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:19.790237 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 131/267] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:19.796662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:19.799481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340a6c-7200-4d87-9a9b-759fb1bb5408 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.800121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340a6c-7200-4d87-9a9b-759fb1bb5408 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.800541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340a6c-7200-4d87-9a9b-759fb1bb5408 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.802433 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 132/268] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:19.808131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.808714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.809165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.824833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:19.838446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:19.839961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:19.988641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869c016-8131-49ee-92d9-762087fc184e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.017938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 133/269] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:20.033009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.033830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.034210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.034573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.035856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.037519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333f31d-2aef-4002-a2bd-02eadba79a3e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.039416 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 137/270] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:19 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:20.045444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.090867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314741-2319-4469-9e58-87566052213d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.091055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314741-2319-4469-9e58-87566052213d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.091317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314741-2319-4469-9e58-87566052213d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.092714 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 138/271] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:20.100080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184af73-1347-4c02-aaae-8b62ecbb2923 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.100508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184af73-1347-4c02-aaae-8b62ecbb2923 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.100874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184af73-1347-4c02-aaae-8b62ecbb2923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.125670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7184af73-1347-4c02-aaae-8b62ecbb2923 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:20.127171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7184af73-1347-4c02-aaae-8b62ecbb2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:20.166618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.220816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 139/272] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:20.222256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6e8d-dcf2-40d0-b3e3-355ba7bceb33 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.222534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6e8d-dcf2-40d0-b3e3-355ba7bceb33 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.225318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6e8d-dcf2-40d0-b3e3-355ba7bceb33 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.226757 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 140/273] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:20.227855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7953-f953-4059-a0c1-29014585aee5 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.228130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7953-f953-4059-a0c1-29014585aee5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.228394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7953-f953-4059-a0c1-29014585aee5 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.230195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 141/274] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:20.233737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.234018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.234289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.250306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee402-0a58-4882-8b2c-5cae8ecb1256 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.257873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:20.259068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:20.263432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.291198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.292139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.292594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.293086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.294065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=7bfafc56ede4493e898153f770f20a8a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:20.294629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.296266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65057a-8ea0-40fb-8021-9e0aa8f24db8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.304143 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 134/275] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/role_assignments?user.id=7bfafc56ede4493e898153f770f20a8a&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:20.305665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172043-4737-424b-b22c-fc711476dd4a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.306090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172043-4737-424b-b22c-fc711476dd4a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.306558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172043-4737-424b-b22c-fc711476dd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.341595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-16172043-4737-424b-b22c-fc711476dd4a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:20.342199 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 142/276] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:20.343722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16172043-4737-424b-b22c-fc711476dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:20.397416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.486014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 135/277] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:20.519092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172043-4737-424b-b22c-fc711476dd4a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.543894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34cdd-4b1e-4b2c-8b30-f7e273838656 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.581267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.610503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.610503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.610503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.610503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.623272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.626607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:20.632850 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:20.633824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:20.634626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:20.637838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 143/278] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:20.647410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.673068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172043-4737-424b-b22c-fc711476dd4a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.721152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.722251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.722733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.723200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.725107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.726799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.729003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 136/279] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:20.729880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.790567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990123ae-8623-4682-99cc-ff74fa966dc9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.833293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.833904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.834182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.834452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.835111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:20.835409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.836808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.841792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099ef78-657f-4322-a62e-d2d363fdfb84 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.845636 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 144/280] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:20.846422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.854754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.876816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.877401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.877677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.877944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.888443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:20.893789 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:20.894675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 137/281] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:20.895704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.910470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.952419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06990fa-2e99-4e52-84e9-1d7efed5110c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.986628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.987231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.987504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.987774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.988420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.989885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.996322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b4d8-c36b-4970-8863-17027410271f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.010688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 145/282] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:21.011489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.041310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.041970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.042248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.042791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.058147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:21.065363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:21.066339 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:21.067135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:21.070955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 138/283] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:21.070955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.108428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.135282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665d4b-df09-4ac8-b150-a544b0d7f67d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.158684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.178533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.179229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.179454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.179724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] PATH_INFO: `/v3/users/7003627d334a44a88894e1ea13dc5a1c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.191285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f1ab-4951-4f0f-a9cc-6b6981c8dfa6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.197964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] RBAC: Authorizing `identity:get_user(user_id=7003627d334a44a88894e1ea13dc5a1c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.200256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.202429 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 146/284] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/users/7003627d334a44a88894e1ea13dc5a1c => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.202760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.240074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.240694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.241130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.241399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.242192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:21.242495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.243892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.258999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 139/285] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.259872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.337308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29138427-e891-4568-a07e-41cfb6b88b4b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.372751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.376834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.376834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.377348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.377515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.378194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:21.378787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.379966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.382616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eae4a-c2b0-4aac-baa4-58f1c48b9b22 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.393188 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 147/286] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.397059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.422516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.423138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.423415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.423683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.424423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, user.id=7003627d334a44a88894e1ea13dc5a1c, scope.system=all) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:21.424730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.426221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.438004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 140/287] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/role_assignments?user.id=7003627d334a44a88894e1ea13dc5a1c&scope.system=all&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.438004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.448057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.519543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862ef5-19c8-4c3e-a6bc-b79fe23ff6e5 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.556461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce4f6b-4c69-4682-bea3-b8daaeb985ce None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.558228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.560012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.560519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.561022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] PATH_INFO: `/v3/users/0e0e1a02db3e4eba953c33467ae98f6c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.562573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] RBAC: Authorizing `identity:get_user(user_id=0e0e1a02db3e4eba953c33467ae98f6c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.564292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.566246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 148/288] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/users/0e0e1a02db3e4eba953c33467ae98f6c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.578198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.596433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.597128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.597454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.600559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] PATH_INFO: `/v3/users/d18cc67ad52a42079c6da1f4c135b72f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.601938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] RBAC: Authorizing `identity:get_user(user_id=d18cc67ad52a42079c6da1f4c135b72f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.605354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.605354 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 141/289] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/users/d18cc67ad52a42079c6da1f4c135b72f => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.618568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.666197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.757425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09d86b-8e99-43b6-8c02-0ed3d27facc6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.764412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2268a80-e9e5-46f3-9b9a-1898784cf140 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.771833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.805637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.806916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.807423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.808172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.832611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.836293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.836794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.837309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.840406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.842287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.851674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 149/290] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.854337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.967349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.968774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.977127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0dd3-4e1e-4871-9ed9-ec336925deb0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.014245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.015301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.015783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.016275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/0e0e1a02db3e4eba953c33467ae98f6c/roles/6f9ac96918ec42bc840e6cde97bc6cd9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.018471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user_id=0e0e1a02db3e4eba953c33467ae98f6c, role_id=6f9ac96918ec42bc840e6cde97bc6cd9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.020132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.037388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.044242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 150/291] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:21 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/users/0e0e1a02db3e4eba953c33467ae98f6c/roles/6f9ac96918ec42bc840e6cde97bc6cd9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:22.176546 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 142/292] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:22.182627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.246579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.326119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc5b-c2a6-43db-8a36-c1144ffee636 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.366891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.367525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.367803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.368076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.369244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.370711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55559f1-c864-4e47-a184-f91169fca0dc None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.373254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 151/293] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:22.379605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.484637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f17321-2161-41c2-bbdf-cddd5314b875 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.513542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.521687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.522297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.522575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.522847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.523574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=d18cc67ad52a42079c6da1f4c135b72f) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:22.523882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.525361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda63f-550a-4371-913a-619b07da5a52 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.532721 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 143/294] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/role_assignments?user.id=d18cc67ad52a42079c6da1f4c135b72f&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:23.717916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cd36-6cba-4789-bf0f-ef8e9dafba00 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.718635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cd36-6cba-4789-bf0f-ef8e9dafba00 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.718635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cd36-6cba-4789-bf0f-ef8e9dafba00 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.719894 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 152/295] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:23.725989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898fc3-0bc3-4264-9673-579db2412c48 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.726632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898fc3-0bc3-4264-9673-579db2412c48 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.726632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898fc3-0bc3-4264-9673-579db2412c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.746746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fb898fc3-0bc3-4264-9673-579db2412c48 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:23.747958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb898fc3-0bc3-4264-9673-579db2412c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:23.820227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 144/296] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:23.833719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1f30-a4ea-4629-8fd8-727dc8db4f99 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.834017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1f30-a4ea-4629-8fd8-727dc8db4f99 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.834272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1f30-a4ea-4629-8fd8-727dc8db4f99 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.835687 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 153/297] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:23.841651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465014-d481-451c-ad0f-4a4e3cb0e9cd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.841933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465014-d481-451c-ad0f-4a4e3cb0e9cd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.842208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465014-d481-451c-ad0f-4a4e3cb0e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.860930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-91465014-d481-451c-ad0f-4a4e3cb0e9cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:23.862135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-91465014-d481-451c-ad0f-4a4e3cb0e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:23.932708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 145/298] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:24.094836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa1f30-a4ea-4629-8fd8-727dc8db4f99 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.115401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ae3-e66d-4d9a-b2bf-cb61ff02aa40 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.116012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ae3-e66d-4d9a-b2bf-cb61ff02aa40 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.116494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ae3-e66d-4d9a-b2bf-cb61ff02aa40 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.118338 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 146/299] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:24.124361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.124944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.125464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.151353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:24.153121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:24.214352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.224112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa1f30-a4ea-4629-8fd8-727dc8db4f99 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.226334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.239630 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:24.241810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.270166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.270810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.271087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.271354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.282719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:24.288234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:24.289186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:24.289997 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 154/301] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:24.295888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.363952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93865d0b-64b3-427d-80d4-6c5c66963e89 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.402451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d5c13-e740-4057-a0f3-ec3770cd9a79 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.407392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.408300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.408782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.409297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.411093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.413160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.415629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 148/302] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:24.422261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.441115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.441768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.442049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.442319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.442987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:24.443341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.444734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.454502 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 155/303] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:24.460727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.481511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.489378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.548154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c8fc-54ac-432d-8c46-441e220dd8d4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.579561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94272fc-65d1-4dd0-b4a5-968847d93975 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.591159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.592168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.592452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.592721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] PATH_INFO: `/v3/groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.595883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.595883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.611946 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 149/304] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Oct 28 09:34:24 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:24.611946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.628886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.629885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.630368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.630775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] PATH_INFO: `/v3/users/892e5ff8189847c08d155fbaa2d93653` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.648497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] RBAC: Authorizing `identity:get_user(user_id=892e5ff8189847c08d155fbaa2d93653)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.650302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c6bc2-1f47-4aaa-9f7f-3e7b50800a4f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.653333 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 156/305] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/users/892e5ff8189847c08d155fbaa2d93653 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:24.654891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4790d0-6041-4c3a-b908-fa7bd6c55f8a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.655172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4790d0-6041-4c3a-b908-fa7bd6c55f8a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.655483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4790d0-6041-4c3a-b908-fa7bd6c55f8a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.657033 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 157/306] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:24.660444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4790d0-6041-4c3a-b908-fa7bd6c55f8a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.739026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ae4f8-3097-45e8-98c2-f90a023744b5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.751260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.762201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.782589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.783263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.783540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.783801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.784133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4790d0-6041-4c3a-b908-fa7bd6c55f8a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.796033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-46385fc4-04f4-4379-b413-3c2d09ca06f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:24.801679 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:24.802590 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:24.803455 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 150/307] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:24.804251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.804339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.804934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.826059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:24.828420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:24.830330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.831081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.831950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.831950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.833174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, user.id=892e5ff8189847c08d155fbaa2d93653, scope.system=all) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:24.833174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.835408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.843978 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 158/308] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/role_assignments?user.id=892e5ff8189847c08d155fbaa2d93653&scope.system=all&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:24.845042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.925005 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 151/309] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:24.981833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37c0f-609b-4a32-859f-6f47b3f56fec None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.022421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.023043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.023320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.023586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.024262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:25.024561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.026083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.035699 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 159/310] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.041411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.142661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.146561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93453f-cc87-4d57-b30d-22501dd2152e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.188967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.189537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.189815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.190087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] PATH_INFO: `/v3/users/7003627d334a44a88894e1ea13dc5a1c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.191238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] RBAC: Authorizing `identity:get_user(user_id=7003627d334a44a88894e1ea13dc5a1c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.192681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.194611 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 152/311] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/users/7003627d334a44a88894e1ea13dc5a1c => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.201082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.215020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.218367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.333459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f7d6b-ccc6-4f62-91fe-330e3d2e645e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.337008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8f0c-642d-4271-8a87-aba1ae59189e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.376795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.377789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.378125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.378424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.378703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.378974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.379203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.379670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] PATH_INFO: `/v3/system/users/7003627d334a44a88894e1ea13dc5a1c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.381390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7003627d334a44a88894e1ea13dc5a1c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.382973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.392353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:25.394245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 160/312] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Oct 28 09:34:25 2022] PUT /identity/v3/system/users/7003627d334a44a88894e1ea13dc5a1c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:25.401986 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:25.403483 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:25.404299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:25.407009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 153/313] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:25.413577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.505410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.535739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd115c-e498-4e3c-a2b8-4c082d04c287 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.575262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a913-d313-4274-997f-681521f3aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.575893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a913-d313-4274-997f-681521f3aace None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.576163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a913-d313-4274-997f-681521f3aace None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.576426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a913-d313-4274-997f-681521f3aace None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.577188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296a913-d313-4274-997f-681521f3aace None admin] RBAC: Adding query filter params (name=reader) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:25.577488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296a913-d313-4274-997f-681521f3aace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.578949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296a913-d313-4274-997f-681521f3aace None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.588891 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 161/314] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.598903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.630649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.709302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2af6-7d9e-4340-88e7-648860553cda None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.745486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.746975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.747458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.747951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] PATH_INFO: `/v3/users/0e0e1a02db3e4eba953c33467ae98f6c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.749384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] RBAC: Authorizing `identity:get_user(user_id=0e0e1a02db3e4eba953c33467ae98f6c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.751031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.753195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 154/315] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/users/0e0e1a02db3e4eba953c33467ae98f6c => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.761371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a913-d313-4274-997f-681521f3aace None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.868131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a913-d313-4274-997f-681521f3aace None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.903203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.903807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.904079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.904342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.907061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.974571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.976039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:26.076937 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:26.082437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:26.191367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:26.198166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18c7be-bfbf-4e1b-90b2-ce2defab2c6b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:26.236747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:26.237411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.237686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.237953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.239081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:26.240518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6031fd-6a11-44d3-9ffa-98a439052260 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:26.242520 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 155/317] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:26 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:26.248985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:26.293277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:26.352253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5bbe-9ad0-4a16-936c-10a5a3580cb6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:26.387765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:26.388370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.388640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.388922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.389656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, user.id=0e0e1a02db3e4eba953c33467ae98f6c) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:26.389958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:26.391436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c4b63-1cb4-4636-8e61-be8189a0c9e6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:26.398691 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 163/318] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:26 2022] GET /identity/v3/role_assignments?user.id=0e0e1a02db3e4eba953c33467ae98f6c&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:26.889987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3121-2fab-4c59-b9d0-8c24815d6850 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.890509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3121-2fab-4c59-b9d0-8c24815d6850 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.890509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3121-2fab-4c59-b9d0-8c24815d6850 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.892045 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 156/319] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:26.897327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1669-17d0-4e2c-86a5-02d35172d0c5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.897747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1669-17d0-4e2c-86a5-02d35172d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.897845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c1669-17d0-4e2c-86a5-02d35172d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.916540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f7c1669-17d0-4e2c-86a5-02d35172d0c5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:26.917763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f7c1669-17d0-4e2c-86a5-02d35172d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:26.992944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 164/320] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:27.078342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9955d-a2a0-451f-b2d7-c1436459e7c1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.078677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9955d-a2a0-451f-b2d7-c1436459e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.078887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9955d-a2a0-451f-b2d7-c1436459e7c1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.080377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 157/321] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:27.085843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.086126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.086397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.107201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:27.108423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:27.135167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.185378 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 165/322] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:27.265939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9955d-a2a0-451f-b2d7-c1436459e7c1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.377525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9955d-a2a0-451f-b2d7-c1436459e7c1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.413512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.414156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.414428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.414698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.415865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:27.417370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:27.419703 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 158/323] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:27.425202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.456279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.493501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.543967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd694-20d0-4eb1-af91-9f5c25bd942d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.587687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.588380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.588652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.588974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.589638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:27.591155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:27.595002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81969-b5e8-42a3-8593-02dde45beafb None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.615972 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 166/324] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Oct 28 09:34:27 2022] POST /identity/v3/groups => generated 226 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:27.648419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.649130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.649408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.649670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.662529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-9460c6ad-5afa-43c3-bca6-ca6e01a04269 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:27.668242 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:27.669528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:27.670382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:27.671551 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 159/325] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:27.676178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.701007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.711511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372efb0c-c7ab-46e7-bc37-33b724c761ae None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.712475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372efb0c-c7ab-46e7-bc37-33b724c761ae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.712969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372efb0c-c7ab-46e7-bc37-33b724c761ae None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.714749 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 160/326] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:27.721709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.721990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.722320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.743165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:27.744503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:27.803143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6e12b-8228-4d41-b10b-be5983a81dc2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.823754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 161/327] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:27.839250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.839860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.840129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.840930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.841599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:27.841893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:27.843253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:27.851399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 167/328] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:27.857215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.879829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.967011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d01d4-4112-4bb5-94bd-ff2ea3b8d03b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.002193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.002853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.003106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.003373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] PATH_INFO: `/v3/users/892e5ff8189847c08d155fbaa2d93653` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.004499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] RBAC: Authorizing `identity:get_user(user_id=892e5ff8189847c08d155fbaa2d93653)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.005983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.007786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 162/329] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/users/892e5ff8189847c08d155fbaa2d93653 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:28.013774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.095014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.108669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:28.131379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b32f2-ce01-4f49-b526-e6af6016d23b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.178386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.179059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.179333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.179608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] PATH_INFO: `/v3/system/users/892e5ff8189847c08d155fbaa2d93653/roles/6f9ac96918ec42bc840e6cde97bc6cd9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.181125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=892e5ff8189847c08d155fbaa2d93653, role_id=6f9ac96918ec42bc840e6cde97bc6cd9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.182512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.193786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 168/330] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Oct 28 09:34:28 2022] PUT /identity/v3/system/users/892e5ff8189847c08d155fbaa2d93653/roles/6f9ac96918ec42bc840e6cde97bc6cd9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:28.206434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:28.223990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da3f6-42a4-4fd4-b4af-bc28315b2658 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.267220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.267939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.268345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.268624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.284044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:28.289880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:28.290837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:28.291616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 163/331] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:28.299222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.416600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b12f5-d13f-4ce3-8d97-53202907530e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.452201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.452818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.453141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.453392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.454059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:28.454359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.455756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.465160 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 169/332] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:28.471096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.581126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596d15-ff41-4761-b399-5f222fcd5c7d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.626684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.627316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.627591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.627854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] PATH_INFO: `/v3/users/7003627d334a44a88894e1ea13dc5a1c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.629006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] RBAC: Authorizing `identity:get_user(user_id=7003627d334a44a88894e1ea13dc5a1c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.630448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc67e1-8ae0-4bfa-a937-8ac3e0f77cae None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.632112 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 164/333] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:28 2022] GET /identity/v3/users/7003627d334a44a88894e1ea13dc5a1c => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:28.638439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.648300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:28.758075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1844-0a6e-4061-a237-f7cf5edad775 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.796345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.796980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.797261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.797528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.798257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] RBAC: Adding query filter params (role.id=5c0f3bf97ca0422cb9f85126cf037e6a, user.id=7003627d334a44a88894e1ea13dc5a1c, scope.system=all) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:28.798562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.800085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c927725-42d9-4123-b9c0-c61d8ed2c774 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.812781 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 170/334] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Oct 28 09:34:28 2022] GET /identity/v3/role_assignments?user.id=7003627d334a44a88894e1ea13dc5a1c&scope.system=all&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:30.383398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1cb6-2c36-4ba5-86e2-a26f429fb7cf None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.384016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1cb6-2c36-4ba5-86e2-a26f429fb7cf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.384016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1cb6-2c36-4ba5-86e2-a26f429fb7cf None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.385728 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 165/335] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:30.398950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d390-565f-41c9-a460-4d0e703d46f0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.399504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d390-565f-41c9-a460-4d0e703d46f0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.399504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d390-565f-41c9-a460-4d0e703d46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.426140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7bd0d390-565f-41c9-a460-4d0e703d46f0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:30.427397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7bd0d390-565f-41c9-a460-4d0e703d46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:30.498960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:30.509700 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 171/336] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:30.659071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8740a2-0574-4ac5-b3b3-b9198f8bf355 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.659355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8740a2-0574-4ac5-b3b3-b9198f8bf355 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.659849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8740a2-0574-4ac5-b3b3-b9198f8bf355 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.661797 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 166/337] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:30.668852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.669483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.669950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.698065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:30.699620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:30.799112 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:30.966239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8740a2-0574-4ac5-b3b3-b9198f8bf355 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:30.992515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:31.101393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8740a2-0574-4ac5-b3b3-b9198f8bf355 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:31.154413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:31.155074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.155352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.155625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.168316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-2880af31-ed6b-4193-becf-2c974411966e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:31.174549 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:31.176271 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:31.177797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:31.184945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 167/339] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:31.185345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:31.349141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8f52-3fef-4207-9940-51230fb0c029 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.349370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8f52-3fef-4207-9940-51230fb0c029 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.349577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8f52-3fef-4207-9940-51230fb0c029 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.355503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 168/340] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:31.357431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.357953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.358414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.394644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81c2b-0ee3-4719-869f-85c26ffb70d9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:31.419712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:31.421990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:31.486268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:31.525070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:31.526714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.527478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.528786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.530592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:31.531357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:31.534606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:31.556335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 173/341] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:31.557970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:31.639751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 169/342] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:31.641826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:31.664953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:31.838505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a53d2-1b17-4105-8746-1613d9b0d976 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:31.941860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:31.943501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.944215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.944941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.952158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7b645-0efc-4510-a146-39e67a3e4718 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:31.981054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-fdcb125b-3c28-4850-bbf5-bea836040532 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:31.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:31.999269 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 174/343] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:32.000857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d677-916d-47e2-bf79-7dc41e24c974 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.002387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d677-916d-47e2-bf79-7dc41e24c974 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.002387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d677-916d-47e2-bf79-7dc41e24c974 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.002387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 175/344] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:32.005904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730d677-916d-47e2-bf79-7dc41e24c974 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:32.032597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.033252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.033523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.033800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.127495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.152238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:32.155337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:32.178792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.285414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730d677-916d-47e2-bf79-7dc41e24c974 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:32.331508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.332158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.332433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.332685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.333391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:32.333911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:32.335650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6359-ad40-4a71-8115-c3221830c487 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:32.347771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 176/345] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:32.353820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.355980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.357082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.392153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:32.395179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:32.410347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 170/346] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:32.410347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:32.520820 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:32.522039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:32.588886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.611492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77394c-2eb4-4892-bfc4-a419e2c56546 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:32.630774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.697718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.698413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f0ad-4e1d-4726-872c-2f6d2b742e63 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:32.698769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.699256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.699817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.721802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:32.732343 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:32.733630 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:34:32.734744 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:32.740952 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 171/348] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:32.740952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:32.756427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.757452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.758628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.759097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.854172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:32.856851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:32.913795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.935901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a296-7381-42e8-ac80-afbb6e7c8942 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:32.986342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addad512-35d2-4817-b525-092f6698122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.987814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad512-35d2-4817-b525-092f6698122e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.988579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad512-35d2-4817-b525-092f6698122e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.989068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addad512-35d2-4817-b525-092f6698122e None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.990646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addad512-35d2-4817-b525-092f6698122e None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:32.992398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addad512-35d2-4817-b525-092f6698122e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:32.994927 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 172/349] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:32 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:32.996453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc25-26f6-46cb-b222-2caa640f9df4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.996996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc25-26f6-46cb-b222-2caa640f9df4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.998318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc25-26f6-46cb-b222-2caa640f9df4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.000956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 173/350] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:33.002075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adc25-26f6-46cb-b222-2caa640f9df4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.017411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 178/351] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:33.018614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.073522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.166684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adc25-26f6-46cb-b222-2caa640f9df4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.225154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7636fb-06b5-45e2-b691-cdae4b364f13 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.226535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.227381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.227841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.228299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.229489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:33.229992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:33.233047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:33.248743 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 174/352] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:33.250169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.298405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.299374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.299842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.300304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.314912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.326447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-f2ea1a56-20fc-470c-abbd-038a901046d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:33.333350 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:33.335167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:33.336982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:33.342902 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 179/353] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:33.346622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.347088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.347549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.383408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:33.385297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:33.461481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.471132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3fc25-0f1c-43ef-8737-5626b121449f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.540201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.540665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 180/354] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:33.541704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.542021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.542176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.543550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.553552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:33.555235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:33.560124 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 175/355] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:33.560489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.786740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6f47-e249-4278-9fb4-875e0f99d0eb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.797339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8d31-9ec4-42cf-a210-1878b3281817 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.854609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.861897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.863182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.863662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.864149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] PATH_INFO: `/v3/users/892e5ff8189847c08d155fbaa2d93653` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.866779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] RBAC: Authorizing `identity:get_user(user_id=892e5ff8189847c08d155fbaa2d93653)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:33.870045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:33.872954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 176/356] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/users/892e5ff8189847c08d155fbaa2d93653 => generated 293 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:33.876948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.884457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.886052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.886870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.887717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.890877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:33.894169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:33.897926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 181/357] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:33.899996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.931538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.055420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b711-dd58-4080-bcef-4a17967e867d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.068653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bb4-507a-4c40-95a7-ab9cee27567c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.116625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.117283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.117572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.117813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.118085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.118492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:34.119547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.119711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.119711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.119985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.120298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.121550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:34.121755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.124332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.130448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 177/358] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.131311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.134932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 182/359] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.135788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.246451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.305369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.323999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb3aca-299d-49ca-860f-23177dda46d6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.330594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc22b-2631-4d69-81ab-59669646130a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.372046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.373188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.373464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.373727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.374472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] RBAC: Adding query filter params (role.id=6f9ac96918ec42bc840e6cde97bc6cd9, user.id=892e5ff8189847c08d155fbaa2d93653, scope.system=all) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:34.374778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.376264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ec439-b38c-4526-9567-882b66a71cac None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.390931 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 178/360] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/role_assignments?user.id=892e5ff8189847c08d155fbaa2d93653&scope.system=all&role.id=6f9ac96918ec42bc840e6cde97bc6cd9 => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.392827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89f35-a605-42fd-99a2-67e50ff744e4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.393163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89f35-a605-42fd-99a2-67e50ff744e4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.393422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89f35-a605-42fd-99a2-67e50ff744e4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.395120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 179/361] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:34.397501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89f35-a605-42fd-99a2-67e50ff744e4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.409788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.410465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.410746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.411018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.413847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.416364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.418425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.419401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.594023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89f35-a605-42fd-99a2-67e50ff744e4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.663079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0db0bf-65c4-4ca6-bc3d-b1c77616d289 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.670571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.671761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.672319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.672869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.693521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-29eae315-5fc5-4f6f-8466-687ddb96b49c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:34.704954 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:34.706656 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:34.708177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 180/363] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:34.714886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77d77-5772-4520-8bd5-43373016847e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.714886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77d77-5772-4520-8bd5-43373016847e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.715443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77d77-5772-4520-8bd5-43373016847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.726574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.742978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.743604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.743901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.744149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.748536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-70f77d77-5772-4520-8bd5-43373016847e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:34.751288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70f77d77-5772-4520-8bd5-43373016847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:34.755432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.854985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.857355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.881413 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:34.882544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77d77-5772-4520-8bd5-43373016847e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.021630 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:35.023114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.074836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77d77-5772-4520-8bd5-43373016847e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.081058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:35.138929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.139903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.143602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.144059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.145412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:35.145788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.148823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.169208 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.170994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.181487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:35.301184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8d3d-dc97-4e51-9736-807eeecc3a3a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.352727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.352727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.352727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.352727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.353306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:35.353388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.356033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.369823 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.376623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.430559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db6802-f263-4924-abe1-5cb52fadd8a5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.485522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.486919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.487780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.488355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.490909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.493375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.496801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.498428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.557544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:35.601341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f368-fbc2-45e0-a513-c1de8d70475a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.656950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:35.694854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.695646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.695804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.696132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.723194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:35.725835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7e9d-a947-49cf-8b07-a39afb606c5e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:35.731611 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:35.734007 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:35.743192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.781807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.787157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.787533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.787688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.898710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ddb-12b1-42d2-9df4-7978fb41a2b5 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.945887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.947405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.958038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.958685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.958957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.959219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.960413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.961921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.964516 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 187/370] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.968389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.001187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.129409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.133527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440398-96ec-48cd-8581-dfcb1c8c8582 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.190320 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 184/371] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:36.192249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.215235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.215750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.216029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.216976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.217105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:36.217403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.218812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.230383 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 188/372] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.231312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.345140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952c4b6-0178-43ff-b275-89aa4b6403aa None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.353435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.384312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12f79-f6f4-4a0e-8bba-506d4bd2704f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.392755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.393399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.393676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.393943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.394677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:36.394981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.396591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.402828 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 185/373] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.403875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.433274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.434301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.434784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.435319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.437524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.439360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.442384 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 189/374] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.452847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.505557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.667601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2260-a8cf-4077-a751-f6909b56fd0e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.696950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f15c-e291-4639-b323-b3e9fcb89873 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.748784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.750596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.751385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.751664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.751932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.753362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.753531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.753668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.753972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.755023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.757355 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 190/375] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.765230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.797671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.943456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6e56-defd-41aa-81fb-c3e7406e5e54 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.986665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.990778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:37.033069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:37.033655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.034003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.034278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.035014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:37.035317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:37.036860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c88ed-2ee1-4592-93d8-db6bd5c316f6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:37.047997 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 191/376] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:37.047997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f092-0bc2-4a6b-9779-3cdc724f6e14 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.047997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f092-0bc2-4a6b-9779-3cdc724f6e14 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.047997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f092-0bc2-4a6b-9779-3cdc724f6e14 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.054269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 192/377] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:37.062224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:37.062471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.062827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.063098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.106004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:37.107907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:37.157538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 186/378] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:37.159663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:37.275409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:37.366923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8adb0b-ca49-4e15-b4ae-e793a4686aa6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:37.434648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:37.436737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.437551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.438345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] PATH_INFO: `/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.440693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] RBAC: Authorizing `identity:get_project(project_id=04a62e1ae96e4c8e9b9228e06dc65dee)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:37.443839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:37.447799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:37 2022] GET /identity/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee => generated 344 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:37.454642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:37.478974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:37.695974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82912a-7b84-4dc5-a2df-2980aeedcb9a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:37.736803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:37.741128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:37.768776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:37.770108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.770604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.771085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] PATH_INFO: `/v3/groups/8d7bd24949644f04a5f89e56b8448ec4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.784379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7bd24949644f04a5f89e56b8448ec4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:37.787717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:37.791960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 194/381] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:37 2022] GET /identity/v3/groups/8d7bd24949644f04a5f89e56b8448ec4 => generated 229 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:37.798806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:37.953753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:37.984769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9efe6-9191-4c07-9ee9-a421fc964039 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.010410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e218-ab38-497d-a336-2c1868228627 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.049503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.050195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.050546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.050817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.051625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] RBAC: Adding query filter params (group.id=8d7bd24949644f04a5f89e56b8448ec4, role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=04a62e1ae96e4c8e9b9228e06dc65dee) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:38.051935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.053503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.061349 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 195/382] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:37 2022] GET /identity/v3/role_assignments?group.id=8d7bd24949644f04a5f89e56b8448ec4&scope.project.id=04a62e1ae96e4c8e9b9228e06dc65dee&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:38.108476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.109562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.110001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.110428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.134190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:38.140731 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:38.141749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:38.143135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 188/383] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:38.150569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.322378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30aa31-295b-432c-96b2-e302783b9bfb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.362084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.363082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.363628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.364102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.365081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] RBAC: Adding query filter params (name=member) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:38.365614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.367242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.374127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:38.379584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 196/384] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:38.385669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.471728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:38.527467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d65e-a7a8-4f35-9f3b-e948cdf0979e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.577291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.577882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.578160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.578437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.579628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.583302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.583302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 189/385] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:38.590307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.750893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dffd9c-f737-478c-8c25-eafdd2ff7e79 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.799347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.800193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.800436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.800678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.802151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.803793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46855af-6d05-49d4-b2d9-e33c2bb7dc20 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.806184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 197/386] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:38.812177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.983686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c420c-c913-440a-9b01-25c7c771d1bf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.031630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:39.040331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.041057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.041339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.041614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/groups/10535dc83a4941e780dc49680e15ba1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.043659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, group_id=10535dc83a4941e780dc49680e15ba1b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.045239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b483f3-cada-4622-8da1-8b145492da1b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:39.056499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551613-4c08-4e79-88e3-91459bc78f3a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.056830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551613-4c08-4e79-88e3-91459bc78f3a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.057054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551613-4c08-4e79-88e3-91459bc78f3a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.058954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 198/387] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:39.065578 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 190/388] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Oct 28 09:34:38 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/groups/10535dc83a4941e780dc49680e15ba1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:39.073038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b428-1cf1-4140-b552-b401fa7bc0d1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.073572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b428-1cf1-4140-b552-b401fa7bc0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.074027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b428-1cf1-4140-b552-b401fa7bc0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.138389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d8f1b428-1cf1-4140-b552-b401fa7bc0d1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:39.140550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8f1b428-1cf1-4140-b552-b401fa7bc0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:39.288695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:39.298046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 199/389] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:39.442196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed9bd-b027-4496-8350-9a9604d1640a None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.442873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed9bd-b027-4496-8350-9a9604d1640a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.443379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ed9bd-b027-4496-8350-9a9604d1640a None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.445385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 191/390] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:39.451556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.451895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.452152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.490449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:39.492569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:39.617822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed9bd-b027-4496-8350-9a9604d1640a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.637783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 200/391] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:39.826443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ed9bd-b027-4496-8350-9a9604d1640a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.885238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.886208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.886769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.887244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.910357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:39.920194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:39.921275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:39.922218 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 192/392] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:39.930021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.066356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.138237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d1a6-3e17-49fa-9eb5-1e278f2ade7c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.210335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.215991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.234473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.237857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.238904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.240413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.243047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:40.243920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.248187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.275373 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 201/393] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:40.281131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.378489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631b66-368d-4bdf-8996-5015f392dd59 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.456326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.457340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.458472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.458932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.485069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:40.491749 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:40.492788 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:40.493633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:40.497508 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 193/394] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:40.506596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.534854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8661b-5ad7-41f7-a790-8380440843b9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.616319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.619130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.620283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.620944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.625942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.628258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.631047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 202/395] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:40.636955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.749268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75b6e-bef3-493d-8e74-ed571f88a9e8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.756862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.777244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.832429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.833089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.833371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.833641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.834333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:40.834635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.836045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.847766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea453-1ae4-49ac-9df7-88ff82c7f3ff None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.853733 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 194/396] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:40.862449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.905252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.906589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.906870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.907145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.908398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.910218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1b1c6-ea34-424e-9c85-355fdedb9580 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.913096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 203/397] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:40.914389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728877f0-b9bf-4c90-8e9a-920eae056bc2 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.914731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728877f0-b9bf-4c90-8e9a-920eae056bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.915012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728877f0-b9bf-4c90-8e9a-920eae056bc2 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.916573 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 204/398] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:40.922418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728877f0-b9bf-4c90-8e9a-920eae056bc2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.047794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16e95-cc04-4cb7-a08e-7d483aca69df None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.112282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.113168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.113334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.113603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.114990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.117339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440914d-36f1-467c-bd07-3488d505fa6d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.120336 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 195/399] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:41.121754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587158ad-9997-4610-9eb9-41222d23ce31 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.122032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587158ad-9997-4610-9eb9-41222d23ce31 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.122301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587158ad-9997-4610-9eb9-41222d23ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.147247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-587158ad-9997-4610-9eb9-41222d23ce31 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:41.149607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-587158ad-9997-4610-9eb9-41222d23ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:41.161055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728877f0-b9bf-4c90-8e9a-920eae056bc2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.200140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.205989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.211275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.211949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.212223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.212503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/groups/10535dc83a4941e780dc49680e15ba1b/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.214889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49, group_id=10535dc83a4941e780dc49680e15ba1b, role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.216354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.232337 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 205/400] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Oct 28 09:34:40 2022] PUT /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49/groups/10535dc83a4941e780dc49680e15ba1b/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:41.233154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.257182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 196/401] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:41.259300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa94c-001e-4f2c-b249-d75b8e886914 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.260118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa94c-001e-4f2c-b249-d75b8e886914 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.260718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa94c-001e-4f2c-b249-d75b8e886914 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.262549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 197/402] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:41.271683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.272306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.273005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.315657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:41.318753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:41.429816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:41.473922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8843d4-e319-4da9-a596-b0087342fa75 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.512928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.514477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.514957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.515423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.516773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.518487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.520835 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 206/404] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:41.527070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.644599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.689387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.700659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04766-d818-40bf-8e20-3a367ec6251a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.722439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.756784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.757638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.757943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.758324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/groups/10535dc83a4941e780dc49680e15ba1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.760670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, group_id=10535dc83a4941e780dc49680e15ba1b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.762196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.782398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Oct 28 09:34:41 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/groups/10535dc83a4941e780dc49680e15ba1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:34:41.783874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.828175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054766b9-6fe3-4fe8-b287-a2a4073fffe1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.874947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.876108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.876606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.877171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.890461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:41.897014 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:41.897999 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:41.898915 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:41.901897 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 207/406] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:41.910965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.946595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d9988-8464-445f-b2ff-4f5b067af165 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.015054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.015930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.016233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.016519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.048680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-06bab9a1-e1f2-4324-afa1-327b391a6994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:42.054340 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:42.055312 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:42.056107 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 200/407] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:42.057975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbc8f-2c45-4b9a-83f0-084a89d31857 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.058700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbc8f-2c45-4b9a-83f0-084a89d31857 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.061185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbc8f-2c45-4b9a-83f0-084a89d31857 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.063583 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 201/408] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:42.069209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdbc8f-2c45-4b9a-83f0-084a89d31857 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.105372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.128640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc55be-84bc-4b1c-9b44-58e00706bda8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.154711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.192193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.192819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.193150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.193421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.194093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.194393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.195824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428bc0-4484-412a-b440-d8e86a6f5b56 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.206237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 208/409] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.212423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.212756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.213062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.236276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:42.237645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:42.247589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdbc8f-2c45-4b9a-83f0-084a89d31857 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.313699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.314894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.315431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.315914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.317859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.318374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.320554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.322591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 209/410] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:42.323486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.339922 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 202/411] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.350160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.448955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ffa22-0236-408c-bc38-6a5837921c3e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.457870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.491344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.492232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.492655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.493101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.494513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.496251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.498154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 210/412] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.509623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.550650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.601022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1057e00-40e8-4fcd-b2c3-694fe9860237 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.650241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.651413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.651842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.652972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] PATH_INFO: `/v3/groups/8d7bd24949644f04a5f89e56b8448ec4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.655474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7bd24949644f04a5f89e56b8448ec4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.657498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.660521 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 203/413] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/groups/8d7bd24949644f04a5f89e56b8448ec4 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.666789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.755430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c42-8310-4b63-b6dd-e993e6714271 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.800708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495fb-16af-4237-974c-d80915f38cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.802001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495fb-16af-4237-974c-d80915f38cef None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.802001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495fb-16af-4237-974c-d80915f38cef None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.802307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495fb-16af-4237-974c-d80915f38cef None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.803476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831495fb-16af-4237-974c-d80915f38cef None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.805290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831495fb-16af-4237-974c-d80915f38cef None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.807470 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 211/414] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.814542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495fb-16af-4237-974c-d80915f38cef None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.852193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adcc45-c3e4-41fc-96fb-7824b4ddbdc1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.887249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.905763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.907330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.908641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.909446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] PATH_INFO: `/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.911003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=04a62e1ae96e4c8e9b9228e06dc65dee)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.913603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.917644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 204/415] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:42.919278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.954912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.967694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495fb-16af-4237-974c-d80915f38cef None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.011006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.011794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.012619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.012619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.027154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:43.033600 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:43.034932 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 212/416] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:43.036146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:43.114185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c2e9f-f9f0-46bf-bc98-48451ce2e3a8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.179577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.181403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.182341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.183158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/groups/10535dc83a4941e780dc49680e15ba1b/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.184763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c3a9-c353-4090-86b4-0ffc0b391cb9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.186769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.189171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac, group_id=10535dc83a4941e780dc49680e15ba1b, role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.190703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.212958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 205/417] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Oct 28 09:34:42 2022] PUT /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac/groups/10535dc83a4941e780dc49680e15ba1b/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:43.212958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:43.293678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.294460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.294790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.295004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] PATH_INFO: `/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee/groups/8d7bd24949644f04a5f89e56b8448ec4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.298359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] RBAC: Authorizing `identity:create_grant(project_id=04a62e1ae96e4c8e9b9228e06dc65dee, group_id=8d7bd24949644f04a5f89e56b8448ec4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.299849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.323889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 213/418] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Oct 28 09:34:43 2022] PUT /identity/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee/groups/8d7bd24949644f04a5f89e56b8448ec4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:43.381752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.411345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1280-b3a3-44d3-b5d3-7034eed5eee6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.457121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.457842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.458253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.458523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.459837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:43.460193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.461960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.473702 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 206/419] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:43.480999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:43.635336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e6ff-defd-4ba4-889b-fa11a848dd73 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.681748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.682372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.682644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.682910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.723844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.778465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.780713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.922313 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 214/420] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:43.928703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:44.082335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d197da-2964-4f83-9357-d92c08c59df5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:44.134007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:44.134650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.134923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.135191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.140827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:44.142316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49743d-f7dd-4267-9c29-777c8254c1e7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:44.144419 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 207/421] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:43 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:44.151679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:44.280252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:44.350188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68f98-d5e0-4b13-8c6b-393b0568d8e8 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.350875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68f98-d5e0-4b13-8c6b-393b0568d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.351423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68f98-d5e0-4b13-8c6b-393b0568d8e8 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.353004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 208/422] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:44.362396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f0f9-9a86-4a1a-82c4-a90894b49f7b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.363020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f0f9-9a86-4a1a-82c4-a90894b49f7b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.363487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f0f9-9a86-4a1a-82c4-a90894b49f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.372954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc299c-a366-48f8-95af-a8478d8426b9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:44.411157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d776f0f9-9a86-4a1a-82c4-a90894b49f7b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:44.412477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d776f0f9-9a86-4a1a-82c4-a90894b49f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:44.415409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:44.416387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:44.417131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.417408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.417706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.418897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:44.421022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:44.425504 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 215/423] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:44.434169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:44.587604 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 209/424] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:44.613984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea43-c173-4281-b9e1-e95358caf9ec None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.614305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea43-c173-4281-b9e1-e95358caf9ec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.614520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea43-c173-4281-b9e1-e95358caf9ec None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.616248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 210/425] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:44.635766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.636218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.636681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.675184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205e06-ba93-4d2c-b73d-40f32cc25eb2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:44.699154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:44.701152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:44.778256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:44.779307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.780270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.780704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.782044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:44.782537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:44.785186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:44.793364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:44.798480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 216/426] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 611 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:44.923082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 211/427] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:44.969830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.174663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfe1f-fcba-42f7-b72f-e98c19313330 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.239566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.240613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.241126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.241586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.260368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:45.273028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:45.274020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:45.274888 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:45.276542 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 217/428] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:45.283369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.364493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.399751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.411513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3400e5-dbe9-4351-bdc7-84e66599f6ef None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.494733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.495705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.496180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.496508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.498555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] RBAC: Adding query filter params (name=member) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:45.498994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.501488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.517084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 212/429] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:45.522428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.535995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.611617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7f55-e5e0-4b5b-bf44-13423ff2483b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.653743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.655028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.655375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.655708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.669774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:45.675829 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:45.676801 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:45.678078 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 218/430] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:45.683544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.738171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbde5-c9e3-4296-ae9c-efb7602cfeaf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.800164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.811836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.812982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.813439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.813884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.890396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63c51-f3e9-4572-8a03-370c0e7ed484 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.921022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.954282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.955111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.955458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.955791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.956561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:45.957161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.958700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.972940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 219/431] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:45.977890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.998595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.003607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.142764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf522-d8e2-4d17-950a-8391fa5ecf21 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.204394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.205068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.205347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.205723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.208364 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 213/432] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:46.215672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.269058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.275213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.301580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.303607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650bd00-077d-4466-8086-1f9b33db6f40 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.379654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee029a7-4f01-4576-858e-6c9b8fef25c3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.435118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.436308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 220/433] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:46.437325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14ce2-1d2d-4167-af8d-b92f95b0693f None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.437700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14ce2-1d2d-4167-af8d-b92f95b0693f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.437974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14ce2-1d2d-4167-af8d-b92f95b0693f None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.438634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.439318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.439877 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 221/434] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:46.440096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.441439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb14ce2-1d2d-4167-af8d-b92f95b0693f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.446280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.449272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3a754-aec5-4ea9-b96f-38fd979a2ee9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.456001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 214/435] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:46.457555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.458006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.458465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.480449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:46.481760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:46.565952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.580940 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 215/436] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:46.580940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.622682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb14ce2-1d2d-4167-af8d-b92f95b0693f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.624750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.687575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.688134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.688407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.688673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] PATH_INFO: `/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.689917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=8c703858f5ed4f6ba8e6a1d22e0faa49)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.691387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.694229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 222/437] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/projects/8c703858f5ed4f6ba8e6a1d22e0faa49 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:46.699256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.736235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f85c2d-c208-4955-ad70-18e18108db13 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.783402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.784031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.784303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.784643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.785845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.787271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ad31-1c1f-4ec3-8300-1a4fc439d5b2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.789053 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 216/438] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:46.790084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923a55-68d7-4e91-abb1-977668129630 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.790358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923a55-68d7-4e91-abb1-977668129630 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.790657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923a55-68d7-4e91-abb1-977668129630 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.791963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 217/439] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:46.797287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923a55-68d7-4e91-abb1-977668129630 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.837613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437dd-888b-46aa-8497-190ffb769fb0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.880135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.880775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.881081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.881471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.882746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.884432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceab68-2780-4cfa-9202-5e197e43b866 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.886311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 223/440] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:46.887669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.887986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.888299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.909023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:46.910237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:46.913481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.921879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923a55-68d7-4e91-abb1-977668129630 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.922630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.961431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.961939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.962217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.962496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.963194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=5c0f3bf97ca0422cb9f85126cf037e6a, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:46.963559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.964946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.971390 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 218/441] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=5c0f3bf97ca0422cb9f85126cf037e6a => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:46.971983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.003881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 224/442] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:47.005468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.121855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037491-79d1-43a4-887b-dfbcc406b841 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.169972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.170981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.171385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.171776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.174094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ccdc-70d8-49b4-a160-e436182236b2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.191824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:47.204770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:47.205770 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:47.206605 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:47.207299 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 219/443] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:47.216203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.226806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.227141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.227350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.227624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.228395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:47.228706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.230304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.240853 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 225/444] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=8c703858f5ed4f6ba8e6a1d22e0faa49&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:47.257226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.353358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.363342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.368024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bba2-1797-4deb-9123-f5dfd6a4e3bd None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.413381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.414519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.414996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.415448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.416317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:47.416653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.418573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.440954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 220/445] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:47.443815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.477943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640065bd-c910-44bf-927b-98e965b1350b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.524133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.524815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.525177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.525451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.543995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:47.551380 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:47.552558 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:47.553595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:47.557268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.560862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.580801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7be84-6d2e-435c-9586-7a30ebed6ee3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.638220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.638930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.639714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.640005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.680562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.739972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a55dc9-4831-4b3a-b02d-038487f6395f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.742421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.744096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.788877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.789825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.790282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.790640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.791318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:47.791672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.793493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.803072 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 227/447] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:47.811669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.858695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.895243 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 221/448] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:34:47.901731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.951552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fb85a-9d62-49f3-b8a3-538923497edd None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.987263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.999931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.000691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.001152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.001501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.018487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3b7b-16ec-4bf1-9c09-e8944d0fc025 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.054962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.055593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.055868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.056137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] PATH_INFO: `/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.057305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] RBAC: Authorizing `identity:get_project(project_id=04a62e1ae96e4c8e9b9228e06dc65dee)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.058733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.060742 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 222/449] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/projects/04a62e1ae96e4c8e9b9228e06dc65dee => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:48.069260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.080367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.082112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.131439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:48.191048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931e54-7d6a-4663-bf88-fd75e5a38a35 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.192561 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 228/450] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:48.199497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.228547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.229213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.229490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.230190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] PATH_INFO: `/v3/groups/8d7bd24949644f04a5f89e56b8448ec4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.230907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7bd24949644f04a5f89e56b8448ec4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.232344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.233998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 223/451] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:48 2022] GET /identity/v3/groups/8d7bd24949644f04a5f89e56b8448ec4 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:48.238160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:48.239824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.313861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce915-2eda-4393-8a57-42a5c5301dbe None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.349339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.349972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.350245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.350520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] PATH_INFO: `/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.351640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5bf2e8919b48a4936b4a7ce9c7e6ac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.353133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.354860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:48 2022] GET /identity/v3/projects/ac5bf2e8919b48a4936b4a7ce9c7e6ac => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:48.355393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ecf8e-b18d-481a-9ee9-334c0967db33 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.360766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.377346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:48.396819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.397462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.397731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.398000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.398727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] RBAC: Adding query filter params (group.id=8d7bd24949644f04a5f89e56b8448ec4, role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=04a62e1ae96e4c8e9b9228e06dc65dee) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:48.399029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.400473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.407215 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:48 2022] GET /identity/v3/role_assignments?group.id=8d7bd24949644f04a5f89e56b8448ec4&scope.project.id=04a62e1ae96e4c8e9b9228e06dc65dee&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:48.466706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:48.473852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84dc3-b2f0-4175-acba-bf232719fa66 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.513175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.514088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.514210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.514525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] PATH_INFO: `/v3/groups/10535dc83a4941e780dc49680e15ba1b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.515859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] RBAC: Authorizing `identity:get_group(group_id=10535dc83a4941e780dc49680e15ba1b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.517368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c4a9-d85e-484b-ac9d-4d936751c143 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.519145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Oct 28 09:34:48 2022] GET /identity/v3/groups/10535dc83a4941e780dc49680e15ba1b => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:48.525450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.649515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53dc8-acce-4b55-9388-c60fd77d6da9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.704339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.705334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.705807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.706269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.707530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] RBAC: Adding query filter params (group.id=10535dc83a4941e780dc49680e15ba1b, role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:48.708065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.710700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b25ef9-491a-4655-8ebb-9ee2e3d44057 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.721228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 225/455] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Oct 28 09:34:48 2022] GET /identity/v3/role_assignments?group.id=10535dc83a4941e780dc49680e15ba1b&scope.project.id=ac5bf2e8919b48a4936b4a7ce9c7e6ac&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:52.010229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b238-5c77-4818-9bc6-a5181188ac6e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.011143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b238-5c77-4818-9bc6-a5181188ac6e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.011621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b238-5c77-4818-9bc6-a5181188ac6e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.013535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 231/456] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:52.020121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cadb-02c3-4af0-969e-95a977c31135 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.021001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cadb-02c3-4af0-969e-95a977c31135 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.021455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cadb-02c3-4af0-969e-95a977c31135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.032390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266dcf5-441a-42b4-bbae-236933ae3941 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.032844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266dcf5-441a-42b4-bbae-236933ae3941 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.033328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266dcf5-441a-42b4-bbae-236933ae3941 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.036263 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 232/457] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:52.045184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18b3-f614-4042-8521-238db4864ca5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.046672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18b3-f614-4042-8521-238db4864ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.047410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18b3-f614-4042-8521-238db4864ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.048676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d686cadb-02c3-4af0-969e-95a977c31135 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:52.049933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d686cadb-02c3-4af0-969e-95a977c31135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:52.094009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-606d18b3-f614-4042-8521-238db4864ca5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:52.096405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-606d18b3-f614-4042-8521-238db4864ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:52.205367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.276545 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 226/458] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:52.334076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 233/459] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:52.452942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80bbc-0352-4abd-80fb-702ab5b40ad5 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.453883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80bbc-0352-4abd-80fb-702ab5b40ad5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.454616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80bbc-0352-4abd-80fb-702ab5b40ad5 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.457486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 227/460] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:52.464702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.465589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.466322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.506540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:52.509033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:52.577985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80bbc-0352-4abd-80fb-702ab5b40ad5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.710257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 234/461] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:52.711970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.759305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.763619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80bbc-0352-4abd-80fb-702ab5b40ad5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.825411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.826051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.826318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.826583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.848122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.849545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:52.886444 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:52.887441 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:52.888293 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:52.888293 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:52.888293 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:52.888799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 228/462] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:52.895660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.913387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858a6f9-6367-4c0d-922e-69195b875c77 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.974240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.984553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.985583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.986047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.986506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.017958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.020865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:53.049776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:53.051560 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:53.053302 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:53.053302 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:53.053302 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:53.058618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 235/463] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:53.059203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.084287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb195-28de-4e33-927a-a5b6a05e41d9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.131197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.131816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.132102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.132371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.133276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:53.133697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.135342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.156127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 229/464] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:53.157445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.214321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.248133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce5199-049a-4299-a7be-ffbe75439e9e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.283067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.290797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.291433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.291711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.291989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.298583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a260-4f4c-455b-b429-284f8cb18096 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.303427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.304954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:53.320935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:53.321938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:53.322849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:53.322849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:53.322849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:53.327154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 236/465] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:53.328076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.345407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.346275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.347189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.347516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.348635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:53.349102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.350878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d1587-b367-41c2-a0c9-4d521c3db234 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.372961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 230/466] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:53.372961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad236f6-dc59-4a86-910d-a2ce589470e4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.372961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad236f6-dc59-4a86-910d-a2ce589470e4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.372961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad236f6-dc59-4a86-910d-a2ce589470e4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.372961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 231/467] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:53.373416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad236f6-dc59-4a86-910d-a2ce589470e4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.465366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8522-57dc-4a3c-80f1-5c4e042bce50 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.498365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.501538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad236f6-dc59-4a86-910d-a2ce589470e4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.515354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.515981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.516257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.516603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.517210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.518786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.545658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 237/468] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:53.547122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.560303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.561697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.562298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.562905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.563884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:53.564443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.567036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52bf58-dbef-49fd-b0bd-189ebfe533ba None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.590728 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 232/469] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:53.592738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.593192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.593623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.619889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:53.621923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:53.625354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.737362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 233/470] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:53.738085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.790752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ce72-c63e-407e-b3e9-bd95bc9ee4e9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.827413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.828283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.828560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.828831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.829549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.831006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b3a68-d57f-4d2c-bcab-07a93ce427ca None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.856487 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 238/471] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/users => generated 246 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:53.889361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee790a3-22e5-493a-b9f3-50787410df35 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.889791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee790a3-22e5-493a-b9f3-50787410df35 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.890519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee790a3-22e5-493a-b9f3-50787410df35 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.892551 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 239/472] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:53.898216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.898593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.898759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.921335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:53.922391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec699c-85a1-49a2-8e7d-35bfe1eae978 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.922568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:53.982052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.983529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.984236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.984947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.986284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.989446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.993856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:54.012725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:54.017621 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 240/473] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:54.041473 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 234/474] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:54.148144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:54.275642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d82f1-dd7f-4e85-aff0-52c50b2b6900 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:54.317147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:54.317796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.318075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.318350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.331273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:54.332784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:54.349550 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:54.350812 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:54.352469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:54.352469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:54.352469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.352469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 241/475] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:54.357848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:54.427582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:54.465516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:54.525566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585bc1-d02c-4188-8e8d-d87bac3d4484 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:54.585042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:54.586320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.586320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.586579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.592032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:54.592032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:54.592032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:54.618608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 235/476] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:54.621444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a16f1-e51b-49c2-9250-31ab9a73f291 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:54.630862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:54.714131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:54.739936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:54.741285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.744401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.744718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.745448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:54.746847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:54.767174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.sql.core [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:34:54.767174 n-d-zed-1 devstack@keystone.service[88452]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:34:54.767174 n-d-zed-1 devstack@keystone.service[88452]: [parameters: {'id': '7d6b153a968546dd82bad7fee3bd0d2d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:34:54.767174 n-d-zed-1 devstack@keystone.service[88452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:54.797733 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return ref.to_dict() Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:54.798838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application yield resource Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise self.value Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application session.commit() Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:34:54.800079 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:34:54.801070 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:54.802242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:54.803193 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [parameters: {'id': '7d6b153a968546dd82bad7fee3bd0d2d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:54.804285 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:34:54.812618 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:54.816466 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 242/477] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Oct 28 09:34:54 2022] POST /identity/v3/roles => generated 144 bytes in 373 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:54.826009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:54.833444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb6ad-a163-4ac8-aea2-1d1e0539e5e6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:54.888386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:54.889587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.891511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.892195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.893459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:54.899705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:54.951636 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 236/478] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:54 2022] POST /identity/v3/users => generated 249 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:55.024371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:55.050349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c745ab-a322-4bc5-94e0-b1d9832c50d9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:55.119472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:55.120152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:55.120432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:55.120702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:55.146524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-bea24b97-21c9-4a38-b226-708399e88139 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:55.153665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:55.155115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:55.155991 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:55.158251 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 243/479] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:55.164153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:55.341503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17405-7182-4922-ba47-5dac3d6a4a1b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:55.365582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:55.417222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:55.418186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:55.418557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:55.419043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:55.420331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:55.420872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:55.423741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1dd8-767a-407c-9b24-363754668a8b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:55.437316 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 237/480] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:56.653495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b365-2475-47d6-9e79-05a6156d7fd6 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:56.654014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b365-2475-47d6-9e79-05a6156d7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:56.654240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b365-2475-47d6-9e79-05a6156d7fd6 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:56.655936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 244/481] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:56.662149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104805-0dd9-47dd-bfed-b1ba475ccda7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:56.662619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104805-0dd9-47dd-bfed-b1ba475ccda7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:56.662694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104805-0dd9-47dd-bfed-b1ba475ccda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:56.690630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d2104805-0dd9-47dd-bfed-b1ba475ccda7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:56.691904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2104805-0dd9-47dd-bfed-b1ba475ccda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:56.795998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 238/482] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:56.948622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea46c-3896-458a-b888-57929eff0c1d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:56.948991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea46c-3896-458a-b888-57929eff0c1d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:56.949262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea46c-3896-458a-b888-57929eff0c1d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:56.950873 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 245/483] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:56.957160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:56.957490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:56.957732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:56.982646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:56.983920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.012572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c663-1c66-44be-8286-b0cb7d7fe57e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.012894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c663-1c66-44be-8286-b0cb7d7fe57e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.013149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c663-1c66-44be-8286-b0cb7d7fe57e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.014940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 246/484] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:57.020530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.020862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.021108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.056697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:57.057955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.127496 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 239/485] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:57.138851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.197851 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 247/486] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:57.205488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.316885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668bc5f-015a-4b4c-8e54-8caa2e5c1c31 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.366941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.367601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.367882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.368149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.380581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:57.385852 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:57.386858 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:57.387817 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 240/487] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:57.395887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.522514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.533537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.551325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b8c6c-7532-44ab-87cf-9c6d19e53bc9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.611218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.611847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.612124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.612396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.613223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:57.613530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:57.615012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:57.628124 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 248/488] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:57.629215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.713298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872e773-f423-4af4-aea5-4641cd77556b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.717326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.775700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd5f52-d1dc-40a3-8b52-d5e4d0543572 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.782273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.783305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.783739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.784233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.806667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:57.813062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:57.814062 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.814950 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:57.820102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:57.821175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.844316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.845622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.846052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.846325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.859463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.866543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:57.875018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:57.877419 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:57.879498 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 249/490] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:57.883028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.999556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63781-0397-479e-aff6-b8a8aeaad3f5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.035255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c9ce-71b4-4d4c-adba-bead5148518e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.045037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.045674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.045951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.047052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.060164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.063064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.082095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.082710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.082987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.083260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.083932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.084260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.085644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126a6b7-4239-4c24-9596-3a1d1a26db0f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:58.086003 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.086857 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:58.087718 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:58.087718 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.087718 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:58.088481 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 242/491] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.089424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.094710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.106534 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 250/492] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.106534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07153a-5384-4aa4-b4e6-e9bda2963aa1 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.106534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07153a-5384-4aa4-b4e6-e9bda2963aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.106534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07153a-5384-4aa4-b4e6-e9bda2963aa1 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.107796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 251/493] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:58.109279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07153a-5384-4aa4-b4e6-e9bda2963aa1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.187346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.245784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3c11-3c00-4568-b35b-290c477b9670 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.250609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07153a-5384-4aa4-b4e6-e9bda2963aa1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.292196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.292718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.293098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.293294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.294154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.294309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.295651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.310125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.310388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 243/494] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.310388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.310610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.310610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.310610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.310610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.310610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.310922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810c6cc-baaa-4504-b68b-8678e1f37db1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.331156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 252/495] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.339071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.339371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.339675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.361339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:58.362593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:58.390354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.440651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543330-6c32-42b0-9556-47671c62c5e1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.469858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 253/496] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:58.470732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.506265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.507078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.507352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.507619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.524351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.527073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:58.551740 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.552843 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:58.554267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:58.554267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.554267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:58.557102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 244/497] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.558719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.569225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.660928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19440f-5fc4-4b8e-8044-87be44337698 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.706322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.707136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.707512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.707810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.723863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.725835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.730879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab30c9-b457-42d2-9615-b89e47577a48 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:58.749712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.750767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:58.751866 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:58.751866 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:58.751866 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:58.751866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 254/498] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.752986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.761317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.782312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.783041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.783317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.783621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.791980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.793539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-43628fc2-2c21-47c6-a679-8c16c015a842 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:58.818864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.820768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:58.822564 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 245/499] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.823745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b481d-1660-4198-ac4d-26c95ba328d5 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.823745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b481d-1660-4198-ac4d-26c95ba328d5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.823745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b481d-1660-4198-ac4d-26c95ba328d5 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.825008 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 246/500] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:58.825703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b481d-1660-4198-ac4d-26c95ba328d5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.885248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816363-5036-4ef2-a8b0-5c4f950f1e1d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.886830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.920930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.922033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.922310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.922585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.923235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.923529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.924926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.938217 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 255/501] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.938789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.958857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b481d-1660-4198-ac4d-26c95ba328d5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.000805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.001573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.001847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.002141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.002923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.003228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.004788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.018427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 247/502] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.019313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.060753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439770a4-59c4-4273-9851-7873979f5e9a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.068025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.110679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.111277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.111671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.111946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.124044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-11c25e52-3692-43f2-9c58-a9534ac8f24a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:59.129703 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:59.130929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:59.132054 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 256/503] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:59.132973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.132973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.132973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.137477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d40-cd92-4d58-bb8b-2447b9a879a3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.154303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:59.156642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:59.180709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.181454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.181743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.182009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.182898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.183318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.185169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.192272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.231194 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 248/504] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.232308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.259314 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 257/505] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:59.260176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.404685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92566d-2b18-4d78-9c76-2c28e7b1f71c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.430142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.443010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f726130-d7b2-43d2-a1e8-016f2d66655a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.458735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.459468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.459730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.460000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.468529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.470074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:59.492347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:59.493473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:34:59.494431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:34:59.500550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 258/506] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:59.501731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.507117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.509360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.509877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.510456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.523464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.524687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.526010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:59.545193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:59.546244 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:34:59.547836 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 249/507] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:59.549299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.652331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991c36-fe5b-4318-bb26-529fc865a9c7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.685226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5daf-49c9-42f9-bac5-444b7656cc9a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.696925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.697558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.697835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.698108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.698774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.699075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.700493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.710501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 259/508] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.711488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.727935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.728544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.728822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.729116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.761670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.797630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.811330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.813334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.830313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059f03-f9c0-4c1d-b620-be5eb1cb22eb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.871098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.872041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.872408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.872678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.873465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.873794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.875821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.919792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 260/509] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.920689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.939653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 250/510] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:59.940454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.006474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.038566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f97d9-481a-41bd-b5e0-91770fdaedf1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.058660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038d951-85dc-4fad-a518-79acdade7982 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.069781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.075453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.076086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.076364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.076630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.087917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.089445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.103674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.104282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.104564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.104837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:00.105460 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:00.106362 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:00.107237 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:00.107237 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.107237 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:00.107446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.107446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.107569 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 261/511] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:00.107635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.107699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.130713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 251/512] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.131579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.234668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a643-0777-435e-bd6c-6bc73101a3de None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.263018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392ee7-db81-4923-8fd7-071959b19010 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.270892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.271513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.271788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.272065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.278514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.286200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.288323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.307930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:00.308147 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:00.309247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:00.310280 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:00.310280 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.310280 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:00.310280 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 262/513] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:00.310548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.310548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.310548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.310736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.353008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.397508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.398976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.444791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadb07a-f194-44e6-b31b-e8fc36220a52 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.482294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.483240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.483583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.483860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.495835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.497259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.513784 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 252/514] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:00.513784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:00.514068 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:00.514973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:00.516452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:00.516452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:00.516452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:00.516452 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 263/515] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:00.516452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.539728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.626664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.641420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a5b4-51c8-4eaf-b178-13593f22c48d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.653332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30174a-c051-4a0a-9492-026b52f80e82 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.684649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.685303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.685580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.685846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.693190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.693896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.694238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.694711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.695672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.695983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.697585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.713517 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 253/516] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.718550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.774383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.775803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.802057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.830215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf447cc-cb09-4a17-8d8c-1c79a25aea9b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.865587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.866199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.866476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.866745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.867388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.867634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.867798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.869110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.888271 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 254/517] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.888470 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 264/518] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:00.888568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.888672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.996745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd71ff-6315-4e88-8b49-12c3ac6ae980 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.005298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc7f21-a6d5-4c27-b3d8-42e362c829c2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.042079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.042680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.042907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.043177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.043811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.044435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.044687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.045016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.045917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:01.046349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.048751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.051217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.055641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.057159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.070461 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 255/519] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:01.071687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:01.073313 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:01.074214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:01.075217 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:01.075217 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:01.075217 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:01.075217 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 265/520] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:01.075913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.120765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.184615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3549-127a-424a-a222-bd6246298bc9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.187127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233775f8-9835-4e19-aac4-8fbe048fd26c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.230694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.231300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.231585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.231848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.232499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.234516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.237009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.237661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.237942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.238246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.251313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.252881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.256350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 256/521] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:01 2022] POST /identity/v3/users => generated 247 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:01.257232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:01.274658 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:01.275749 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:01.276657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:01.276657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:01.276657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:01.276657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 266/522] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:01.278127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.333836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.410277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.414533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdb921-7583-4633-b35e-a79ac6d5d886 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.422632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0edf9-d60d-44fc-a681-2b4ea26587b4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.465207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.466153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.466663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.466941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.475972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.477505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.477722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.478865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.479745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.479745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.492786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.494285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:01.495234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:01.496283 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:01.497281 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:01.502657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 267/523] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:01.502657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:01.510106 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:01.513267 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 257/524] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:01.517338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.649148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4695f-a1b6-4b6e-a83c-9623df049ed3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.664112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a529-41ca-4da9-86ff-8c7c3fe89b6d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.680203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.696879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.697534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.697811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.698164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.698884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:01.699219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.700684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.715901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.720976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.729372 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 268/525] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:01.731010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.736695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 258/526] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:01.738637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.748068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:01.856997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdec99-368f-4d96-b6e4-e54774d12741 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.885875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca12ec-e8ea-4983-8590-a0354838eb80 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:01.905365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.906461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.906956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.907446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.908669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:01.909246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.911883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.933268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:01.933925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:01.934201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:01.934466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:01.935319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:01.935650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:01.937131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:01.951781 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 269/527] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:01.951781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:01.972450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 259/528] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:01.973436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.005127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.047890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.096758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296ca2-3ae5-42a3-998d-c2c9682628ad None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.114405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ab05-d0ba-4350-bb8b-0a1bb6fc7917 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.158649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.159957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.160473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.161019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.170092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.170908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.171188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.171444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.172130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.174326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.179850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.181470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:02.191164 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:02.194903 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 270/529] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:02.197763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:02.200893 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:02.204574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:02.206947 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:02.208077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 260/530] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:02.208258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.321630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.331508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb2776-23dd-4ab1-a285-ec6a951689f7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.344819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03472f8b-e982-4cc9-9256-a2724f6bade6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.368782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.374380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.375815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.376311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.376575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.377424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=b6f23fb45ed14020a6d15f834881d50b) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:02.377737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.379235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.385412 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 271/531] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/role_assignments?user.id=b6f23fb45ed14020a6d15f834881d50b&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.386076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.401489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.402341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.402626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.402943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.488533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.490262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.528765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d15ae-ed29-4ca3-aa1a-8524d14b1fce None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.570130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.571201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.571723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.572222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.573245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:02.573818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.575667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.593843 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 272/532] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.595227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.606280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.629034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 261/533] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:02.630044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.670410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.746389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b5b86-4bb2-455d-9ac5-31412c033191 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.756681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efcb63-44a4-49da-a98b-e309607482fe None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.789599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.790268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.790580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.790850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.791734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:02.792041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.793783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.807868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.808958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.809112 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 273/534] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.810132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.814093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.815374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.816355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=95ff200fd16445debdaa322bf2123ab5) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:02.816665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.818179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.831511 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 262/535] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/role_assignments?user.id=95ff200fd16445debdaa322bf2123ab5&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.833556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.987134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.060318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9150b9-0af1-4b71-9bba-0da135cf386d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.084540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59099c4-ae59-4801-ba36-bcfad96343f3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.091280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.129733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.130368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.130653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.130925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.146772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.147756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.148260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.148732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.149745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:03.150268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.152765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.160048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.163825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.167681 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 263/536] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:03.186413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:03.187570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:03.188431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:03.188431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:03.188431 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:03.190895 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 274/537] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:03.202143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.332644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716b80-5bee-4c22-a458-41ca64fe8b64 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.352169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.373450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.374131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.374417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.374687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.375456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:03.375765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.377280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd8eb-66fc-4645-9ce2-3433478ce265 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.391835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 264/538] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.402471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.563771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b566d9-25f8-449c-a584-ed02a389d894 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.623484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.624539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.625565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.626043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.639500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.641431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.650516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f1be5-3fd7-41e4-ab1a-a67fa0a85f41 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.650831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f1be5-3fd7-41e4-ab1a-a67fa0a85f41 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.651062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f1be5-3fd7-41e4-ab1a-a67fa0a85f41 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.652764 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 265/539] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:03.659175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.659478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.659722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:03.660056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:03.660855 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:03.661763 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:03.664295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:03.670400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.684499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:03.686308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:03.708490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.809059 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 266/541] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:03.856027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a0add-4077-48af-add9-a08e7c606fcc None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.911573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.912188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.912466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.912737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.913460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:03.913765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.915212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.935070 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 276/542] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.941236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.045760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d96d6-589e-4bec-8014-e772098a6a9c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.061389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.082622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.083226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.083502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.083768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.084486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=051db56282044b44934f4db7ce8cd08c) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:04.084789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.086236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.092252 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 267/543] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/role_assignments?user.id=051db56282044b44934f4db7ce8cd08c&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:04.178223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.294014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.308960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9139-7f0b-46c0-a46f-26bd3acee722 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.348863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.349579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.349862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.350130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.371889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:04.377301 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:04.378213 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:04.379039 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:04.383458 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 277/544] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:04.384818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.496308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7a5-dd5a-4bd8-8e32-badc371b9894 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.532189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.532803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.533108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.533374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.534106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:04.534405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.535834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.549019 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 268/545] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:04.550704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.685421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb8cb-9c8f-410d-9582-632363cdfcba None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.742090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.743078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.743573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.744077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.758174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.759942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.769947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:04.784676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:04.785655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:04.786503 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:04.786503 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:04.786503 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:04.788669 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:04.794142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.849962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.927754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40b89f-75fd-4009-bc86-539e3fa78803 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.978294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.978910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.979190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.979460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.980106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:04.980407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.981802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1bd2e-f2cc-4f7a-913a-e4d064468553 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.995745 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 269/547] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.001100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.104233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef5f4-a16c-403a-9ff7-37f8f554bc74 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.104728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef5f4-a16c-403a-9ff7-37f8f554bc74 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.104728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef5f4-a16c-403a-9ff7-37f8f554bc74 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.106213 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 270/548] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:05.115506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.115506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.115506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.138082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:05.141274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:05.182943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e621f-455a-410c-99b4-93a8fff68c7f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.262347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.262992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.263282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.263536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.277183 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 271/549] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:05.278347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.279816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:05.302598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:05.303775 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:05.305134 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 279/550] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:05.311762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.348932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.441651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905adee7-4776-4627-bce4-4193727f9b74 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.477520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.478433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.478912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.479378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.480291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:05.480769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.482366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.506157 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 272/551] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.507750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.571483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.619986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a551df-a8a3-49a4-8c71-c432a4bc5390 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.661236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.661859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.662137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.662412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.733533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.734152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.736177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75d863-3672-4481-997e-c7c8a00c26af None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.799415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.839664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.862473 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 280/552] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:05.863973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07783-0d18-45da-8e2d-2a647685229e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.864343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07783-0d18-45da-8e2d-2a647685229e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.864548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcea94-376a-4a22-97bf-40bb08cd4248 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.864679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07783-0d18-45da-8e2d-2a647685229e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.866797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 281/553] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:05.867758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07783-0d18-45da-8e2d-2a647685229e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.912940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.914131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.914411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.914683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.928505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b0fa20ea-d951-4b06-990a-43afb0bcdf77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:05.934629 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:05.935546 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:05.936354 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 273/554] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:05.938307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.938307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.938546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.958514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:05.959994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:05.983492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07783-0d18-45da-8e2d-2a647685229e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.019931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.020642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.021046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.021387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.033165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.034794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.044984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 274/555] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:06.045926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:06.061473 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:06.064163 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:06.066454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:06.066454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:06.066454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:06.070705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 282/556] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:06.073877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.096482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.185219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.213677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc31b4e-c71f-444b-8b79-a3fe482280c9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.258238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.259247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.259746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.260080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.261395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:06.261777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.263381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.275831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 275/557] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.284405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.314021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e028e-f596-4908-b625-e6d92e535297 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.377350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.377969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.378239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.378505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.379148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:06.379440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.380814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66188a87-fd10-4e57-b9a8-427e70c20618 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.394574 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 283/558] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.395638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d448f-23ba-4e79-ab03-2f1020e05834 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.395915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d448f-23ba-4e79-ab03-2f1020e05834 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.396423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d448f-23ba-4e79-ab03-2f1020e05834 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.397670 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 284/559] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:06.398386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d448f-23ba-4e79-ab03-2f1020e05834 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.436661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf4d5-5863-48b3-8a1d-ece5929345d0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.474314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.480386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.481611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.481893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.482163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.485443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.495234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.496680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:06.512172 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:06.513551 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:06.514904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:06.514904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:06.514904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:06.518696 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 276/560] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:06.519428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.526548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d448f-23ba-4e79-ab03-2f1020e05834 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.568175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.568813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.569115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.569383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.581104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-639ab1d4-b991-45a0-9296-68d0ce11743c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:06.586229 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:06.587355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:06.588488 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 285/561] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:06.589244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.589244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.589244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.607651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:06.608846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:06.635886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026530-8327-4aa7-a264-474c3c556e60 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.669687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.670315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.670620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.670844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.675638 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 286/562] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:06.676492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.677753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.679571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-5208ae9b-9968-4a80-8c37-291fd16b92d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:06.692996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:06.694098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:06.695061 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:06.696588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ce4a-4581-4960-a6fa-22d108b4cdb2 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.696876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ce4a-4581-4960-a6fa-22d108b4cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.697176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ce4a-4581-4960-a6fa-22d108b4cdb2 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.699287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 278/564] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:06.699864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ce4a-4581-4960-a6fa-22d108b4cdb2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.756531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.759875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.807109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245aaa-9ad3-4c4d-94ff-396dd5e4af30 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.826181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ce4a-4581-4960-a6fa-22d108b4cdb2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.842060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.842667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.842942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.843211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.844347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:06.844711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.846145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.858562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 287/565] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.859440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.874953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.875934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.876287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.876633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.877375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:06.877676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.879020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96046-864e-408d-a2fc-7adec1792f14 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.893014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 279/566] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.893014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.893014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.893014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.912482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:06.913736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:06.981737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df50deb-eb10-495f-a49d-dfa91d78bbbd None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.989120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 280/567] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:06.989982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.007262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.021024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.021631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.021905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.022177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.022861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.023156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.024629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.035846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.043452 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 288/568] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.043452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.117180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7ca4-b9cc-4885-9129-3342410dbf8b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.153024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0438c-6e04-49a9-a1a5-533e15643f1e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.155642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.156382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.156580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.156866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.167867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.169370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:07.182910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.183959 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 281/569] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.185254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.205413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.206438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.206724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.206999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.219858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.221678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:07.237785 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.238861 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:07.239776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:07.239776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:07.239776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:07.239776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 289/570] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.239776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.278220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.310086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.317524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708f17b-543b-44b6-9c44-ea4ec1f5f151 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.351499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.351885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d07e-facb-47f2-9f6d-95c1bf9e86aa None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.352652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.352652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.352652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.363927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:07.369956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.370900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:07.371810 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 282/571] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.372516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.389838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.390524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.390728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.391039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.391776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=35c19dc65ad64a8eaa5d0f64e7e14079) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.392076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.393547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.399069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 290/572] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/role_assignments?user.id=35c19dc65ad64a8eaa5d0f64e7e14079&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.399947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.486173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090ebe1-75f5-4f4b-bd00-cb5f7ffbfed6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.523210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.523827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.524110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.524304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.524410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.525170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.525443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.526995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.529703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1706-4224-4205-9225-0af9d83c4fbb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.549431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 283/573] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.550456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.569480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.577530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.578146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.578459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.578725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.579627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.579927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.581373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.603879 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 291/574] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.604888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.677817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3705-9b07-44b6-8859-0f9db9079503 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.715808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd4a52-f5a4-4ef6-861a-ff54c240a33e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.720506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.721174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.721447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.721710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.734000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:07.739416 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.740597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 284/575] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.741689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.760301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.760972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.761247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.761514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.762176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.762483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.763849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.772545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 292/576] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.773443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.798122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.832995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.864598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185fe79-8300-4ea1-b190-44d994b69b4f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.884109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06381-645a-4b75-8378-1fd263710de9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.904369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.905041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.905319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.905586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.927000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.928571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.930058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.930672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.930950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.931218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.940397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.941877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:07.944932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.946811 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:07.947754 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:07.947754 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:07.947754 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:07.947754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 285/577] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.947754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:07.960184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.961244 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 293/578] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.962184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.056566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.077883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf64b0-60a6-42a7-982d-0d29cba3788e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.086276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e0ece-2974-4549-afb9-cc1d5db5d030 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.117129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.126738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.127388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.127661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.127929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.129211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.129886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.130415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.130691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.131825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.132134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.133601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.140331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.141956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.144280 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 286/579] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.144280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:08.167528 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:08.169142 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:08.171258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:08.171258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.171258 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:08.171258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 294/580] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:08.171258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.270703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a3ffc-2ccf-4afa-b7a3-aed3c9369d8e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.294552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9106-70a1-408e-a14d-95a92399670e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.312220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.312920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.313204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.313468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.314139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.314432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.315852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.328553 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 287/581] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.329688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.336417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.341799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.342759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.343104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.343734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.345060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.345688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.347184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.365562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 295/582] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.366400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.389981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.445295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49412c4-6e74-40d8-a7e3-13162e517c88 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.474182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de041-edd7-4a50-bf0d-ebfb5d835ed8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.481802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.482426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.482708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.483090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.494407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.496285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.509948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.510553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.510828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.511101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:08.511437 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:08.512363 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:08.518559 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:08.518559 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.518559 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:08.518732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.518732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.518870 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 288/583] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:08.518948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.519018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.534924 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 296/584] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.534924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.589033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.646581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.649454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628bcf-14e4-44b2-939f-ef38479560e3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.651236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c033c-d27e-4aaf-a6f2-065a81f8cc09 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.685275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.686192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.686627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.686900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.690489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.691120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.691399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.691670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.697769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.698679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.699229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.700385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:08.712719 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:08.713809 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 289/585] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:08.715265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:08.719901 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:08.720828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:08.721830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:08.721830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:08.721830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:08.721830 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 297/586] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:08.723716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.828526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6e8-8965-4c0b-8cc1-15494c982cc4 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.830123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b089-89d9-4f6c-bb6d-39ff0ac18045 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.830554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.866139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.867064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.867693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.868244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.868967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.869084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.869357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.869815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.870039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.870307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.870957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.882621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.887708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 290/587] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.887877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.887986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:08.896355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:08.897379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 298/588] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:08.903512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.917270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.007016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d6514-f7d0-421c-91d0-07d126ad66ca None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.007360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174b84-5ff8-4ecc-9317-f9961514400f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.042805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.043038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.043402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.043506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.043680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.043777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.043940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.044033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.044563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.044671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.044863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.044978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.046251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.046348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.058319 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.059047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.073653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.073653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.088461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.158918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.175048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e650d-2cbf-4d76-9046-0fcfaa23a969 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.182177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df07f0-ad92-46c2-bdd7-fe95b5ce2d0e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.215702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.216651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.217104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.217375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.220812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.221444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.221719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.221985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.222703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.223003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.224478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.224810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.226308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:09.238859 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:09.239904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:09.240876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.247853 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.253194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.333665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.355710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b8ad0-07b5-4895-b4f4-cd3bbcf802f3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.367989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa70-9e90-4c75-b41d-a04edb97f2a4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.393998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.394733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.395009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.395269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.402531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.403980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.404810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.405486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.405760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.406025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/b6f23fb45ed14020a6d15f834881d50b/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.415241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:09.415552 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:09.416413 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:09.417786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.427477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=b6f23fb45ed14020a6d15f834881d50b, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.428963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.452944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 293/594] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:09 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/b6f23fb45ed14020a6d15f834881d50b/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:09.452944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.537211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4c69-dce9-4823-885a-10e4abdd20d6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.577487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.578246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.578695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.579057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.580509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.580887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.582506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.604720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.612688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dc2a-be96-492d-9314-9aca76945876 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.615906 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.617427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.663789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.664714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.666930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.666930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.679311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.680791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:09.698269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:09.699286 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:09.700181 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:09.700181 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:09.700181 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:09.700181 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:09.701041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.737633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97b5c-6489-403a-b813-fc8acababb81 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.744575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.777457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.778159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.778508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.778850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.779609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.779983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.782502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180907d1-f8f7-497d-9f74-799d8950bb6b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.799346 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 303/597] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.799346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f531-5d26-4e71-871f-696743933792 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.799346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f531-5d26-4e71-871f-696743933792 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.799346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f531-5d26-4e71-871f-696743933792 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.802408 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 304/598] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:09.803158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f531-5d26-4e71-871f-696743933792 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.815228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4583-ed8c-4e12-81a4-600094d87c3b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.852762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.853518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.853855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.854206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.866666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.867219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.869244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:09.886280 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:09.887495 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:09.893730 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:09.893730 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:09.893730 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:09.893730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 295/599] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:09.893730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.917257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f531-5d26-4e71-871f-696743933792 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.951868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.952480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.952760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.953068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.954257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.954811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.956187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7af2f-c35a-46c4-a83a-f79b6dacdffe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.968954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 305/600] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.970545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.970897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.971233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.989813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:09.991382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:10.001291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.012296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034b76-09d9-487a-9c40-c10cbccd2183 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.052022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.052697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.053001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.053279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/95ff200fd16445debdaa322bf2123ab5/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.064436 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 306/601] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:10.065648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.077776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=95ff200fd16445debdaa322bf2123ab5, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.080518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.096664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 296/602] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:09 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/95ff200fd16445debdaa322bf2123ab5/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:10.097875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.131328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.228940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4bed9-e323-4a2a-8d00-43d67f7763e8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.235346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e88c0-5905-45ff-80e5-e2b395a81abc None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.292661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.294920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.295201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.295473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.296149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:10.296447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.301457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.321026 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 307/603] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:10.326441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.326601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.327274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.327548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.327810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.349949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.351447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:10.372207 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:10.373814 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:10.374931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:10.377619 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 297/604] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:10.386153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.392119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.460282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2c7d-8dff-4ffc-a753-50deb8de390f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.474663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.501015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.502307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.502871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.503385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.511624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe3ba3-9667-423f-b539-15a676dd67de None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.513113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.515973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:10.533306 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:10.534451 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:10.535586 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:10.538219 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 308/605] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:10.539156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.560589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.561390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.562025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.562390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.565414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:10.565850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.568154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.588069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 298/606] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:10.588069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.674758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.676678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0b45-8ccf-4ef9-8455-75bef2e02c0a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.714552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.715276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.715646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.716124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.718946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a007-15ed-4ebd-81e9-05cc7d830d8e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.728078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:10.733355 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:10.734580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:10.735795 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:10.741031 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 309/607] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:10.741996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.760999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.761860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.762289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.762734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.763589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:10.764042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.766699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.777323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.781152 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 299/608] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:10.782326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.889611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394b35f-15b8-4046-8ab9-23bda8a0aa3c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.898918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f3d4-dfb1-404c-9627-46fbd50382a0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.923659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.940866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.941470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.941750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.942020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.942610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.943578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.944018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.944733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.946626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:10.947109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.948738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.959043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=5e0030a2c94142b0af1fe8bf0ac671f8, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.960492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.961738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 300/609] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:10.963027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.985082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 310/610] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:10 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:10.986232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.083435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e026964-c5e2-46a8-8bea-6e2aec9585f9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.124754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d50aca-b225-4975-845c-71064f083827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.126520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d50aca-b225-4975-845c-71064f083827 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.126983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d50aca-b225-4975-845c-71064f083827 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.127401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d50aca-b225-4975-845c-71064f083827 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/051db56282044b44934f4db7ce8cd08c/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.145150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d50aca-b225-4975-845c-71064f083827 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=051db56282044b44934f4db7ce8cd08c, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.147227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d50aca-b225-4975-845c-71064f083827 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.173694 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 301/611] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:10 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/051db56282044b44934f4db7ce8cd08c/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:11.211225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879926c3-55ee-4f7c-b694-c12bb3b34a87 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.215152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.272739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.273436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.273715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.274084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.288035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.289694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:11.312956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:11.314012 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:11.314920 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:11.314920 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:11.314920 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:11.314920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 311/612] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:11.320454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d50aca-b225-4975-845c-71064f083827 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.380940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.491919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d50aca-b225-4975-845c-71064f083827 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.530631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.531240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.531518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.531818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.533020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:11.533325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.534689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.549027 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 302/613] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:11.554932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.694123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b268-cd3c-4b92-ac37-ab2ef135246c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.728353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.736147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.736818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.737132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.737405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.746946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.748378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-f753a976-e1a6-41d9-bea8-f0640e8cbc1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:11.761828 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:11.762869 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:11.763809 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 312/614] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:11.769853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.863280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644997-3846-46d0-a97a-6f11ee6e8cd9 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.863682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644997-3846-46d0-a97a-6f11ee6e8cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.863809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644997-3846-46d0-a97a-6f11ee6e8cd9 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.865454 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 313/615] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:11.870767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.871043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.871312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.897109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:11.898328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:11.927164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.935183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a58f-ec14-4d17-b013-f64b3f6d5319 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.010431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.014694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.015243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.015716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.016754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:12.017286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.018964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.049373 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 314/616] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:12.053325 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 303/617] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.058751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.193088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701127c-f40b-44a9-9e40-2abec2c5c9ff None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.227988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.241486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.242130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.242408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.242677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.256143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.257849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:12.281150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:12.282220 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:12.283120 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:12.283120 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:12.283120 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:12.283120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 315/618] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:12.288242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.392222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.432775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9693-f230-49ac-a19c-3a1c403dc318 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.505545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.506533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.507042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.507509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.509512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:12.510168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.512736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.537039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 304/619] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.541700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.568234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.585865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070fd1c-eb9c-4657-b519-ff1e8af492f8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.659069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.659712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.659987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.660256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.686277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:12.692233 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:12.693234 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:12.694099 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 316/620] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:12.701944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.751118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e2e54-5be0-4956-95dd-3bf4981c599f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.780650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.817849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.818427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.818726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.818973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.826334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.827798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:12.850672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:12.851661 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:12.853035 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 305/621] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:12.857607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.900771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb314de-7c22-479c-92fc-8583830e9477 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.937243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.938260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.938713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.939179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.940109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:12.940594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.941061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.943387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707528-a8fb-4286-8bea-094a98ec0a01 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.959365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 317/622] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.961239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca38c0-9a9f-47e0-ba04-c9e8fa46222c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.961701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca38c0-9a9f-47e0-ba04-c9e8fa46222c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.962206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca38c0-9a9f-47e0-ba04-c9e8fa46222c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.968256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 318/623] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:12.969550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca38c0-9a9f-47e0-ba04-c9e8fa46222c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.973518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8f36-64af-4495-b1e1-6573558e30b9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.009633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.010299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.010584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.010877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.011540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.011842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.013349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6c6d5-fd5a-4042-86d4-d6cd3d944771 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.032779 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 306/624] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.032779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.032779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.032779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.055560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:13.057155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:13.113786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.123510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca38c0-9a9f-47e0-ba04-c9e8fa46222c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.149699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 307/625] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:13.149699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.209709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.210380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.210662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.210932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.242119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.243613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.246395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:13.278581 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:13.279622 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:13.281061 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:13.281061 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:13.281061 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:13.281061 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 319/626] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:13.287974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.291160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae49d8-e8d9-48e3-8634-473076dacbf7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.332008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.332677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.332970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.333249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/35c19dc65ad64a8eaa5d0f64e7e14079/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.349868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=35c19dc65ad64a8eaa5d0f64e7e14079, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.351624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.386891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 308/627] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:13 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/35c19dc65ad64a8eaa5d0f64e7e14079/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:13.515738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02490-288d-4fdc-ac47-6babecc4fceb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.522385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.597492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.598725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.599286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.599702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.600530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.601066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.604087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.625003 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 320/628] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:13.627410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.639990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.676266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428f0b-4a1e-46fd-966a-31de2db38849 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.691834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.718829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.719837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.720390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.720860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.739318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:13.751010 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:13.752103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:13.753476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:13.757483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 309/629] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:13.763663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.781253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a1dd3-b34f-4899-b929-bc7340b6fdaa None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.867766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.868453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.868736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.869048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.879788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.881304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-429e5166-68a4-4993-b7b7-ace6289d1326 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:13.897399 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:13.898433 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:13.899398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 321/630] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:13.900006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f426a-2c38-4441-8361-d4683da1e489 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.900581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f426a-2c38-4441-8361-d4683da1e489 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.900581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f426a-2c38-4441-8361-d4683da1e489 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.904979 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 322/631] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:13.906032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f426a-2c38-4441-8361-d4683da1e489 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.918601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79903e7e-59ab-4e52-9403-79ea900e4ecf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.957316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.957937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.958173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.958444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.959145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.959449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.960933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c790b-b2c4-4ef6-beb9-223067eeda53 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.970697 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 310/632] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:13.972074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.972358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.972653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.988881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.992257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:13.993530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:14.022716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.031535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f426a-2c38-4441-8361-d4683da1e489 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.075093 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 311/633] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:14.076375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.077704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.078532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.079096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.080603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.081551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:14.083169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.085904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426a136-38b6-4f86-8b67-1579a725876d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.108474 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 323/634] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.110008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8774-f7b7-490e-92fe-28e7a97906d8 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.110358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8774-f7b7-490e-92fe-28e7a97906d8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.110791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8774-f7b7-490e-92fe-28e7a97906d8 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.117197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 324/635] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:14.118431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8774-f7b7-490e-92fe-28e7a97906d8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.219285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196caa9-af14-49d9-a96e-6a74918d3283 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.252323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8774-f7b7-490e-92fe-28e7a97906d8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.260854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.261520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.261798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.262068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.273237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.274771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.283381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.294833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0d806844-b5a8-46ba-b4d2-57a57201ccce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:14.295904 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.297382 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:14.298600 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:14.298600 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:14.298600 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:14.298600 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 312/636] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.298879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.299044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.299278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.299636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.300047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.300447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.322244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:14.323447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:14.335813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.382206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.383792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.404813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 313/637] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:14.405709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.520192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984d89-dc8e-4ca8-8547-a50b5dcae3d9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.534525 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 325/638] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:14.534525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.566151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.568777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.570035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.570752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.571448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.572500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:14.573074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.575918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.597809 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 314/639] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.599959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.612065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.654561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc8eb-c880-44bb-909b-2d616cdf6944 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.695059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.695693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.695971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.696242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.707866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:14.714505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.715508 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:14.716434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 326/640] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.717892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.731555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cfaad-c1ee-4f5c-b28f-4c7771b6ea2b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.775133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.775688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.775930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.776199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.788966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.790880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:14.810049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.811077 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:14.811990 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:14.811990 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:14.811990 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:14.816953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 315/641] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.817556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.819079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.837970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b692-c58c-4cbe-b4c3-7cdd2979251c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.876737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.877408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.877677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.877942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.886183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.886903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.887651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:14.899752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.900805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 327/642] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.902018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.940602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4e548-5f12-4df2-893a-410a5f40ad08 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.978181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.979208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.979585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.979923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.991102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:14.996633 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.997805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 316/643] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.998737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.022234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8574-d7f0-4eb0-ae4b-058db15aec61 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.062903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.064368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.064860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.065330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.066212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.066589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.068071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.077122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 328/644] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.077968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.093998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.112479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923503d7-ab4b-47e1-b54c-37c21238c97d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.132202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.154118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.154753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.155116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.155526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.156224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.156679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.158783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.175675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 317/645] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.176536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.199691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c2ce-5057-467a-92cc-73778b7eb069 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.244992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.245676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.245963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.246244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.247264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.247579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.249120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.269876 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 329/646] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.270732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.302643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6813fa-68bc-441d-ab95-5ad833de790f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.344260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.344862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.345153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.345425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.346096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.346394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.347749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.352240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.357607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 318/647] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.358499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.404505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337af10-33b3-4098-992e-7802d0b8139b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.412649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.447484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.447978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.448260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.448528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.460840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.462466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:15.479337 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:15.480539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:15.481486 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:15.481486 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:15.481486 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:15.481486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 330/648] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:15.481486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.491076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99e9f-6739-4977-b2f4-938f8ee54d83 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.527500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.528304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.528678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.529076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.536521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.538105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:15.550772 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:15.551901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:15.553098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:15.554162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 319/649] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:15.554770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.596168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31094-d248-4999-a298-011f304b0408 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.615908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.635234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.635931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.636287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.636631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.666100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.669583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee5c1-e762-482c-82b8-3eab2c23c4c2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.706970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.707776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.708239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.708531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.717985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.719503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.722556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.725190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:15.741915 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:15.743117 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:15.744193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:15.744193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:15.744193 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:15.750133 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 320/650] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:15.750133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.838637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 331/651] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:15.839495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.858727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.859723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189e8be-963e-4ee6-b27f-dc00bfb1a1ad None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.897486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.898097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.898373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.898640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.899275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.899576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.900984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.913062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 321/652] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.913913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.929392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.943356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4384df-97bf-4fd7-b9a0-9c1ed9434f41 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.977335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.977944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.978230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.978493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.979186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.979487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.981009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd735-d24c-47a4-865b-6c075dc90f9b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.993117 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 332/653] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.994523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb98b-a2e5-406b-bce7-9ca4ff92bf4c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.994803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb98b-a2e5-406b-bce7-9ca4ff92bf4c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.995137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb98b-a2e5-406b-bce7-9ca4ff92bf4c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.996288 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 333/654] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:15.997019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb98b-a2e5-406b-bce7-9ca4ff92bf4c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.024512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db186-3f0a-41cb-b752-a61c5ddf876c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.062941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.064289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.065137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.065410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.066013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.066311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.067835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.078490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.081347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 322/655] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.082027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.106834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb98b-a2e5-406b-bce7-9ca4ff92bf4c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.144129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.144676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.144975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.145247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.153340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.159641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.162493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.188012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b111b-a446-4ae3-bf5f-340842748bb5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:16.191243 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.192352 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:16.193330 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:16.193330 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:16.193330 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:16.193720 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 334/656] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.195280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.240595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.241629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.241955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.242363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.252649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.254151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-f41bf61c-0def-409d-932c-4c4cfcb07a1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:16.267337 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.268454 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:16.269484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 323/657] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.270661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03460-c418-495d-8768-3955323d532e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.270661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03460-c418-495d-8768-3955323d532e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.270904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03460-c418-495d-8768-3955323d532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.290953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-27d03460-c418-495d-8768-3955323d532e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:16.292168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-27d03460-c418-495d-8768-3955323d532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:16.326361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344316-5753-4a00-9f65-315c57272c84 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.357816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.365088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.365504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 324/658] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:16.365735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.365987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.366258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.366352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03460-c418-495d-8768-3955323d532e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.367003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=b6f23fb45ed14020a6d15f834881d50b) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.367315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.369087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.388943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 335/659] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/role_assignments?user.id=b6f23fb45ed14020a6d15f834881d50b&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.388943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.447222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.509323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03460-c418-495d-8768-3955323d532e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.531870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f3b9-e675-4356-a6f5-cd52fb3fa649 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.557109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.557763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.558044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.558317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.566836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.568560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.579029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.579938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.580622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.581080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.581916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.582379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:16.583413 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.584418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:35:16.585758 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:16.586832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.586910 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 325/660] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.586910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.599515 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 336/661] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.599717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.677663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.721487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb02a-ed1d-4cca-ab6e-84f90ebcec8a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.724334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988161b-1506-4e31-b285-462a2a371d5a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.745830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.759066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.759681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.759959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.760231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.761051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.761356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.761538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.762232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.762611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.762787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.763057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.763870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.764267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.765812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.783315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 326/662] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.784474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.784940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 337/663] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.785854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.897191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9ce23-4d12-4327-bc58-57d0405f5b80 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.899522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5327b-4d99-47b8-ab6f-2b546a53a4c3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.912405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.936005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.936885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.937330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.937470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.937876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.938036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.938311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.938635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.945742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.947384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.950335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:16.955969 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.957132 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 338/664] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.957982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:16.963103 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.964123 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:16.965038 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:16.969027 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 327/665] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.969027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.017060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.072817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474b27-090d-44cf-b008-4fc6db6bd039 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.082412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8b8a-c0de-40b9-8220-7eef4a8fca7a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.111266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.112042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.112652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.112955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.117011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.117621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.117898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.118168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.161359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.189634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.191104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.197880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.199639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.245324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.299298 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 339/666] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:17.301034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.306911 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 328/667] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:17.307750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.383574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.416508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4beb0-7b0e-4067-8551-12b4f26085f7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.427084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c73ec-076a-44ac-96ed-540e5f9351e8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.453366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.453976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.454336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.454611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.455272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:17.455829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.457227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.463668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.464270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.464546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.464812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.470253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 340/668] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.470410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:17.470410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.470593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.470669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.478615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.487014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 329/669] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.487014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.583840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2a02-2e1a-4f54-8a03-646cba733329 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.602711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1f1e-1d10-498c-81cb-68485f70fc63 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.624882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.625910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.626474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.626987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.629260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.642338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.642710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.642968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.643245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.643510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.644237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.655657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.657111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:17.661598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:17.662511 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:17.663428 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:17.663428 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.663428 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:17.665038 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 341/670] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:17.665863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:17.675900 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:17.676887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:17.677894 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:17.677894 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.677894 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:17.677894 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 330/671] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:17.678868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.737924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.783099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d18933-111d-42a8-89c0-56c586d5036a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.789662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afe03f-4b75-4fce-a2cf-005ab7ceb9b4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.818729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.819367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.819639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.819919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.825141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.825744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.826017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.826282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.827020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=95ff200fd16445debdaa322bf2123ab5) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:17.827361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.828773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.831601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.833526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.835285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 331/672] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/role_assignments?user.id=95ff200fd16445debdaa322bf2123ab5&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.836016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:17.860241 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:17.861512 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:17.862421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:17.862421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:17.862421 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:17.865523 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 342/673] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:17.867041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.931651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.957499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fffe-520d-4812-a954-f3d9a4a0a1da None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.976975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.999852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.000545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.000931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.002328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.002801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.003219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.004856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.020015 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 332/674] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.021122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.029638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c6a7-7ad8-427e-b547-f2552aaf70ee None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.073474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.074284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.074619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.074891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.075578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.076005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.077503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.091998 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 343/675] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.092768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.145701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19af33-5a9b-480c-bc56-f2672c274877 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.190904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.191607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.192002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.192362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.193187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.193495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.194896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.201773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.207092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c816f-8b43-40e4-ae10-72ef2138440d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.211572 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 333/676] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.212452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.244046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.244859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.245269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.245629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.253004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.254394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.255029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:18.268994 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:18.270561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 344/677] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:18.272983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.338089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcc4d-8564-4cfd-b853-872e1a56fd8a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.383818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.384366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.384640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.384926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.390343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb419-fb5d-47c1-b678-65df39ac85c0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.393511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.394977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:18.408426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:18.410810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 334/678] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:18.412981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.429357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.430044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.430327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.430604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.440008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.441651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:18.454242 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:18.457416 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 345/679] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:18.459782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.479320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.519231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.527884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30666e-d348-49b1-a6e8-76c6c65a954b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.569868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.570501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.570787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.571049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.571764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.572068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.573600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.592314 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 335/680] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.593846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.600409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa934-beec-42ee-8013-a20ccedcf7eb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.645155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.646103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.646577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.647515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.648407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.649253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.650744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.668615 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 346/681] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.670150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.718060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f335b5-0422-41ca-a701-0afa19727c5e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.754146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.754793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.755034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.755333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.756056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.756361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.757812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.760375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.780635 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 336/682] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.780635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.791377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a38de-b028-420a-9cfb-425aac033aed None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.794581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.828437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.829102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.829428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.830185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.831161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=051db56282044b44934f4db7ce8cd08c) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.831462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.832876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9f2f9-c7f0-494f-a0f3-4fe0cfd3ee14 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.838801 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 347/683] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/role_assignments?user.id=051db56282044b44934f4db7ce8cd08c&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.840016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6aa9-985f-4716-a6d5-22f56d8a11a7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.840293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6aa9-985f-4716-a6d5-22f56d8a11a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.840549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6aa9-985f-4716-a6d5-22f56d8a11a7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.845086 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 348/684] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:18.845086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6aa9-985f-4716-a6d5-22f56d8a11a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.910919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821f131-ce88-4def-8145-547c106ba7d1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.967061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.967977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.969239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.969671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.971342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.973402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.975851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba6a2-4206-40d5-af52-d2d3dc392321 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.986651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 337/685] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.988327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.989182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.991159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.001851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6aa9-985f-4716-a6d5-22f56d8a11a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.036178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:19.040181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:19.087930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.088565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.088837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.090394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.115839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.177385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 338/686] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:19.215393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.217220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.340130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 349/687] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:19.346731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.357925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.458816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5503-d215-448d-b08e-b2eacfd325e7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.463030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.504114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.504753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.505083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.505351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.517140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.518613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.523888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:19.536989 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:19.538027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:19.538932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:19.538932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:19.538932 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:19.538932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:19.544797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.622151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.645172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7ca4-ccd4-4e10-b545-54941914b8da None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.680226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1554-8b30-4f8b-9289-8e1af4405e03 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.691573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.692810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.693223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.693587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.706057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.707663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:19.724886 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:19.725904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:19.726797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:19.726797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:19.726797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:19.726797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:19.732546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.777939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.778615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.778824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.779094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.779744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:19.780044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.789640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.811462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 340/690] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:19.817758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.854501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.862955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605f59-382f-47a2-a78e-e3cfc986f7b8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.904925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.905532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.905807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.906076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.910365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:19.910669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.913184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.940030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 351/691] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:19.945213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.051209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a035f-9577-413b-ac20-15cfedb10cd9 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.086416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:20.097728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.098624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.098908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.099183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.106855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.108421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.110070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab59ee-670f-43fa-b57c-227742ebc109 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:20.120634 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:20.121877 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:20.123026 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:20.126077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 341/692] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:20.137264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.167162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.167773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.168049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.168407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.169099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.170666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9185-3ee6-4287-b403-2a89adae4517 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.199368 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 352/693] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:19 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:20.326877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d357-637f-43e1-9b39-7ee6f8751158 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.332327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b09-324f-4f1d-bc72-a18e845311ab None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.332643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b09-324f-4f1d-bc72-a18e845311ab None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.332881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b09-324f-4f1d-bc72-a18e845311ab None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.335103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 353/694] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:20.341111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.341421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.341644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.374652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.375691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.376185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.377249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.378228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:20.378743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.380233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:20.380779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.381475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:20.384850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:20.396799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 342/695] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:20.410614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.474873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:20.505009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 354/696] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:20.541948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60454-bb1f-47d0-9030-93397ff5776b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.578194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.578728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.579057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.579328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.580959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=35c19dc65ad64a8eaa5d0f64e7e14079) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:20.581290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.582728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.589561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 343/697] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/role_assignments?user.id=35c19dc65ad64a8eaa5d0f64e7e14079&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:20.787904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.895111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b884333-d83b-4e35-b0c6-ab2da98b760f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.932254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.933312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.933818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.934287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.935076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.936656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:20.948706 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:20.950057 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:20.951165 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:20.958586 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 355/698] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:20.960104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.066782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e170b-c5ad-4455-83db-ef6322b1e40a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.069574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.105570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.106457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.106884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.107302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.108072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:21.108520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.110069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f34770-da9f-4f0a-a871-cb785f1ebc61 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.119252 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 344/699] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:21.121302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.126092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.240465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2c75b-d9dd-4aa0-a8bb-c33026f646eb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.278480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.279406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.279904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.280350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.281261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:21.281769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.283457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b2da8-8cbe-4239-b176-40e812af5832 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.297052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 356/700] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:21.693528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8f66d-89e0-42ea-aee9-ee676eea384e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.694232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8f66d-89e0-42ea-aee9-ee676eea384e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.694739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8f66d-89e0-42ea-aee9-ee676eea384e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.696887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 345/701] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:21.703539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0f4d7-268f-4f02-a1fa-1182c8d69149 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.704173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0f4d7-268f-4f02-a1fa-1182c8d69149 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.704705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0f4d7-268f-4f02-a1fa-1182c8d69149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.726511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a0e0f4d7-268f-4f02-a1fa-1182c8d69149 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:21.728822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0e0f4d7-268f-4f02-a1fa-1182c8d69149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:21.870457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.889486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 357/702] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:21.966242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f05544-81ea-48e4-b2fd-3afd9e964373 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.966792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f05544-81ea-48e4-b2fd-3afd9e964373 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.967400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f05544-81ea-48e4-b2fd-3afd9e964373 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.970586 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 346/703] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:21.976108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.976568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.976660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.002924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:22.004123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:22.098217 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 358/704] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:22.422717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f05544-81ea-48e4-b2fd-3afd9e964373 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.588311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.663503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f05544-81ea-48e4-b2fd-3afd9e964373 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.739532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.740465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.740940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.741437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] PATH_INFO: `/v3/services/network` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.742360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.744628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.772936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a2317-7b04-4274-8dfb-34ec9dab3009 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:22.787318 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:22.788420 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:22.789405 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:22.790177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 347/705] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/services/network => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:22.796525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.824299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.840868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.841599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.841878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.842145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.864977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.866046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:22.871449 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:22.872403 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:22.873324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 359/706] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:22.888581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.946910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16b6a-39bb-4b82-8669-e4081859b549 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.982946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.983578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.983825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.984098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.984794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] RBAC: Adding query filter params (name=network) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:22.985127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.987045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.996488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:22.997905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.097947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.104788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73596f5-57a5-42a1-9e3e-c15f0b8b1fee None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.140515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.141169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.141447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.141715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.142411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] RBAC: Adding query filter params (type=network) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:23.142713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.144097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.157056 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 349/708] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:23.160629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be73dd-c3a9-46d4-98f0-c48778e9e1de None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.237838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.238554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.238841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.239110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.239795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:23.240096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.241515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0e503-8137-4f80-828c-e5c941b37456 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.252575 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 360/709] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:23.258347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.315042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee385-041b-47cb-a62e-cc15984ed272 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.315386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee385-041b-47cb-a62e-cc15984ed272 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.315598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaee385-041b-47cb-a62e-cc15984ed272 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.317220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 361/710] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:23.327047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.327383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.327590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.366072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:23.367309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:23.389848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061a677-f8e4-4296-a381-f4d35c020812 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.430243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.430900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.431181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.431641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.444133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.445846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.452311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:23.467162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:23.468205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:23.469178 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:23.469178 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:23.469178 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:23.469178 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 350/711] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:23.478376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.481550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 362/712] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:23.497392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.612609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181e66-1e14-4060-841a-82f3947bc7c5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.658245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.658861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.659139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.659409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.660054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:23.660359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.661749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.682539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 351/713] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:23.687906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.790326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.833784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d920b5a-0739-4f65-bf70-0a0f9dc47f28 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.871466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.872021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.872295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.872562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.880762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.882262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-946ec3a7-1b12-444b-8be4-b189829b3277 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:23.894636 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:23.895666 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 363/714] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:23.897097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0eac-43d7-47cf-ad4c-e38daaa13120 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.897774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0eac-43d7-47cf-ad4c-e38daaa13120 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.897774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db0eac-43d7-47cf-ad4c-e38daaa13120 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.898860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 364/715] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:23.903844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db0eac-43d7-47cf-ad4c-e38daaa13120 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.916430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.953904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.955581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f4609-96ec-43d1-9999-bc709260d99f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.002342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.003206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.003486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.003765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.016147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:24.017893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db0eac-43d7-47cf-ad4c-e38daaa13120 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-537bfc2b-c070-4dff-bbad-74f53d138ecd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:24.022449 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:24.023426 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:24.024278 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:24.028969 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 352/716] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:24.030292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd1a1-719f-4311-8b8f-71e8201cf6cc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.031046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd1a1-719f-4311-8b8f-71e8201cf6cc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.031328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd1a1-719f-4311-8b8f-71e8201cf6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.054529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-549bd1a1-719f-4311-8b8f-71e8201cf6cc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:24.055899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-549bd1a1-719f-4311-8b8f-71e8201cf6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:24.057576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.058370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.058742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.059101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.059901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:24.060270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.061796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.080506 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 365/717] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.081753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.135606 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 353/718] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:24.137109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acfb-99af-4d5b-9444-163e93b2a609 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.137484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acfb-99af-4d5b-9444-163e93b2a609 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.137825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acfb-99af-4d5b-9444-163e93b2a609 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.139267 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 354/719] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:24.139894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5acfb-99af-4d5b-9444-163e93b2a609 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.218568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.225991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993384ed-1cb8-4ee5-a965-1eb3bc4b9033 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.228438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.274486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5acfb-99af-4d5b-9444-163e93b2a609 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.278298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.279007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.279356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.279692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.280423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:24.280788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.282249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaaf71-062e-417d-94d1-5f43043aa559 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.298535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 366/720] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.298535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.298535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.298535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.318016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.318985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.319532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.320002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.320108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:24.321399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:24.398701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.401542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.417847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 367/721] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:24.419091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.468310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.518896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 355/722] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:24.519683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.538877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.552449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2b3e-ec22-4ec8-909a-b316340f8100 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.598803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.599553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.599901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.600552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.615041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.616940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:24.638712 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:24.639791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:24.640767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:24.640767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:24.640767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:24.640767 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 368/723] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:24.641050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.661931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e5af8-1c4d-4b72-bdc7-05335f1f44dd None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.703018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.703623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.703902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.704172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.717787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:24.723913 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:24.725029 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:24.725891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:24.726625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.754845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.778682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620eb4-2aff-441f-af55-305f6a5a660a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.813700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.814857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.815135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.815404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.829358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.830949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.833243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.842624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490df33-ea3d-4926-8264-07c1125c7190 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:24.848030 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:24.849027 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:24.850056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:24.850056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:24.850056 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:24.853870 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 369/725] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:24.854799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.884605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.885249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.885558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.885795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.886499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:24.886737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.888096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.900457 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 357/726] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.901015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.965376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789071-672c-4fe8-933f-142b22f2329c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.989763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.003562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.004192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.004466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.004729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.005476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.006982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.009128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9462-7801-4bce-a256-65ecfd23e345 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.024955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 370/727] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:24 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:25.024955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.084147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.084784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.085089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.085357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.086038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.086338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.087927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.100088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 358/728] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.101197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.104140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.163567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bfcc-20fb-46b1-be25-0b9eeee61516 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.212856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.214206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.214624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.215023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.216217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.216799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.218628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.233089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 371/729] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.233293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.252275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cbc18-5cf2-45ce-9107-f90d4d38db8c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.292936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.293583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.293859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.294126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.306216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.306960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.316306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:25.328294 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:25.329352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:25.330352 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:25.332057 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 359/730] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:25.333000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.366510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-2342-4f53-b9d1-c73ee28f9b36 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.383495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.411444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.412587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.413303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.413734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.429838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.431528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:25.452835 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:25.453884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:25.455752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:25.455752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:25.455752 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:25.460399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 372/731] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:25.461809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.480357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cedec-a687-46f5-af5c-99413e0ba2c6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.537467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.538600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.539135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.539673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.550117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.553180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:25.567707 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:25.568880 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:25.570057 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:25.578330 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 360/732] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:25.580136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.612713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a797e-a81b-4d3f-87e0-e6616bd270fc None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.654639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.655409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.655793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.656167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.657084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.657491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.659593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.681437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 373/733] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.682774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.699000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.711292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.782662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e3524-3660-41c1-b6db-bd368a144568 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.794507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b73e5-ce3d-4092-93d9-3782d487e7e1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.828050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.828680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.828991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.829292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.829929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.830290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.831977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457378-aa14-4d50-a6b6-03e2a458a22e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.844372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.845032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.845314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.845594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.850480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 361/734] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.850758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.850758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.851002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f699-a1d3-4cf8-8c64-7fd0a7564657 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.851002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f699-a1d3-4cf8-8c64-7fd0a7564657 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.851002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f699-a1d3-4cf8-8c64-7fd0a7564657 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.851186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.853815 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 362/735] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:25.854622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f699-a1d3-4cf8-8c64-7fd0a7564657 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.863768 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 374/736] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.865929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.967225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.984669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146fcea-9f29-4a75-a4b9-2c734d6060c5 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.987138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f699-a1d3-4cf8-8c64-7fd0a7564657 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.012639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.030634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.031251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.031530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.031722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.031834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.032423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.032753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.032999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.043626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.045164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-49f998ee-9d2d-4779-8bd0-a91263d39097 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:26.057767 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:26.058817 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:26.059771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 375/737] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:26.060979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.060979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.061148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.084297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:26.086112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:26.124607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.126484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.176219 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 376/738] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:26.177204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.265727 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 363/739] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:26.267021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.271239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.294773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.308186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d71f-0982-40ba-a3b5-416a3385a86c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.350426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.351050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.351325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.351591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.352338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.352644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.354150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.361128 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 377/740] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.362211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.529737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd0f98-abf6-4fc0-ae2d-0ff696b82347 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.571449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96392-f5e6-4002-b730-ef8641a781f7 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.585241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.586379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.587513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.587513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.598011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.605169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.606649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.624698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.625362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.625637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.625905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.626700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.627083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:26.628347 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:26.629342 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:26.630623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:26.630623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:26.630623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:26.630813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.630886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 378/741] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:26.631236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.657822 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 364/742] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.658768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.754934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.771586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab831a-5dec-4492-b41f-2df996d49d2c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.785238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a622-5a69-4851-adba-45e34c6def2d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.814114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.815494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.815494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.815854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.816527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.817971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.834613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.835038 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 379/743] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:26 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:26.835807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.836050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.836639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.837184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.838228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.838885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.840751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.855738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 365/744] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.862887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.900696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.980820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030908cc-f2cb-4116-9d13-192e8a83d24a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.994596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc79b5-bbca-465b-8b19-5e9ce504d611 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.039946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.040939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.040939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.041210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.043097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.044393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.045164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.045890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.049250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.050961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.054125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:27.067912 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:27.068971 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:27.069896 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:27.072582 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 366/745] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:27.079749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.212193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94552139-1256-4ca4-bdd8-902c8921446b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.251431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.253884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.254307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.254712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.255113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.255700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.256481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:27.256800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.258287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.272732 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 367/746] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:27.278897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.348453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.418764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 380/747] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:35:27.421164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.436051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.502502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a38-231f-4b03-82c7-f31489fbbe6c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.566884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.568011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.568397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.568873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.570264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=557422469bd844e6ba2ea08c1db83be3) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:27.570809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.573569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf98e-2a53-40cb-ae0e-d1a0ad228b89 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.577697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a90d12-3c1b-4b2f-b651-bf7fdb7bf0c8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.588648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 368/748] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/role_assignments?user.id=557422469bd844e6ba2ea08c1db83be3&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:27.591155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9a07-a9fb-43bb-9f86-a82080a1dae1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.591643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9a07-a9fb-43bb-9f86-a82080a1dae1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.592091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9a07-a9fb-43bb-9f86-a82080a1dae1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.604393 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 369/749] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:27.614414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665078ae-affa-49b9-86eb-054909b3377d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.614692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665078ae-affa-49b9-86eb-054909b3377d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.615074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665078ae-affa-49b9-86eb-054909b3377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.646809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-665078ae-affa-49b9-86eb-054909b3377d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:27.648041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-665078ae-affa-49b9-86eb-054909b3377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:27.656738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.657415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.657688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.657953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.683488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.685065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.700064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:27.713665 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:27.714759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:27.715676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:27.715676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:27.715676 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:27.715676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 381/750] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:27.723896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.822380 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 370/751] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:27.929942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035eb41-7aa2-4ce3-86f4-1f592daa691f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.002469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.003582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.004122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.004597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.005805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.006327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.008847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.042259 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 382/752] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:28.051240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665078ae-affa-49b9-86eb-054909b3377d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.132347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.205826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665078ae-affa-49b9-86eb-054909b3377d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.253495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.254134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.254406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.254668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.262129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.263578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:28.280958 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:28.283020 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:28.286195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 371/753] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:28.297627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.389665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.395269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.488824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8f50b-b2ad-4b0e-bf4d-04384b52cb68 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.561663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.563148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.563433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.563702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.564434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.565279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.566825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.596750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 383/754] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:28.598697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386ffb-7687-45a1-93c8-b3b505a13fc2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.610598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.661989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.662935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.663213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.663929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.668118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.669329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.671948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:28.683643 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:28.684734 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:28.685625 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:28.689090 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 372/755] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:28.695664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.850653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9fdfa-9320-405e-af6c-68a23539a727 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.908799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a80b-6812-4a20-ab94-ff8a87bedf62 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.927973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.928554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.928831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.929122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.929761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.930061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.931460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.940480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 373/756] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:28.947939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.952716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.980695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.981342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.981618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.981885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.982617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=35c19dc65ad64a8eaa5d0f64e7e14079) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.982930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.984375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf5e6-bca3-4dc2-bd44-fb09ffe991fe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.996931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 384/757] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/role_assignments?user.id=35c19dc65ad64a8eaa5d0f64e7e14079&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:29.017769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.048841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2219c-b9a1-43b7-a702-828702555c4a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.049649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2219c-b9a1-43b7-a702-828702555c4a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.050140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2219c-b9a1-43b7-a702-828702555c4a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.052096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 385/758] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:29.058119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.058748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.059226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.080717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:29.082635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:29.153107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022ee70-faee-45f3-830b-3bddea7b6d4a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.172983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 386/759] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:29.217707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.218697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.219183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.219664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.220531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:29.221618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.223290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.234041 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 374/760] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:29.240627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.358455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c079d5-7814-469f-a3ea-2230a5177e60 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.374105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.399416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.400892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.401419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.401894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.402807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] RBAC: Adding query filter params (interface=public, service_id=78ae48384c904b9fad2a080ef5caeacf, region_id=RegionOne) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:29.403342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.404990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.414487 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 387/761] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/endpoints?service_id=78ae48384c904b9fad2a080ef5caeacf&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:29.421214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.602120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.687775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd1d33-9250-4231-9928-684db60c12e8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.693191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.756937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777b38a-e1fa-4542-a2be-9f65c11214e9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.786663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.787290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.787566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.787833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.788435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.789946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.792520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.793485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.793973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.794463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.796012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 375/762] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/services => generated 772 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:29.823333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:29.829452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:29.830515 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:29.831382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:29.841711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 388/763] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:29.850092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.999029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb6d0-74d2-4000-b367-aa1f232ba438 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.038549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.039175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.039449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.039712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.040375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:30.040669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.042066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.051692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 376/764] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.058076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.117620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.239226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d09c0-8fd9-486e-a500-1455475afa10 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.297233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.298137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.298517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.298888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.316944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.319179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-85184f36-4271-430c-83d2-88c7c66d33df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:30.343561 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:30.345452 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:30.348186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:30.348186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:30.348186 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:30.348186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 389/765] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:30.354451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.419605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.517662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d10-56ba-4854-9466-c532cd5e4e94 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.527314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ff7d-4deb-4f4c-8a57-f1502708475d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.528788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ff7d-4deb-4f4c-8a57-f1502708475d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.529610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ff7d-4deb-4f4c-8a57-f1502708475d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.540940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 390/766] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:30.547239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.547893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.548455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.564238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.565817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.566280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.566729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.567557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:30.568486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.570337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.589563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 377/767] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.599293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.614897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:30.616165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:30.704139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 391/768] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:30.822905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.844406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e50ca-786b-44c3-a0b2-c7ac156b7e9b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.914516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.915592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.916057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.916544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.931430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.934206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c1cebf8d-c89a-41bd-9930-803b3d9bc635 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:30.959034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:30.960080 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:30.961212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:30.961767 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 378/769] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:30.970962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.972404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324184-7f00-48fc-86f1-99afc4d22cce None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.972893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324184-7f00-48fc-86f1-99afc4d22cce None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.973472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324184-7f00-48fc-86f1-99afc4d22cce None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.976291 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 379/770] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:30.983129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.983704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.984190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.996409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.021734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:31.023921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:31.090038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258094-4777-4fc0-ae08-3777ed2aadbe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.128850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.129511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.129787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.130056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.130796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:31.131098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.132554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.152394 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 392/771] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:31.158086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.170842 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 380/772] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:31.257190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.347262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.404610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74143e-e57d-4b52-b00e-331e9a47034c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.464184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.487847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.488492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.488764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.489086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.507817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.508083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a689b-f731-4dfb-9ae2-029671ca7066 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.509479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:31.532697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:31.536227 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:31.539340 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:31.539340 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:31.539340 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:31.539340 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 393/773] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:31.539340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.569012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.570135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.570681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.571183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] PATH_INFO: `/v3/services/network` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.572705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.575201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:31.590254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:31.591556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:31.592696 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:31.598366 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 381/774] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:31.603026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.732481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c5c5-0c7c-43eb-aa55-c626c6d65dab None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.772385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.774689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467a91-f5d1-4e30-af3c-6dfdabcc2f18 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.789028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.789688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.789974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.790243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.808226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:31.815957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:31.817957 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:31.819596 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:31.823411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 394/775] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:31.824726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.852995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.853673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.853944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.854217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.855846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:31.855846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.857278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.878250 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 382/776] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:31.878250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.884765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.987276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08b5f-9117-4003-8b9a-60f425ebe83d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.998959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c7ab-a0ac-4a07-920b-ade361db8cb8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.032961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.034762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.035262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.035805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.037043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] RBAC: Adding query filter params (name=network) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.037574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.037983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.038675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.038960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.039234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.039906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.040211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.040832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.041771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.052353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 395/778] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.053769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.055724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 383/778] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.056890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.133763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.140997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.203523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586ef-1877-4d3b-a5a6-feb55ab4a043 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.214914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819f83-cccc-45ce-83dc-6925931ee2ac None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.259707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.260719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.261159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.261428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.261674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.262261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.262419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.262529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.262644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.262759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.264239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.278003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 384/779] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.278245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.278364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.278501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e345ef4c-cebe-4383-989c-0a4546afbb8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:32.292010 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:32.293608 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:32.294534 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:32.295625 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 396/780] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:32.297034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05802b-24fc-474d-8841-2b5d50cf1462 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.297315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05802b-24fc-474d-8841-2b5d50cf1462 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.297573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05802b-24fc-474d-8841-2b5d50cf1462 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.299114 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 397/781] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:32.299971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05802b-24fc-474d-8841-2b5d50cf1462 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.441753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fd223-63aa-4dd2-8c04-9928f1d41cd5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.477016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05802b-24fc-474d-8841-2b5d50cf1462 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.492718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.497181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.503751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.505224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.505813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.506385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.533499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.535628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.539089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.540389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.540593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.541117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.550729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] RBAC: Adding query filter params (interface=public, service_id=e9de5187595a4ea4a8813079844eba77, region_id=RegionOne) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.550729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.550729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.562665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 398/782] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/endpoints?service_id=e9de5187595a4ea4a8813079844eba77&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.564117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-8982871d-a08e-486f-97c6-6d534ee80fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:32.564790 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:32.566793 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:32.569024 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:32.569024 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:32.569024 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:32.569394 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 385/783] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:32.572224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.572224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.572224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.596372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:32.597635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:32.695922 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 386/784] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:32.696812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.748333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295fd1-036a-4822-a76d-ab76d7d586be None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.824069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.825151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.825733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.826069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.826865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.827206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.829681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.860937 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 399/785] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.860937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.871336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4979b2-12e7-40cd-8372-1cb00c3ca8c0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.898560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.916758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.938169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.938863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.939134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.939345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.939916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.941934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.949109 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 387/786] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.949109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.069422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655aeb0-f9e0-4fb2-a993-384deea095e3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.117442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.118264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.118754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.119232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.120404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:33.120891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.122879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b751-b581-4e07-a8a2-7ad41fcd692c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.125491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d1a1-3bc9-4c4d-8037-d21cf2268320 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.139030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 400/787] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:33.140121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda153-6ac1-42f1-9bf7-ec56661acfd1 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.140410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda153-6ac1-42f1-9bf7-ec56661acfd1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.140686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda153-6ac1-42f1-9bf7-ec56661acfd1 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.142006 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 401/788] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:33.147013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dda153-6ac1-42f1-9bf7-ec56661acfd1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.178545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.179396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.179775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.180146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.182287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=5e0030a2c94142b0af1fe8bf0ac671f8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.183785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.205479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 388/789] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:32 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:33.207642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.292187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.364036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.380021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dda153-6ac1-42f1-9bf7-ec56661acfd1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.434389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b39d-a31f-44a0-8a41-78445eb55aa8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.456811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.458089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.458405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.458754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.478362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:33.479488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.480323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.480745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.481199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-3fbf4f54-379a-4ea5-9f4d-661e02625f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:33.487737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:33.488980 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:33.490060 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:33.490896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 402/790] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:33.493129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.493517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.493959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.494098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.495834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:33.510365 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:33.511627 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:33.512828 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:33.515236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 389/791] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:33.516365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.686464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:33.688071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:33.691078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.700056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baccaf-64fc-480a-b4b1-1d30d5d3b8a3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.753913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.754652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.755218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.755791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.757571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:33.758229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.760385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.777236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 390/792] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:33.778764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.813121 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 403/793] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:33.814383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.016328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.034657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d97135-f917-434b-9d63-5c43b82968ce None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.053922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118a9d-ec83-4b74-bcf5-63fd942d1b0a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.151664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.152802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.153307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.153762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.155139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:34.155749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.158450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.167007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.168032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.168388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.168657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.193723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.195202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.196204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 391/794] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:34.207100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:34.255891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:34.257977 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:34.260076 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:34.260076 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:34.260076 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:34.260076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 404/795] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:34.260076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.269225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.421916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463e9f6-3f42-4e04-a071-d700ca9727b3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.449522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b593c2-d5be-43a0-9a5c-df3e67ba394d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.478188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.479093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.479451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.479761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.498618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.499834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:34.517920 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:34.520583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:34.522486 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:34.522486 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:34.522486 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:34.522486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 392/796] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:34.522486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.524285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.525751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.526607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.527340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.528606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.531469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:34.547899 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:34.550066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:35:34.551777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:34.555919 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 405/797] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:34.557575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.562645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.606323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.661727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164aeb-7c15-423a-915b-b0a30cb9aa79 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.705386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.706845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.707279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.708151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.709075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:34.709524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.711042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.712604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8b43-dccb-47ed-b087-808660a7606a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.728976 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 393/798] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:34.730440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.759006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.760619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.761118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.761688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.762800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:34.763316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.765789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.783957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 406/799] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:34.785110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.890798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7989003-813b-4489-9662-1e6da5d1976a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.898998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.927467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.943385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.944733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.945235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.945686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.946581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:34.947278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.949422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.956600 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 394/800] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:34.957992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.975199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d5c9-1103-4454-8942-4cc2c020f779 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.041460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.042677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.043336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.043790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.056184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.059188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:35.082334 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:35.083747 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:35.084892 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:35.088001 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 407/801] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:35.089247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.096242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a1be-9765-4722-9ad3-71ebc878a0fa None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.145558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.146505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.146976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.147410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.159989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.162177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:35.180743 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:35.182640 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:35.184190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:35.185790 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 395/802] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:35.186976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.259764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e281b-282a-42b2-9517-fd16ec53d4e6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.271804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:35.290504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:35.309578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.310665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.311288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.311813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.313055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:35.314854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.316723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.326227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 408/803] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Oct 28 09:35:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:35.327912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.388785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ebd01-c79b-49f0-a611-943f0bde1547 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.472991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.474359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.475027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.476004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.478458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:35.479222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.482497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.511536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950a71-95e1-42ee-a2c7-944488e94a1d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.526958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 396/804] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:35.530128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.576577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.577682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.578278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.578861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.580271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:35.581494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.584676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.610766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 409/805] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:35.612781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.689650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:35.706400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98494c-a4fb-42cf-a832-abf3f81416d3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.722246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:35.757502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.758302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.758690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.759013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.759758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.761518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f98e17-2c08-469d-b4d6-e07e13e28d39 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.775060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fc4a-2aae-4c75-b9b4-a8d654e6dd5a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 397/806] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:35:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8937-fb77-463c-ab13-10f4b5991e6a None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8937-fb77-463c-ab13-10f4b5991e6a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8937-fb77-463c-ab13-10f4b5991e6a None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 398/807] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:35.804950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef8937-fb77-463c-ab13-10f4b5991e6a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:35.846199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:35.847414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.847785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.848268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.863590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:35.865661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-4b8e4f9f-1266-449f-8b8c-1cc5de713dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:35.887791 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:35.889927 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:35.891443 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:35.891443 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:35.891443 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:35.891443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 410/808] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:35.891834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:35.891985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:35.892836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:35.918994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:35.920415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.005393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef8937-fb77-463c-ab13-10f4b5991e6a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.040949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 411/809] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:36.040949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.068657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.070266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.070742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.071213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/557422469bd844e6ba2ea08c1db83be3/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.074302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.097275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=557422469bd844e6ba2ea08c1db83be3, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.100324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031d46-2e89-4c69-af54-5829d4a7f022 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.118456 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 399/810] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:35 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/557422469bd844e6ba2ea08c1db83be3/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:36.119729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02332-6cd2-45a0-a48c-a3a9fe8ece19 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.120008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02332-6cd2-45a0-a48c-a3a9fe8ece19 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.120274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff02332-6cd2-45a0-a48c-a3a9fe8ece19 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.122042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 400/811] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:36.128967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.129284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.129528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.151369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:36.152714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.167456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.196692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b0b8-ba9c-4965-abde-79e3fe198be3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.286045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.287083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.287552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.288023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.289235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:36.289773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.292021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.295246 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 401/812] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:36.330138 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 412/813] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:36.337887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.341033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.466651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.496765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff9af1-e2d8-433d-a9e2-e1cfde6219f6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.527520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c2ca7-da66-4ea6-ab58-d75ddd2eec5a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.563149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.563947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.564304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.564761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] PATH_INFO: `/v3/services/network` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.565959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.568026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:36.587967 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:36.589647 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:36.590938 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 413/814] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:36.602651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.603920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.604650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.605014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.605286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.624605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.626152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:36.649816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:36.652099 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:36.653918 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:36.657686 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 402/815] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:36.668078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.686556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.788261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8eb90-3a15-434b-9540-91611bd70c8d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.818402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b6f47-4b5e-4fae-b874-61e0541941bc None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:36.852149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.853174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.853548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.854011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.855026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] RBAC: Adding query filter params (name=network) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:36.855397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.857294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.859842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:36.860556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.860841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.861139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.861856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:36.862166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:36.863727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:36.864782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 414/816] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:36.866572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.879405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 403/817] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:36.880532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.901448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.960982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.003207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee5a3-e106-42cb-b4d6-55471ba32a24 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.026528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a2524-77c4-4a6b-a318-07938c5de924 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.048006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.048754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.049208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.049584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.050872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] RBAC: Adding query filter params (type=network) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:37.051278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.053376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.059541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 404/818] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:37.060769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.073848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.074760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.075351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.075775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.090007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:37.096556 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.097923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:37.099022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:37.101575 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 415/819] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:37.102646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.197309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44611e-d57f-41fa-9542-6e9c8bbd44ad None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.234146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.236425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.243875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.245055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.245586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.246135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/35c19dc65ad64a8eaa5d0f64e7e14079/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.248511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=35c19dc65ad64a8eaa5d0f64e7e14079, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.250438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.267709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 405/820] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:37 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/35c19dc65ad64a8eaa5d0f64e7e14079/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:37.269394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.300826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868af89-fdc5-4ec9-8367-9311c8c6d216 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.405845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24eee-0f6c-4665-afeb-1e61e9bf10cd None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.414856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.415582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.415871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.416170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.417149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.419059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.451775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.452991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.453570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.454097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.455156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:37.455762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.458450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.473018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 416/822] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:35:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:37.475590 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 406/822] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:37.477425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.666463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6ecdc-f567-4866-861b-8a62b2a3db06 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.698054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.713350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.714083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.714370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.714643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.729192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.730706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:37.748838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.750034 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:37.751063 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:37.751063 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:37.751063 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:37.752843 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 417/823] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:37.756558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.824377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.898291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bad377-1a7a-49bc-beba-50744528cd23 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.941406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.942114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.942394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.942693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.943400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:37.943707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.945351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.962177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 407/824] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:37.967616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.114710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3fc6-f47f-4e7c-b56e-68770ed45823 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.153494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.154032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.154312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.154586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.164043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.165965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:38.179709 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:38.182864 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:38.185786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 418/825] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:38.197032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.310806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3713fb-6719-4600-98d5-61432cdc3520 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.326964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.352744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.353982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.354465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.354954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.356019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:38.356601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.358350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445ba62-54cb-4c00-bf97-e39fd7b06bc4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.384786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 408/826] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:38.387085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.438305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.558466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4f6-b0fb-4329-b8ec-80e19726796a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.610526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b4df-e126-471e-adc1-4c33d6d0d8a4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.610905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b4df-e126-471e-adc1-4c33d6d0d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.611171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b4df-e126-471e-adc1-4c33d6d0d8a4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.613929 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 409/827] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:38.620275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.620603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.621041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.630499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.631872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.632577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.633378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.645527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:38.647004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:38.738303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.739671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.765097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 410/828] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:38.791912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.886962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 419/829] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:38.892498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.007754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.011794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297c01-4ed7-45e6-8c84-b48791f0ecf9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.056779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.057524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.058275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.058563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.058881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.072097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.073788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:39.091306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:39.093710 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:39.095921 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:39.095921 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:39.095921 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:39.100982 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 411/830] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:39.102747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.199892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b93f-cf15-4198-bf48-03a1ae376d22 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.243204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.243875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.244165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.244481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.245107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.246832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b970f56f-9f68-454d-a37c-70383b7c6af2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:39.258002 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:39.259988 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.262066 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 420/831] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:39.263699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801500f-e844-4a4a-8794-4135107c8bd7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.263699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801500f-e844-4a4a-8794-4135107c8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.263927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801500f-e844-4a4a-8794-4135107c8bd7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.266491 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 421/832] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:39.267983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801500f-e844-4a4a-8794-4135107c8bd7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.306261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44decb-b3a9-41d5-91a9-cb102241ea0d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.351240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.351861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.352135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.352398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.353069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.353370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.354744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7d49-921e-419e-8e68-e7f33aa88424 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.369685 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 412/833] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.371845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.372298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.372741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.402677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:39.405004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:39.418549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.429129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801500f-e844-4a4a-8794-4135107c8bd7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.483138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.483755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.484087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.484368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.484918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.485246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.486646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.499075 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 422/834] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.499075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.528172 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 413/835] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:39.530182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.620411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.706940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385924c1-9acf-4424-afee-d4fd626d59c8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.724401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da249a8-2346-454a-a91a-aa3796368296 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.779356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.780604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.781381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.781983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.788636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.788636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.788636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.790290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.790290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.790290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.791282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.796885 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 414/836] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.803548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.807411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:39.827848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:39.828887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:39.829845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:39.830333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.839123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.839870 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 423/837] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:39.842438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.969458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6bd58-3299-49aa-9f2c-cd31b4c53f3d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.016019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.017534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.017825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.018095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.022469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38123970-5b32-45eb-b4c4-0efe9c64c85a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.030765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-285538b5-a874-4dab-a25a-ed324b477f1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:40.036115 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:40.037398 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:40.038417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 415/838] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:40.042526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72df7-55c5-4c29-869f-fceb79728c91 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.042815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72df7-55c5-4c29-869f-fceb79728c91 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.043097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72df7-55c5-4c29-869f-fceb79728c91 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.044448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 416/839] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:40.045231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72df7-55c5-4c29-869f-fceb79728c91 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.064797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.077150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.077806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.078121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.078399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.079148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.079452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.081064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ac3d0-4431-4e49-9bed-53369aedfa3c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.094855 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 424/840] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.096121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.096400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.096669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.125067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:40.126622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:40.145956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.197432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72df7-55c5-4c29-869f-fceb79728c91 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.233504 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 425/841] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:40.234362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.266896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.268648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.269431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.270699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.273374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.274567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.278036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.293090 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 417/842] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.306268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.385701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a7c7-54a4-49a1-8f8b-4fdd7f6327e4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.406727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.436342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.437305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.437791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.438340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.439248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.439734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.441955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.455314 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 426/843] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.488337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e2db-4e82-4e41-aa81-c5279c4fdacf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.515375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.528853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.540091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.540929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.541404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.541859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.562343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.564610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:40.601129 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:40.602269 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:40.603212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:40.603212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:40.603212 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:40.603212 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 418/844] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:40.606444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.695909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389068-7828-4468-a474-6fe90b4c78a1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.750937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.751608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.751859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.752172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.762303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2658-ca82-4db6-9180-24a8fed87571 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.765675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:40.771277 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:40.773226 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:40.774926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 427/845] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:40.781006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.815508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.816193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.816396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.816718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.817687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.817995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.819521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.838624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.845263 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 419/846] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.849193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.907742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.935290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d4c-b5a5-4f63-85cd-4dc804785f5e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.989026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a919a8e-55b0-42c9-b718-6153b509ad86 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.989733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.990540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.991018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.991733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.993371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.993713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.995387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.012204 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 428/847] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:41.013742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.035997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.037267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.037779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.038652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.048707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.050814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:41.067457 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:41.068479 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:41.069919 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:41.077425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 420/848] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:41.078772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.171507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.177981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450181d-4f78-481e-9514-5d1a0d86f12f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.247294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.251849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.252431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c057b-12db-4437-b150-e6ceb5b4d7bd None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.252972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.254001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.254493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.276617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.278925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.295527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.296498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.297017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.297531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.298518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:41.299040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:41.299575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:41.300641 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:41.301575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:41.301575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:41.301575 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:41.303252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.306205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 429/849] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:41.308618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.327575 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 421/850] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.332976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.446173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573ade-aba9-4797-a091-0a7b50ca624b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.489972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77b82d-7238-4202-8e58-29663b91a575 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.495314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.496312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.497018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.497607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.499243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:41.499845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.502310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.524118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 430/851] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.529552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.535580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.536652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.537243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.537845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.548506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.579798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.642791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.645206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.693260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad935f6-076a-47df-bc42-f4d1b5816133 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.749541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.751055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.751839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.752594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.764250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.766557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:41.787911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:41.789375 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:35:41.790827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:41.794287 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 431/852] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:41.803697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.804645 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 422/853] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:41.814012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.905409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.947345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.968039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d63bcb-11d4-44ee-bfe3-57dbe694e5f8 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.988718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31e84-8ba1-46a1-b350-118665f5f364 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.011085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.011998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.011998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.012323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.025445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.026930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.036503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.037769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.038339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.038906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.040111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.040871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.042870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:42.045864 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:42.046956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:42.047982 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:42.047982 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:42.047982 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:42.052002 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 423/854] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:42.053123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.069108 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 432/855] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:42.078116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.216391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123e8e-26bd-459d-a352-771d760869e1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.221380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100b56-164e-4e00-a215-d0cd43504a39 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.231136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.264023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.269950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.271191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.271710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.272200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.273101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.273723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.274002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.274388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.274675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.274943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.276763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14359b2a-6676-43d7-bd6f-58a9d27b96d2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.298035 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 424/856] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:42.300800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bacea-03cc-4d34-88e0-401d9e528f95 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.301328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bacea-03cc-4d34-88e0-401d9e528f95 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.301811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bacea-03cc-4d34-88e0-401d9e528f95 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.308609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 425/857] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:42.308609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bacea-03cc-4d34-88e0-401d9e528f95 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.362129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.364141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178804-2bae-4731-8ab2-8ac822d95cde None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.448305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bacea-03cc-4d34-88e0-401d9e528f95 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.494716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 433/858] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:42.494716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.494716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.494716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.505718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.506434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.506715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.507004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.514470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:42.514999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.515954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:42.516488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:42.539528 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:42.540550 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:42.541510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 426/859] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:42.542817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.553379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.588811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.620545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 434/860] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:42.621913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.694385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536a8c-0880-4292-b2c1-ab490f01ec9d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.740485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.741212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.741490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.741762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.755447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.757034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.770365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c23f-a80f-413e-a52a-2db4d33849b2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:42.774812 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:42.776052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:42.777034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:42.777034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:42.777034 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:42.777034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 427/861] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:42.781894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.820932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.822882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.823791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.824511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.825903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.826423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.829141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.851874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 435/862] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:42.857761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.889784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.899147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.928730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6bd6-83d3-4d70-b75e-7484d04a37d6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.971574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.972552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.972825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.973133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.973810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.974114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.975524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.994038 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 428/863] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:42.994038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.006514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e07f-9989-4096-b1d1-13d7263916ea None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.062898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.064014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.064425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.064864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.066074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=557422469bd844e6ba2ea08c1db83be3) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:43.066392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.068694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.085004 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 436/864] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/role_assignments?user.id=557422469bd844e6ba2ea08c1db83be3&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:43.085004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.145288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0dac2-1dcb-408e-9514-b1ca60e4313b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.200133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.201128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.201247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.201671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.202594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.204192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a004f-2643-486b-a668-00be319e77b3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.225951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.238523 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 429/865] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:42 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:43.238523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06479-e74f-41c6-a48f-3d46629552ba None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.238523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06479-e74f-41c6-a48f-3d46629552ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.238523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06479-e74f-41c6-a48f-3d46629552ba None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.239031 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 430/866] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:43.241202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.241564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.241802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.248802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9eb61-0db7-40ea-a2b3-e4f60ef82003 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.249454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.280388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:43.281720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:43.309652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.310318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.310600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.310872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.321679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.323418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:43.338781 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:43.339972 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:43.341973 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 437/867] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:43.349415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.397193 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 431/868] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:43.467947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112d19-2eba-4ef6-8f11-b172f1211f27 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.505125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.505970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.506349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.506721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.507515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:43.507918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.509494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.520887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.525054 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 438/869] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:43.531289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.641791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae18cd-865c-4bda-a4ab-148a76d231e3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.671461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.674357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.686900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.687673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.688057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.688433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.689333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=35c19dc65ad64a8eaa5d0f64e7e14079) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:43.689751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.691435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.698470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 432/870] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/role_assignments?user.id=35c19dc65ad64a8eaa5d0f64e7e14079&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:43.794160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bcce-9f96-4422-a2b9-26593aca6646 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.834567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.835224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.835496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.835758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.836355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.837806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:43.847925 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:43.849257 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:43.850493 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 439/871] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:43.857865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.968299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8777-871e-48f6-b1a6-0c322606afaa None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.005127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.006136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.006617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.007084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.007972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:44.008475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.010078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def94e55-857f-44e2-8ecf-ded0e5bb0372 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.020009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 433/872] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.021697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.087628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.129758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739c6b4-cd68-4d35-91f8-7282eb7ae8d2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.173636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.174250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.174518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.174783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.175463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:44.175758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.177160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fed13-998d-4e99-90de-4c86d48f0e2a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.182327 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 440/873] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:45.467259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90332-a0fb-449a-9d56-af20cf19da85 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.468351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90332-a0fb-449a-9d56-af20cf19da85 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.468854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90332-a0fb-449a-9d56-af20cf19da85 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.470722 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 434/874] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:45.477163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea275-ed62-44cd-abbd-dee3ed6708ba None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.478143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea275-ed62-44cd-abbd-dee3ed6708ba None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.478623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea275-ed62-44cd-abbd-dee3ed6708ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.499351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-835ea275-ed62-44cd-abbd-dee3ed6708ba None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:45.500990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-835ea275-ed62-44cd-abbd-dee3ed6708ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:45.575361 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 441/875] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:45.620629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406402-5c23-4ff4-95b9-9f61131043b1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.620978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406402-5c23-4ff4-95b9-9f61131043b1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.621211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406402-5c23-4ff4-95b9-9f61131043b1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.622942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 435/876] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:45.628300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1375e-6da9-40f2-acec-357dcda3859b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.629106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1375e-6da9-40f2-acec-357dcda3859b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.629415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1375e-6da9-40f2-acec-357dcda3859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.647512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0da1375e-6da9-40f2-acec-357dcda3859b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:45.648691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0da1375e-6da9-40f2-acec-357dcda3859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:45.709397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.724564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 442/877] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:45.862755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406402-5c23-4ff4-95b9-9f61131043b1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.928542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.973795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406402-5c23-4ff4-95b9-9f61131043b1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.985720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a047f0-335f-470a-b197-8ba2c7f90377 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.986304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a047f0-335f-470a-b197-8ba2c7f90377 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.986777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a047f0-335f-470a-b197-8ba2c7f90377 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.989229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 443/878] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:45.994676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.995348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.995830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.009659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.010302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.010582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.010846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.017047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:46.018787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:46.022190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:46.027650 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:46.028813 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.029901 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 436/879] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:46.035697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.097178 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 444/880] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:46.098768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.162484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be4ee3-3600-492a-b509-c39a3cd92fe2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.190589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.212802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.214001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.214476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.214896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.216326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.218254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.218832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8edab-8a08-4ab8-901d-58df397e39fa None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:46.231074 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:46.232351 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:46.233445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.237054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 437/881] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:46.245067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.249317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.289232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.291032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.291570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.292259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.293688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.294492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.296343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.314845 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 445/882] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.317174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.390700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c645-73d0-4f9b-b550-d022c7c8adbe None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.427837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.428453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.428738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.429037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.429667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.429969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.431341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.434213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2e497-15ad-4a71-b6d0-31a3a706bdec None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.436483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 438/883] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.437162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.468135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.468767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.469077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.469351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.480419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.481926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.488833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a7348806-ba41-4b00-877b-ee443774d39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:46.497955 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:46.499179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:46.500572 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:46.500572 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:46.500572 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:46.500572 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 446/884] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:46.500572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fff8-21a0-4fc9-8228-7b78bb7c3654 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.501017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fff8-21a0-4fc9-8228-7b78bb7c3654 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.501017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fff8-21a0-4fc9-8228-7b78bb7c3654 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.502252 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 447/885] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:46.502992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138fff8-21a0-4fc9-8228-7b78bb7c3654 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.537291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.551078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fbea1-6045-40b4-9bb7-334cf08130a3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.589699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.590336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.590618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.590897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.591479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.592846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:46.602445 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:46.603494 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:46.604357 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 439/886] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:46.605226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.616169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138fff8-21a0-4fc9-8228-7b78bb7c3654 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.650320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.650921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.651202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.651474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.652095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.652401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.653804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ef244-24b8-4e76-8f84-5d84e39e8d04 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.658519 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 448/887] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.659663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.659968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.660260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.678190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:46.679385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:46.704359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9849-9560-4f69-ab24-de9628567387 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.717741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.740401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.740956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.741242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.741514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.742149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.742456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.743824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.746068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 449/888] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:46.746914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.755766 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 440/889] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.760842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.773758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.852145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c617e9-ac0f-4fce-94b5-68f4fdf41e4f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.874693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c32f-b3e1-4cb0-b1e9-da8ca58125f3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.888572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.889214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.889493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.889763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.890442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.890711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.892071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.897214 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 450/890] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.898097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.915921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.916976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.917422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.917843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.918689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] RBAC: Adding query filter params (interface=public, service_id=c86fa2371bf24cd4be254f8bcd6e9984, region_id=RegionOne) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.919144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.920795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.929749 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 441/891] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/endpoints?service_id=c86fa2371bf24cd4be254f8bcd6e9984&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.930780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.972033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.995378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.005461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450a64e-7a7c-4c2d-8465-8eed41bddbf6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.039306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.040009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.040212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.040477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.042528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4616-e4cf-4765-b5c7-833e4e20a2f0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.047645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.049121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:47.060802 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:47.062072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 451/892] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:47.063150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.079313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.080065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.080406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.080741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.081472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:47.081876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.083354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.088673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 442/893] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:47.089623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.206211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa246083-e1e2-4976-8b65-54c5bd81fb7d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.218183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.223631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30bee0-b15a-490d-b5a9-a6ee42251160 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.253088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.253670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.254107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.254373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.255061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.256632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.263832 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 452/894] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/services => generated 1011 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:35:47.264658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.287455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.293577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.294658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.295171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.297303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.298795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.301642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.329502 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 443/895] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:47 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:47.413038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef514-fbb5-4eaa-b335-11bc7df86936 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.464047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.464751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.465088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.465357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.466136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:47.466436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.468010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.491301 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 453/896] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:47.497024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.636867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e205-dfd7-405c-89f0-4abb548ffbc4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.674662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.675274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.675549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.676344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.706342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.756272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.757757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.861911 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 444/897] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:47.867594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.939012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.976180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7998c5-43ea-41f3-87e0-28903c681787 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.012340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.013011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.013430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.013709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.024682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.026183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:48.047651 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:48.048692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:48.049640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:48.049640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:48.049640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:48.056163 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 454/898] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:48.057919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.120850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.168374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ff25-0ad4-4942-8e6f-ecad8cfcee7f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.206295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.206900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.207728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.208073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.208783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.209357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.210833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.223810 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 445/899] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:48.229441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.344209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c578c-c326-4ca2-9b02-3c15562470da None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.367394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.382339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.382906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.383183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.383454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.390359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.391804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:48.403824 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:48.404724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:48.406156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 455/900] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:48.412733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.515536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8745-5200-455b-bfdb-84fc77664b7b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.538962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.556548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.557544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.558051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.558515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.559423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.559923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.561573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4d0b-5235-424b-b10f-17bbde387ad2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.578808 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 446/901] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:48.585273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.697132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085d876-cfc9-4d8c-9979-1a8ffdd3b550 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.732758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.733447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.733721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.733988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.734707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] RBAC: Adding query filter params (role.id=eeec153851bc4286b4efc1155abc14f4, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=557422469bd844e6ba2ea08c1db83be3) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.735009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.736508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3886f9-b5a2-4c85-beee-10f13d8d72e1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.742914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 456/902] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/role_assignments?user.id=557422469bd844e6ba2ea08c1db83be3&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=eeec153851bc4286b4efc1155abc14f4 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.502821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bce-3c1c-41a5-8ae4-1131b39e88d3 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.503235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bce-3c1c-41a5-8ae4-1131b39e88d3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.503416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bce-3c1c-41a5-8ae4-1131b39e88d3 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.505734 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 447/903] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:49.512073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156126-6a6d-4251-9306-1e2dc1747f3d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.512412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156126-6a6d-4251-9306-1e2dc1747f3d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.512623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b156126-6a6d-4251-9306-1e2dc1747f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.534086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6b156126-6a6d-4251-9306-1e2dc1747f3d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:49.536241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b156126-6a6d-4251-9306-1e2dc1747f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:49.585609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.617544 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 457/904] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:49.623276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01486-1115-4ecf-bbff-ae1d6e66f313 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.623788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01486-1115-4ecf-bbff-ae1d6e66f313 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.623899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01486-1115-4ecf-bbff-ae1d6e66f313 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.625459 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 448/905] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:49.635252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.635693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.636064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.655001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:49.656200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:49.675038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae423-d2d2-4ea1-869a-0055a7660051 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.675332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae423-d2d2-4ea1-869a-0055a7660051 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.675578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae423-d2d2-4ea1-869a-0055a7660051 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.677926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 449/906] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:49.683501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.683650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.683900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.701796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:49.702981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:49.738144 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 458/907] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:49.787041 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 450/908] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:49.906693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.009317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309453a-2dba-4d83-8e11-5bd81e4c9149 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.011718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.022151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.052534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.053121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.053402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.053672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.054790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.056693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.076691 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 459/909] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:49 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:50.077578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.147179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb879a-30f7-4396-8810-7573a384ccd1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.163427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.213407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d202-4d43-4277-90ae-3c1907c342df None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.214414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.215876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.216504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.217888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.218680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.223111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:50.242154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:50.243530 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:35:50.244491 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:50.249165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 451/910] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:50.256263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.275299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.276714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.277058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.277333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.277944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.279397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:50.290619 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:50.291683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:50.292580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 460/911] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:50.298064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.327400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.393645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d052f-cbf1-4bac-8862-e356f25547a0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.435930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e9823-4651-48e7-8990-44c4b436e802 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.439457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.440317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.440811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.441320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.442214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.442711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.445015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.453010 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 452/912] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:50.459266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.484646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.486231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.487010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.487479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.489138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.490068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.492182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.499095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.506957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 461/913] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.508323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.575609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29864e53-de5e-439c-a923-df85fee7eda2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.623546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.625332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.625756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.626193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.626972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.627413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.628764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.631295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.640170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 453/914] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.646634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84fc4-4ff4-4866-8811-791f5a7ba1f0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.646823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.691963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.692583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.692861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.693180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.693823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.694123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.695523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.703163 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 462/915] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.709637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.771215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.775895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870467-b6c1-4743-b601-bdee9cbb60d2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.819013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.820020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.820495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.821220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.822665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.824411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.827964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a6538-2afc-420a-bfb4-dde4f193ec2a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.850795 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 454/916] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:35:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:35:50.883205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.883982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.884334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.884672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.885800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] RBAC: Adding query filter params (interface=public, service_id=f9076fd6165147cb83d4c5365825bfc7, region_id=RegionOne) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.886201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.887720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee1b3a-05e0-49bf-aeed-9052c8519cc1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.894533 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 463/917] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/endpoints?service_id=f9076fd6165147cb83d4c5365825bfc7&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.900401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:51.029710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4eb02-ae5c-4f55-946f-fe75361e141f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:51.067166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:51.068087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:51.068362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:51.068626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:51.069306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:51.070675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ca7a1-1695-48cf-a670-6e50e5f634d6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:51.076961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 455/918] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:35:51.121517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f693b-e17a-436c-afbb-502e2afbe05d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:51.121712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f693b-e17a-436c-afbb-502e2afbe05d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:51.121969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f693b-e17a-436c-afbb-502e2afbe05d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:51.123338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 464/919] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:51.129040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:51.130168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:51.130651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:51.150863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:51.152534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:51.169130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:51.236131 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 456/920] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:51.516709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f693b-e17a-436c-afbb-502e2afbe05d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:51.532488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:51.642941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f693b-e17a-436c-afbb-502e2afbe05d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:51.683527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:51.684235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:51.684514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:51.684785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:51.697604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:51.702796 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:51.703833 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:51.704697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 465/921] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:35:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:51.710704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:51.828109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5185b2-dc4e-4f90-9db8-c29970e318d8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:51.865902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:51.866525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:51.866804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:51.867077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:51.867753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:51.868061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:51.869565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:51.879937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 457/922] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:35:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:51.886890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:51.994402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:52.033679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e57b2-0b3f-4f47-9c98-d9a19ef8775e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:52.076265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:52.077152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.077438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.077692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.089601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:52.091092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:52.109588 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:52.110642 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:52.111573 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:52.111573 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:52.111573 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:52.111759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 466/923] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:52.118419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:52.132936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:52.307306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36153-0c3e-40a1-8960-10a817aee600 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:52.345025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:52.345564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.345838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.346105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.346751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:52.347050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:52.348980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7cb4c-0fa1-4d8c-9c74-b5c43ba61bce None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:52.363999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 458/924] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:52.371026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:52.495911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717acf-81d5-4e7f-b4d7-a5bbbdefa230 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.496277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717acf-81d5-4e7f-b4d7-a5bbbdefa230 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.496500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717acf-81d5-4e7f-b4d7-a5bbbdefa230 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.499305 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 459/925] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:52.505555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.506153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.506649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.507055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0572b-5429-4500-8c75-a683297208b1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:52.532741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:52.534566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:52.539495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:52.554217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:52.555150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.555428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.555691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.565894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:52.567999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:52.587649 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:52.588807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:52.589975 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:52.592259 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 467/926] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:52.599886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:52.648674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:52.658486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 460/927] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:52.725119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3278f-d370-40b9-8db8-5aff139baad8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:52.762359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:52.762977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.763257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.763530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.764312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:52.764626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:52.766201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:52.786771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 468/928] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:52.792563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:52.919197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7166c8-6645-46a5-8f19-4d4cfcda6844 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:52.944848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:52.966155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:52.966916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:52.967196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:52.967468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:52.981516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:52.982987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.006634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:53.020222 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:53.021316 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:53.022237 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:53.022237 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:53.022237 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:53.022411 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 461/929] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:53.027794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.078260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d08b9a-057a-4fd8-b22c-cbbcf089114b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.099924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.118002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.118734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.118942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.119207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.119865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.121472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:53.131470 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:53.132541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:53.138881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 469/930] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:53.141618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.171028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2a65-7b2f-4b4b-80ba-8128e1d5708c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.219884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.220498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.220778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.221376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.222035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:53.222338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.224544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.247214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 462/931] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:53.249029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.311813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61c9c-d1ba-4263-ae80-fa2d8f1f974a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.324032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.365598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.367134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.367643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.368142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.369084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:53.370399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.372424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19516e-ee55-4d3a-9fb2-6e0820c43961 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.382462 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 470/932] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:53.383894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1bafe-9fdd-40cc-bb9f-743368c51f0d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.384179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1bafe-9fdd-40cc-bb9f-743368c51f0d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.384450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1bafe-9fdd-40cc-bb9f-743368c51f0d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.387522 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 471/933] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:53.388437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1bafe-9fdd-40cc-bb9f-743368c51f0d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.390984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b0d6-d74a-487f-8448-7f59d1dc2df6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.408804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.434828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.435407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.435691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.435962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.444371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.445861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-714e676f-ae71-4538-9a9f-41826511f0c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:53.459256 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:53.460493 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:53.461691 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 463/934] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:53.462351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.462560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.462911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.481930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:53.483144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:53.519849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1bafe-9fdd-40cc-bb9f-743368c51f0d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.557221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 464/935] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:53.558371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.565523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.566165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.566419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.566693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.567487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:53.568423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.569766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6669-3900-4c4d-a775-8c35a76809ba None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.575441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 472/936] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:53.576384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69574a-3ddb-49ef-a110-5ab493b7004b None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.576669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69574a-3ddb-49ef-a110-5ab493b7004b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.577148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69574a-3ddb-49ef-a110-5ab493b7004b None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.582499 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 473/937] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:53.582499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69574a-3ddb-49ef-a110-5ab493b7004b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.626412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.698316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224f83-5cd1-4b9b-bd97-e460ed73a5e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.700359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.714387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69574a-3ddb-49ef-a110-5ab493b7004b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.753049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.753499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.754350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.754350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.755065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:53.755065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.756518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4844ad-b6a8-4f3c-96bb-80bde9349418 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.764025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.764669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.765130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.766078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.766189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] RBAC: Adding query filter params (interface=public, service_id=ecbc28a25ebd4c69bb5787850a73e088, region_id=RegionOne) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:53.766568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.768105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.775586 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 465/938] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:53.775586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.775586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.775586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.782548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 474/939] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/endpoints?service_id=ecbc28a25ebd4c69bb5787850a73e088&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:53.783553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.798296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:53.799505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:53.882080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 466/940] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:53.882949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.900960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.904346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af187-6031-4de4-b5b0-f6510e14ecef None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.944670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.945403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.945645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.945917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/557422469bd844e6ba2ea08c1db83be3/roles/eeec153851bc4286b4efc1155abc14f4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.949712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=557422469bd844e6ba2ea08c1db83be3, role_id=eeec153851bc4286b4efc1155abc14f4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.951121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.969764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 475/941] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:53 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/557422469bd844e6ba2ea08c1db83be3/roles/eeec153851bc4286b4efc1155abc14f4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:53.970479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.023699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.034637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3356746-0461-41d4-b70a-ffd5874b94ec None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.079638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.080305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.080587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.080860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.081587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.083279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.090905 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 467/942] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:35:54.151511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b770eb4-49f2-40a5-967c-86cd42d7fd81 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.183367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.205261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.205825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.206108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.206379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.206989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.209021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:54.219724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:54.220887 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:54.222028 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 476/943] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:54.230919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.263875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.334358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92455d-8b53-443b-a0a1-7e739e4a03d6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.361855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4b89-35d4-45aa-9eab-4ee19e9c8e30 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.380721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.381921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.382205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.382478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.383440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.385046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.387825 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.server.flask.common [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 09:35:54.407115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.408311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.408878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.409507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.410344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.410850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.412476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.413223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.sql.core [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:35:54.413223 n-d-zed-1 devstack@keystone.service[88451]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:35:54.413223 n-d-zed-1 devstack@keystone.service[88451]: [parameters: {'id': 'e050e1a38f2648b89735ffe5982ce8d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:35:54.413223 n-d-zed-1 devstack@keystone.service[88451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:35:54.419047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 477/944] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:54.427521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e050e1a38f2648b89735ffe5982ce8d8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e050e1a38f2648b89735ffe5982ce8d8. Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:54.432988 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 09:35:54.434027 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application yield resource Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise self.value Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application session.commit() Oct 28 09:35:54.435252 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:35:54.436396 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:35:54.437584 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:54.438673 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [parameters: {'id': 'e050e1a38f2648b89735ffe5982ce8d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.439863 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:54.440914 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e050e1a38f2648b89735ffe5982ce8d8. Oct 28 09:35:54.442165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.443381 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 468/945] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/projects => generated 262 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:54.452462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.477146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.570252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.589995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4b466-c349-4aa0-b801-4f05f7df9622 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.605113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0b8df-228a-4eac-afb7-d346acc3cdc6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.636204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.637320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.637700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.638070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.639044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.639715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.641629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.656548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 478/946] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:54.658889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.673670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.674679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.675226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.675687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.687301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.690007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:54.708427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:54.710171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:54.711206 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:54.714511 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 469/947] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:54.720100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.803410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578bcd3-e3cd-4855-b8fd-e0d8f519c7d6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.804517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.841636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.842428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.842806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.843175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.843948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.845533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fa37-872b-4e29-8cd1-99fe8ec7ac8a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.854764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d832-c78f-4aca-b6e2-90acc3c58d02 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.873528 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 479/948] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:54.909596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.910518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.911531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.911950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.912808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.913289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.914924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d613-aacb-4e4d-b6ae-c8f2077f060c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.936443 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 470/949] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:56.324161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a20e0-f706-4d2f-a28d-0011a562fcc5 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.324725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a20e0-f706-4d2f-a28d-0011a562fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.324725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a20e0-f706-4d2f-a28d-0011a562fcc5 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.326357 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 480/950] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:56.332153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.333164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.333665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.360849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:56.362828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:56.392614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb525c-e1ef-412b-be6a-207efb9211ce None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.392873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb525c-e1ef-412b-be6a-207efb9211ce None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.393195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb525c-e1ef-412b-be6a-207efb9211ce None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.394798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 481/951] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:56.400267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.400545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.400819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.415622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:56.430849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:56.433491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:56.457409 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 471/952] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:56.530084 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 482/953] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:56.736802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:56.830043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:56.894808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ba3a8-4e16-41c0-b525-e96c5e060921 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:56.931763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:56.945197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:56.946234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.946720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.947192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.966788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:56.971752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:56.973275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:35:56.974750 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:56.977064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 472/954] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:35:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:56.980695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.101295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef184fab-e0c0-49e0-a711-2cd1b587424a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.115491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366815-0d79-462d-ad95-4e19660dfa2e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.136885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.160231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.161175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.161554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.161925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.162764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.163171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.164733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a5dd-349d-4af3-8466-f90275f33e1e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.166065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.167797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.169372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.170158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.171552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.175892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.180579 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 473/955] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:35:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.181522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.182426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7989f-a49a-4fb3-88a6-4051691795ac None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.182721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7989f-a49a-4fb3-88a6-4051691795ac None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.183097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7989f-a49a-4fb3-88a6-4051691795ac None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.185095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 474/956] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:57.186917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7989f-a49a-4fb3-88a6-4051691795ac None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-68f7b9ca-e713-4a62-b118-39623b36d507 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.194456 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.196138 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:57.197319 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 483/957] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:35:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:57.198270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.198270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.198270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.217044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:57.218226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:57.288304 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 484/958] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:57.289178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.309540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7989f-a49a-4fb3-88a6-4051691795ac None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.346340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.347074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.347367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.347639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.358733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.360165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6c2b791b-f264-4f2e-8c52-e390eefe2641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:57.375380 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.376431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:57.377654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:57.377654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:57.377654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:57.377654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 475/959] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:57.378331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c0fd-d44f-4213-aabc-9efcecc986d6 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.378331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c0fd-d44f-4213-aabc-9efcecc986d6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.378579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c0fd-d44f-4213-aabc-9efcecc986d6 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.380084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 476/960] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:57.384751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c0fd-d44f-4213-aabc-9efcecc986d6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.404254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d99d-3bad-48e7-85bf-7295321512c2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.417774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.443729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.450472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.451154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.451585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.451861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.452484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.452783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.454304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587edb5-3ed2-4456-8710-69cc7e4475a1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.460098 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 485/961] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.461382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.461660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.461918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.484498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:57.485733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:57.512153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c0fd-d44f-4213-aabc-9efcecc986d6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.563812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.564436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.564715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.565021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.565668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.565969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.567389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.572024 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 486/962] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:57.573460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.579483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 477/963] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.583260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.693871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.703908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c8f8a-fd94-40c1-84ba-07f903faab07 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.712044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb9fb-8ae1-4141-8636-7d87ba6b6fa8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.745268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.745703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.746352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.746618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.747347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.747956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.749828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.760042 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.765703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:35:57.766604 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:57.767375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.767476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 478/964] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:57.767549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.767549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.767727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.767803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.767803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.767803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.767803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.775118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 487/965] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.776515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.890154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346684a-57aa-4fbd-9cf1-2e0b33d6f5a0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.894410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020d6db-670b-44a1-9df9-78002198c01f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.933991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.934625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.934899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.935169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.935640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.936246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.936524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.936789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.937453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] RBAC: Adding query filter params (name=compute) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.937751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.939116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.943346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.944611 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 488/966] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.944847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.945349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:57.962446 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.963725 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 479/967] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:57.965136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.983665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.008898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.059329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ff97-04a0-4c54-972b-51ef3c82318c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.073840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde371e2-e405-41b1-ad87-aa3135d0de8b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.095995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.096612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.096885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.097181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.097845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.099260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.112520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.113224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.113519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.113787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.114962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.116449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.122408 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 489/968] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:35:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:58.123321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.138751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.sql.core [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:35:58.138751 n-d-zed-1 devstack@keystone.service[88451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:35:58.138751 n-d-zed-1 devstack@keystone.service[88451]: [parameters: {'user_id': '8ec50a9b54fa4fc695ad67ce3bc8d0e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:35:58.138751 n-d-zed-1 devstack@keystone.service[88451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:58.148583 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:58.149638 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application yield resource Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise self.value Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application session.commit() Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:35:58.150663 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:35:58.151890 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:58.154531 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:58.156784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [parameters: {'user_id': '8ec50a9b54fa4fc695ad67ce3bc8d0e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:58.158246 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 28 09:35:58.159752 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 480/969] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Oct 28 09:35:57 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:58.160887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.266034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.276832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d865b6-47a9-4394-b6a3-a00d0346e69f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.279654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.305606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ca918-0040-4e37-acb9-396cfea32564 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.335795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.336431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.336715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.337060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.337930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] RBAC: Adding query filter params (type=compute) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.338126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.339433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.348328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 490/970] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:58.350148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.363928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.364708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.365010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.365284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.366035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.366336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.368079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.392964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 481/971] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:58.399217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.498588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e64d-5926-4da5-9910-d84aaff271de None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.537185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0296fd-8c41-44fd-a571-c6361a3bfa23 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.540189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.540955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.541245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.541514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.550223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.552683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:58.568639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:58.569734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:58.570738 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 491/972] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:58.575817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.600592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.601272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.601928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.602210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.607387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.630315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.690313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.692266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.723044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d490d-873b-4e94-8bbb-bfcadf56b10e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.768844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.769826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.770253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.771194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.772098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.772551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.774231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.813644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 492/973] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:58.815143 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 482/974] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:58.825078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.925331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.943405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bf2ad-24d8-40f3-82fc-7abc2df59156 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.983977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.985096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.985581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.986055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.998926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.000758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:59.017411 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.018446 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:59.019361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:59.019361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.019361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:59.021606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 493/975] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.027099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.070166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.154625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398c5f7-e246-4a8e-ba40-366f343f3656 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.197185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.198202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.198697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.199172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.200012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.200539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.202157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.215939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 483/976] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:59.223199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.344441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cad88-8c66-46a7-b609-bfea7243341b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.382151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.382776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.383049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.383314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.390342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.391783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.393875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:35:59.404827 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.406353 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:35:59.407783 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:35:59.409058 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 494/977] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.412222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.555529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.567517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dbe-45ac-4b96-8e76-9e519eab9e30 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.621566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.622171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.622448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.622713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.623410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.623800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.625461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be587345-b417-4b79-b9f4-6553486bb9f5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.639212 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 484/978] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:59.645173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.767860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337016-4d7b-4bcc-b300-290ade1c04bb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.806609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.807232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.807579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.807855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.808593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] RBAC: Adding query filter params (role.id=eeec153851bc4286b4efc1155abc14f4, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=557422469bd844e6ba2ea08c1db83be3) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.808916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.810408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e0da-fa3e-4343-8b5d-93a4be909165 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.821510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 495/979] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/role_assignments?user.id=557422469bd844e6ba2ea08c1db83be3&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=eeec153851bc4286b4efc1155abc14f4 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.473342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d0e-5c05-41c3-913c-7f746624df37 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.473948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d0e-5c05-41c3-913c-7f746624df37 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.474325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08d0e-5c05-41c3-913c-7f746624df37 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.476761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 485/980] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:00.482713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7565-858d-4771-ab7d-139c3664a0fb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.482987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7565-858d-4771-ab7d-139c3664a0fb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.483283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7565-858d-4771-ab7d-139c3664a0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.502868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-912a7565-858d-4771-ab7d-139c3664a0fb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:00.504066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-912a7565-858d-4771-ab7d-139c3664a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:00.563545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.575774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 496/981] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:00.746692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02b210-d1a8-4e6e-93e1-a314b561e1c1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.746884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02b210-d1a8-4e6e-93e1-a314b561e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.747138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02b210-d1a8-4e6e-93e1-a314b561e1c1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.748624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 486/982] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:00.753598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.754031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.754189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.773658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:00.774821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:00.846098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02b210-d1a8-4e6e-93e1-a314b561e1c1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.872952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 497/983] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:00.969900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02b210-d1a8-4e6e-93e1-a314b561e1c1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.006373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.006903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.007185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.007460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.008040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.009522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:01.019112 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:01.021465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:01.022810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:01.024074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 487/984] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:01.026847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.145059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.150581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4be9-4a55-491d-ada4-c9ba7aaef13a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.175346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.182485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.202025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.202718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.202923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.203192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.203828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.204127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.205557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.214623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 498/985] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:01.220303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.281285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddf49-ed6b-48c5-ac73-dc771e6a235a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.320334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.321112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.321385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.321659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.322381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.323755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.341359 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 488/986] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:01 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:01.365682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851f9b-6879-4409-ab34-69d5593c6fd9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.421906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.422974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.423261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.423555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.424473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.424977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.426737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.438413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 499/987] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:01.440879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.545434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.576630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d85e8-1ab7-45e1-9422-8bc2b03d7258 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.621808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.622725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.623153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.623584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.624451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] RBAC: Adding query filter params (interface=admin, service_id=ecbc28a25ebd4c69bb5787850a73e088, region_id=RegionOne) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.624934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.626473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b740e-3817-48e3-9369-81cf935950fd None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.638189 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 489/988] 10.222.0.16 () {56 vars in 1249 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/endpoints?service_id=ecbc28a25ebd4c69bb5787850a73e088&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:01.639939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.695493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.756182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89b90-e7bb-4453-9323-11e9eaf37250 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.801063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.801591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.801861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.802650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.803252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.804653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249bb42-d1fb-432c-a3a6-551f170ec866 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.817011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 500/989] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:36:02.110017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800994-d8a0-4ba4-b3de-b4d5534c4878 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.110214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800994-d8a0-4ba4-b3de-b4d5534c4878 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.110494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800994-d8a0-4ba4-b3de-b4d5534c4878 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.111988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 490/990] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:02.117745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.118028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.118299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.142304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:02.143119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:02.219914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 501/991] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:02.487371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a800994-d8a0-4ba4-b3de-b4d5534c4878 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.615790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a800994-d8a0-4ba4-b3de-b4d5534c4878 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.655657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.656290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.656566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.656831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.657432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.658790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:02.668285 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:02.669397 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:02.670410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 491/992] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:02.677457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.722113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.783152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf60e4-7238-4e67-b0e2-5247f5b98efc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.816857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.817484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.818287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.818555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.819172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] RBAC: Adding query filter params (name=image) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.819465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.820831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da946f-9ea7-4578-a59c-c5f66a3b6f7e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.825716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 502/993] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:02.831149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.843041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.930511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a28a-e99a-417b-be82-851ca12b24c6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.963487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.964091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.964366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.964631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.965279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] RBAC: Adding query filter params (type=image) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.965578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.966925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceffea2-dacd-4bc8-a910-6b89e7cf1d89 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.971570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 492/994] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:03.576477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88acd4-29f2-4c7d-b298-1d77d62a5829 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.576764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88acd4-29f2-4c7d-b298-1d77d62a5829 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.577316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88acd4-29f2-4c7d-b298-1d77d62a5829 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.578782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 503/995] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:03.586881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87908a49-8ab0-4db9-8a3a-44f21afaf0bf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.587357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87908a49-8ab0-4db9-8a3a-44f21afaf0bf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.587823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87908a49-8ab0-4db9-8a3a-44f21afaf0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.613781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-87908a49-8ab0-4db9-8a3a-44f21afaf0bf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:03.615970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87908a49-8ab0-4db9-8a3a-44f21afaf0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:03.688939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 493/996] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:03.962796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88acd4-29f2-4c7d-b298-1d77d62a5829 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.003265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c93b-96af-4eab-b4b7-7afa90c45af1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.003625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c93b-96af-4eab-b4b7-7afa90c45af1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.003810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c93b-96af-4eab-b4b7-7afa90c45af1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.005191 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 494/997] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:04.010220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.010505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.010781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.017168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.030291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:04.031485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:04.081629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88acd4-29f2-4c7d-b298-1d77d62a5829 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.085494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.104954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 495/998] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:04.123228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.123937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.124286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.124626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.125306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.126755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.135830 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.136837 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:04.142657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 504/999] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:04.144817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.248548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbef16-3b21-4f59-b723-e164e0a5ca2e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.278902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.285206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.285817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.286096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.286367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.287515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.287813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.289195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.298759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 496/1000] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:04.300027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.375054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.411103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490904-9490-4b58-a087-a7c9aef4aae2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.449044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.449648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.449934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.450209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.450841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.451138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.452510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.458420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 505/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:04.464381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.490567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c612ed-5a8f-4286-a8ed-79f70d0a5b23 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.498103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.528632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.529224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.529496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.529764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.530745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.532155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.543320 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.544418 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:04.545322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 497/1002] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:04.550283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.579490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28519d16-461b-4ec2-a5d8-7200f2c95a69 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.619564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.635146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.635766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.636050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.636317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.637044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] RBAC: Adding query filter params (interface=public, service_id=eb09920c46c24b6e910cd3d8752d0dce, region_id=RegionOne) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.637350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.638722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.644162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 506/1003] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/endpoints?service_id=eb09920c46c24b6e910cd3d8752d0dce&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:04.650391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.678874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84501611-114c-453b-a06c-a5f686a87e5a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.722831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.724357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.724635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.724913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.725565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.725869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.727228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.738765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 498/1004] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:04.740326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.755064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.762536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197850-e1b2-4d8d-8e73-930709d41af0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.798256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.798779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.799055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.799324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.800042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.801450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.809320 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 507/1005] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:36:04.855962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648edf51-0680-4949-b045-d583b3fd4ca4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.884790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.898163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.898792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.899071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.899341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.899979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.900279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.901827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679dc3f-20d6-42a2-af2b-86009c0e2328 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.912302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 499/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:04.914164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.027444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f207d-8f84-49eb-aeaf-9e78990b9466 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.066470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.066995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.067269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.067537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.068337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.069745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eb75a-b0a1-42bb-b37b-796aaa68163f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.092942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 508/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:05.154831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc851f2-ae4f-4744-aa1e-f2c78602e25e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.155136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc851f2-ae4f-4744-aa1e-f2c78602e25e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.155404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc851f2-ae4f-4744-aa1e-f2c78602e25e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.157008 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 500/1008] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:05.163503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f44b-5a51-4baa-b93d-ed25cc010f8d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.164025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f44b-5a51-4baa-b93d-ed25cc010f8d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.164025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f44b-5a51-4baa-b93d-ed25cc010f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.184731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8130f44b-5a51-4baa-b93d-ed25cc010f8d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:05.185994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8130f44b-5a51-4baa-b93d-ed25cc010f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:05.202405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.270965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 509/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:05.539738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc851f2-ae4f-4744-aa1e-f2c78602e25e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.660596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc851f2-ae4f-4744-aa1e-f2c78602e25e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.697766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.698391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.698668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.698921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.699587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.701037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bdd95-4636-430e-94fe-d3eb600b5f0d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.724986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 501/1010] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:05 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:07.002942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ac5a-05dc-4638-998b-d9b0c351f3c7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.003468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ac5a-05dc-4638-998b-d9b0c351f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.003468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ac5a-05dc-4638-998b-d9b0c351f3c7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.004986 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 510/1011] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:07.010745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a0b9-58d2-4f3b-a081-7e1c3333d4f0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.011189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a0b9-58d2-4f3b-a081-7e1c3333d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.011274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a0b9-58d2-4f3b-a081-7e1c3333d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.029899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2fc4a0b9-58d2-4f3b-a081-7e1c3333d4f0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:07.031118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fc4a0b9-58d2-4f3b-a081-7e1c3333d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:07.090503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.124210 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 502/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:07 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:07.298621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780ec-f44b-40c2-afd3-2da052226d1d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.298808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780ec-f44b-40c2-afd3-2da052226d1d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.299084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780ec-f44b-40c2-afd3-2da052226d1d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.300674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 511/1013] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:07.305997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.306290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.306568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.326209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:07.327398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:07.389054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00780ec-f44b-40c2-afd3-2da052226d1d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.410292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 503/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:07 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:07.558697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00780ec-f44b-40c2-afd3-2da052226d1d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.609740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.610380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.610655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.610935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.611501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.612867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.622426 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.623530 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:07.624526 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:07.628563 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 512/1015] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:07.629471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.734037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883de327-b824-4fce-b52d-2748ad323c21 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.736355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.759184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.770507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.771124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.771932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.772195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.772835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.773166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.774559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.774821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.785149 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 504/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:07.786602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.902890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5c66-b40c-4e5e-8d34-acfcd9105c51 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.919647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04cd60-5740-44ae-8325-76d984681b89 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.946616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.947250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.947524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.947792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.949303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.951744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a10d5-b617-461d-a7a3-ceeaba217a6d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.953970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 513/1017] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:07.954715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ce40-fa62-4ff3-8d67-9d3eccb25fd7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.954997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ce40-fa62-4ff3-8d67-9d3eccb25fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.955268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ce40-fa62-4ff3-8d67-9d3eccb25fd7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.956503 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 514/1018] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:07.959768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ce40-fa62-4ff3-8d67-9d3eccb25fd7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.972868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.973518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.973793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.974058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.974751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.975052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.976414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5c50e-48ba-41f0-8e43-b297d18fab37 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.981572 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 505/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:07.982873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.983151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.983418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.002189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:08.003419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:08.029547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.050026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.072922 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 506/1020] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:07 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:08.077187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ce40-fa62-4ff3-8d67-9d3eccb25fd7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.077289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.116518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.117767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.118044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.118310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.119388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.121303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.160362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 515/1021] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:07 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:08.189786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0c48-6e1e-41c5-9224-b5e1153473f3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.245895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.247365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.248065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.248823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.250337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.252872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.285639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 507/1022] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:08.344044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.466341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3003-fc6a-4ec4-b340-0d052216f6c2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.497235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.513212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.514281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.514781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.515271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] PATH_INFO: `/v3/services/image` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.516310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.519010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:08.530231 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:08.531462 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:08.532940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 516/1023] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:08.538878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.563278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.662802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08ee7a-efcb-40b5-84ba-ad7379d83daa None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.698618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.699232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.699511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.699783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.700417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.700749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.702153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.712789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 508/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.714421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.819329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933300-fe89-4f8b-9e24-6527c7a85c8f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.854357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.854972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.855246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.855511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.856133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] RBAC: Adding query filter params (type=image) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.856432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.857834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.863510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 517/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.869841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.960491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.980658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5bba-9dd1-4739-b845-4142913f0ff2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.015545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.016150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.016570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.016684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.017393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] RBAC: Adding query filter params (interface=public, service_id=df3996af6ff248d98fa475bbf68aec6b, region_id=RegionOne) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:09.017697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.019044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed160-c265-47d5-bdbe-03297fa90f91 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.024373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 509/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/endpoints?service_id=df3996af6ff248d98fa475bbf68aec6b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:09.030063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.089488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.137519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e13c0-f810-4b76-ad2b-39691983c939 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.174395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.175009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.175289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.175559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.176189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.178110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29271be7-6f07-4e32-8bfe-ffbeb366da19 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.192965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 518/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:36:10.427518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752153-e9d5-46f4-b062-6d039ecc1d56 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.428174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752153-e9d5-46f4-b062-6d039ecc1d56 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.428174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752153-e9d5-46f4-b062-6d039ecc1d56 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.429821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 510/1028] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:10.435224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1404-f3df-4b5a-9783-9076a2815f21 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.435740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1404-f3df-4b5a-9783-9076a2815f21 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.435740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1404-f3df-4b5a-9783-9076a2815f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.454548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-85ae1404-f3df-4b5a-9783-9076a2815f21 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:10.455741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-85ae1404-f3df-4b5a-9783-9076a2815f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:10.535051 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 519/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:10.624792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16d9f-b264-4c7d-923a-a033ec1403c9 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.625308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16d9f-b264-4c7d-923a-a033ec1403c9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.625783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16d9f-b264-4c7d-923a-a033ec1403c9 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.627654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 511/1030] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:10.633862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.634107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.634386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.652666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:10.653892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:10.698857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.725092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 520/1031] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:10.798741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16d9f-b264-4c7d-923a-a033ec1403c9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.911322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16d9f-b264-4c7d-923a-a033ec1403c9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.946784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.947413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.947688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.947954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.949217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.950635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.952514 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 512/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:10.958130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.998536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.015267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.063061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52fcaa-1180-47c3-9ade-8f3d2d74eedf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.100738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.101770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.102308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.102821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.103576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.105289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.107759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eceb0-cf6c-4af5-a2bb-9df1713168d5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.128946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 521/1033] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:10 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:11.149940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.150934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.151419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.151870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.165814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:11.171218 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.172455 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:11.173384 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:11.174067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 513/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:11.180150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.220719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.302072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726651fc-7dda-4117-8822-a20f4b4648d3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.340551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.341210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.341486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.341758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.342424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:11.342722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.344101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d20be-15e5-474d-9ddf-eef883a4ef60 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.353425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 522/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:11.359185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.380872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c35-c497-462f-8e59-86f094756628 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.381715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c35-c497-462f-8e59-86f094756628 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.381979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c35-c497-462f-8e59-86f094756628 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.383565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 523/1036] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:11.388603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.388886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.389240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.408318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:11.409544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:11.450392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.480631 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 524/1037] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:11.481359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195c69-f8e6-4a81-8245-ea51eeb40298 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.518537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.519167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.519440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.519698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.531189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.532715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:11.546962 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.548063 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:11.549580 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:11.549580 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:11.549580 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:11.549580 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 514/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:11.554313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.587871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.669707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff745e87-318a-459a-a0bc-256dbb0408c7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.706451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.707063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.707342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.707609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.708257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:11.708553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.710492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.723164 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 525/1039] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:11.728671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.750695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.850611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.856527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d158-5708-42eb-abc8-2a63302eb2ec None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.868270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c622c-99ec-4fa3-af46-737d72de2612 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.884745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.895213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.895954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.896179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.896411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.905938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.906181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.906582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.906862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.907130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] PATH_INFO: `/v3/services/image` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.907405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.907720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.909173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.919570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.920880 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:11.921820 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:11.922585 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.923462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:11.924424 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:11.926151 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 526/1040] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:11.931052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 515/1041] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:11.931293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.933166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.047702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6802e81-ab28-4dbf-a45b-09f0c8cb7803 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.059231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6573-a102-4e17-bfe1-dc1e123c12e0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.088401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.089283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.089441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.089665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.090233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] RBAC: Adding query filter params (name=image) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.090533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.091970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.098246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 527/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:12.098707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.099407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.099691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.100489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.101281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.101589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.103026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.104337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.121666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.127835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 516/1043] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.129028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.182163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.225506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5030-b3f1-4d04-b023-c0d02b1f63ad None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.253773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7e30b-016b-469e-befa-bea934c83ab1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.269702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.270727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.271539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.272514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.273589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.274092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.276438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.288747 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 528/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:12.290724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.311197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.312071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.312521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.313003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.409319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.423758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.425230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.446901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c59-a142-4cca-92a6-c8a690f84ac0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.472070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.503882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.505294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.505761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.506231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.507407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.510173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.544958 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 529/1045] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:12.562034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 517/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:12.568056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.726877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e7de-339a-476e-8cb2-4103055d7491 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.757122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.764125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.765304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.765593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.766036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.779103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.780578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:12.795807 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.797140 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:12.798075 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:12.798075 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.798075 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:12.798075 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 530/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:12.804757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.924498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2079-c5e4-4288-a856-39d216f21526 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.962732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.963352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.963630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.963901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.964554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.964995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.966324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.983466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 518/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.985023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.092306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79621524-583b-433b-9502-ce214c028ef6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.126970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.127589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.127860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.128126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.135377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.136840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:13.150020 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:13.156128 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:13.157139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 531/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:13.157665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.161480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.266669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86569a5-387f-4375-9e53-9ea09233e0e6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.302695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.303424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.303773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.304077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.305020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.305333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.306829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051aca-4704-445d-a847-8ff319eff934 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.327180 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 519/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:13.328558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.374121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.425274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2374cd-76c0-49ec-bc20-93e9c9c89c07 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.425657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2374cd-76c0-49ec-bc20-93e9c9c89c07 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.425829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2374cd-76c0-49ec-bc20-93e9c9c89c07 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.427654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 520/1051] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:13.434082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.434496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.434667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.440792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffabb4-41f9-4eab-b720-14a7feca0551 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.455314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:13.456863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:13.488121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.489235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.489766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.490215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.491400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] RBAC: Adding query filter params (role.id=eeec153851bc4286b4efc1155abc14f4, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.491715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.493435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.508952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 532/1052] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=eeec153851bc4286b4efc1155abc14f4 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:13.542873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.552713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 521/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:13.825039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.939005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6471e-5682-4321-aa0e-495e4922d4e3 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.946961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.984601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.985272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.985551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.987470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.999298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:14.004176 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:14.005454 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:14.007083 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 533/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:14.012035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.124022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75a17-7726-4e66-9edc-8384ba9b9ad3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.160474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.161108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.161388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.161656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.162320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:14.162654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.164020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.173339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 522/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.179222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.305430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639670a2-8265-4532-b7ab-72e4a6ea8e34 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.350591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.351231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.351507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.351775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] PATH_INFO: `/v3/users/4f1a01bbd97240998a394f836cc1ffa9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.370182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a01bbd97240998a394f836cc1ffa9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.373995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.376275 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 534/1056] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/users/4f1a01bbd97240998a394f836cc1ffa9 => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.382429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.450538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.505435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d22f-77c5-4039-bd14-f7874e19bef4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.545692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.545692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.545692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.545692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.626422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.627782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522cdb6-4a6c-4034-be41-9f1d58f7a8b2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.699744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.753417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 523/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:14.754640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.781142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.802460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5e3-921c-4518-a2fb-2c1685f7c9bf None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.802744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5e3-921c-4518-a2fb-2c1685f7c9bf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.803020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5a5e3-921c-4518-a2fb-2c1685f7c9bf None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.804374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 524/1058] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:14.809436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.809717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.810017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.830271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:14.831473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:14.868096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d905-037e-4ff1-8f0c-7449b4982bfe None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.902249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 525/1059] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:14.905482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.906109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.906381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.906641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.919464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.919464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.919464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 535/1060] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:14.920573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.017872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.034963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9b37-8e05-47ca-92b9-724b07914004 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.078181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.078779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.079043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.079309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.080025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=fede6766c8d74dbbb9aba6bb9e628168, user.id=4f1a01bbd97240998a394f836cc1ffa9) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.080323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.081766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.089006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 526/1061] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/role_assignments?user.id=4f1a01bbd97240998a394f836cc1ffa9&scope.project.id=fede6766c8d74dbbb9aba6bb9e628168&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:15.176184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.282169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.292542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebed5-47a8-42fd-a229-c22e2f71bb6e None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.330174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.330789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.331059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.331323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.402815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.404263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea00a-26a6-4aef-b15d-589ad2a51433 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.531019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.548958 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 536/1062] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:15.554093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.684390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a582-939f-42cf-a1ad-55dabb9fd786 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.719692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.720329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.720599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.720861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.726464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff297a-8a35-4ae8-8564-c71d011c5cfe None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.726745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff297a-8a35-4ae8-8564-c71d011c5cfe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.727016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff297a-8a35-4ae8-8564-c71d011c5cfe None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.728565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 537/1063] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:15.733592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.733876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.733983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.734155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.736328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:15.753837 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:15.754885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:15.755816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:15.755816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.755816 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:15.755989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:15.755989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:15.760004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 527/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:15.760802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.763685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.831276 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 538/1065] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:15.874312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc554da4-6179-46e2-adba-bccbea992cde None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.910444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.911054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.911332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.911600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.912237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.912537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.913985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.932941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 528/1066] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.108736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.229055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456a031-3655-40fc-b83d-2408c5fc7de5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.254720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.269013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.269656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.271650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.271650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.281179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:16.286066 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.287182 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:16.288570 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 539/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.295661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.358986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.399094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30044f-390e-460d-a8ee-f56befbd096c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.433981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.434726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.435000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.435260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.435917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.436212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.437605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.446422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 529/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.452081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.552344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fa209-0c01-4be5-ab58-467d3fd9a0c0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.589749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.590379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.590651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.590915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.605035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.607117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:16.627136 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.628143 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:16.629109 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:16.629109 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:16.629109 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:16.629109 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 540/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.634098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.737059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd3edb-4031-4ce5-b973-502e6ebaa0d2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.759880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.770843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.771453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.771730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.772000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.773199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.773498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.774861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.786705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 530/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.792824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.830905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.898680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a44b-b3bf-4f4b-bec6-ff97b7127941 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.932208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.932829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.933130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.933395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.940686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.942145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:16.953576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.954626 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:16.955595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 541/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.960996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.059031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74718-8491-4b34-a626-3afbd20f00c7 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.093488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.094097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.094377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.094649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.095368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.095669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.097106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.115945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 531/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:17.122343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.214958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.222052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23961-371e-445c-b2a3-ce9ab0964c50 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.255906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.256568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.256842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.257141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.267677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.269300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b5d32cd9-ef81-4553-8dc0-d1514a222805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:17.285161 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.286287 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:17.287268 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:17.287268 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.287268 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:17.287268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 542/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:17.293685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.337283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.393181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef75d9-cc9a-49c1-b889-48f01cbe32b2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.398498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c595-6bad-474e-aced-13e5df4c6578 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.398773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c595-6bad-474e-aced-13e5df4c6578 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.399042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c595-6bad-474e-aced-13e5df4c6578 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.400369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 543/1074] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:17.405545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.405834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.406112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.424426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:17.425657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:17.428451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.429101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.429387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.429657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.430290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.430592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.431947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.443202 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 532/1075] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:17.449428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.499176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 544/1076] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:17.555361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184153d2-8857-4e83-9889-2783785ccfc4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.556871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.589576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.590207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.590484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.590754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.597433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.598864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:17.611992 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.613165 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:17.614105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 533/1077] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:17.619425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.694618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.718289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e23a5-b997-4ffc-81bd-56332f12424e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.752242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.753218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.753218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.753498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.754013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.754314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.755748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.767557 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 545/1078] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:17.769715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.773433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.871494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d07a2-b6a7-406c-9e58-3d93d06d03d3 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.873469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1eb5-ac4d-40d6-88b3-c765f12cc3da None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.905132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.905762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.906039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.906167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.906309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.906726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.907005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.907275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/eeec153851bc4286b4efc1155abc14f4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.909467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=5e0030a2c94142b0af1fe8bf0ac671f8, role_id=eeec153851bc4286b4efc1155abc14f4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.910907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.914947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.917405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:17.923853 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.924862 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:17.925800 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 534/1079] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:17.927011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 546/1080] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:17 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/5e0030a2c94142b0af1fe8bf0ac671f8/roles/eeec153851bc4286b4efc1155abc14f4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:36:17.931703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.959130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.045873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a761d3-fde2-4bd0-ac37-fcc11295a0ef None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.081940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.082560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.082838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.083107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.083777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:18.084080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.085545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.095369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 535/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:18.101982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.204295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207771-4fe1-4024-b352-0f93ce9cf30a None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.237845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.238478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.238755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.239027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] PATH_INFO: `/v3/users/4f1a01bbd97240998a394f836cc1ffa9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.240157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a01bbd97240998a394f836cc1ffa9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.242164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.243749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 547/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/users/4f1a01bbd97240998a394f836cc1ffa9 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:18.251712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.341620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.357935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7966-8d85-46b3-aa3d-d53cbb5937be None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.392175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.392804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.393110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.393382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.394495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.395928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c8c3f-f8a3-4912-bd86-66af769736e3 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.398313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 536/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:18.404116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.465898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.504790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5f92-7226-4927-a8bf-9d3362945c17 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.538830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.539477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.539747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.540011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168/users/4f1a01bbd97240998a394f836cc1ffa9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.541895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] RBAC: Authorizing `identity:create_grant(project_id=fede6766c8d74dbbb9aba6bb9e628168, user_id=4f1a01bbd97240998a394f836cc1ffa9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.543310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a8439-bdaf-4e0c-815b-7bf27b83ab48 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.557553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 548/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:18 2022] PUT /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168/users/4f1a01bbd97240998a394f836cc1ffa9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:20.086201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54505-467e-4562-ac6b-ead11c62f9b0 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.086737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54505-467e-4562-ac6b-ead11c62f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.086737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54505-467e-4562-ac6b-ead11c62f9b0 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.088624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 537/1085] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:20.093858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.094266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.094411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.113017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:20.114199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:20.181372 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 549/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:20.455041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d54505-467e-4562-ac6b-ead11c62f9b0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.562048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d54505-467e-4562-ac6b-ead11c62f9b0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.602468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.603124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.603401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.603671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.617402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b841d091-79c0-4b1c-9417-73def8672b37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:20.623588 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:20.624556 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:20.625484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 538/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:20.633802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.693140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.703688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4b40-861b-4008-97a5-d97910fb8f84 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.704060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4b40-861b-4008-97a5-d97910fb8f84 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.704579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4b40-861b-4008-97a5-d97910fb8f84 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.706174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 539/1088] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:20.711962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.712241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.712514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.730997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:20.732179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:20.740442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.742355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440a76-d27f-48a5-9bb0-94f9a8c8730f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.777570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.778533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.778749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.779033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.779669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:20.779960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.781358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.789855 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 550/1089] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:20.795685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.804497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 540/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:20.895169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35135-4c2d-41ea-87f9-525ed0a2c0c8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.911297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.930765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.931388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.931659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.931923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.942255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.943822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:20.958110 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:20.959214 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:20.960246 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:20.960246 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:20.960246 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:20.960246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 551/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:20.966226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.077867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee50d10-a7fe-4980-a714-bb61c2faf0c3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.080419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.113448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.114053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.114315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.114577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.115212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:21.115519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.117473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.131514 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 541/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:21.137941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.140883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.224132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84d51-c76b-4af5-a02c-8887ddd3c262 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.258374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.259032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.259287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.259554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.263668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947c9e-570e-4013-868e-2d63ebccc2a2 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.271181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:21.277211 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:21.278239 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:21.279108 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 552/1093] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:21.284380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.307454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.308080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.308354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.308618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] PATH_INFO: `/v3/users/nova` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.314550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.317025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.318513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:21.330544 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:21.331703 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:21.333154 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 542/1094] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:21.338303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.398293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b62c-5ab5-45a8-8d81-d622885fe08b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.410543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.437443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.438051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.438327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.438597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.439308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:21.439559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.440968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.449866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 553/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:21.453060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c2a2-63ae-4081-b7b0-bc0f1779a6af None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.456002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.495246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.495774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.496065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.496315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.497083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:21.497390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.498826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.517423 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 543/1096] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:21.523802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.557004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.567351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24688-b666-4b12-9fff-2e315d16d4d9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.613092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.613728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.614007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.614273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] PATH_INFO: `/v3/users/4f1a01bbd97240998a394f836cc1ffa9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.615463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a01bbd97240998a394f836cc1ffa9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.616922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.618791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 554/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/users/4f1a01bbd97240998a394f836cc1ffa9 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:21.624391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.639330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108ab40-7d29-4e45-bcfc-8a9b54880bbe None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.663167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.677885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.678671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.678974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.679244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.731182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1800b-83b9-49ee-8745-f2eadf5fd609 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.753705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.755534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.769610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.770219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.770501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.770770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.801661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.847489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.849003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.873790 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 544/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:36:21.880493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.903450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.958637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 555/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:36:21.965155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.000215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1a7-da17-48b3-b08c-16d382e85b13 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.025546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.039955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.040594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.040872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.041368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.052209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.053710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:22.069194 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:22.073078 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:22.074022 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:22.074022 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:22.074022 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:22.074022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 545/1100] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:22.074436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d9ae-2bec-4f9a-bab4-ad79156d5ce9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.077015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.111486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.112120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.112407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.112670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.113821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.115261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.117654 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 556/1101] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:21 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:22.123815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.154380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.187569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b0e6-f432-4e37-a3df-46cd7423e2eb None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.221618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.222235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.222503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.222769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.223404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:22.223710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.225109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.232983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b4b2-0f88-4a3e-9a2f-b15d131ccadb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.250432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 546/1102] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:22.251727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.262224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.271693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.272308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.272597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.272871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.273629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=fede6766c8d74dbbb9aba6bb9e628168, user.id=4f1a01bbd97240998a394f836cc1ffa9) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:22.273938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.275369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.297024 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 557/1103] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/role_assignments?user.id=4f1a01bbd97240998a394f836cc1ffa9&scope.project.id=fede6766c8d74dbbb9aba6bb9e628168&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:22.358652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e16ad7-ef16-40ba-8ea1-5d6a946a817f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.389836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.395620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.396264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.396539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.396807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.404189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.405689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:22.418764 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:22.419934 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:22.420888 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 547/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:22.426033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.533485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef38a6-9398-44cf-9afe-221d8f3a60fe None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.567935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.568452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.568719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.569026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.570217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:22.570513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.571945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4f05-719e-4a0e-b72c-d0ca98eebe1e None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.589216 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 558/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:22.591242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.724136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361143c5-4074-45fd-bed1-1662baa67fff None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.760699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.761335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.761614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.761884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.762617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] RBAC: Adding query filter params (role.id=eeec153851bc4286b4efc1155abc14f4, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=5e0030a2c94142b0af1fe8bf0ac671f8) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:22.762921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:22.764342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78af219-526d-4325-9458-d8ef19ba8719 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:22.770576 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 548/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/role_assignments?user.id=5e0030a2c94142b0af1fe8bf0ac671f8&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=eeec153851bc4286b4efc1155abc14f4 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.489213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6bef3-46f1-4beb-9735-e63ef68fa4ad None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.489801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6bef3-46f1-4beb-9735-e63ef68fa4ad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.489801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6bef3-46f1-4beb-9735-e63ef68fa4ad None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.491094 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 559/1107] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:24.497236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.497668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.497787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.516810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:24.518039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:24.568454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.586071 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 549/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:24.854909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6bef3-46f1-4beb-9735-e63ef68fa4ad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.904295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.953570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6bef3-46f1-4beb-9735-e63ef68fa4ad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.987103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.987723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.988000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.988269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.989385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.990833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f319-a76c-40a7-a103-328f2db18724 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.992416 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 560/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.998270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.094564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327aec1-fe65-4d85-9f73-2136ee9aa5c0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.128087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.128614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.128893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.129192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.129836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.131261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbd81d-0a07-459d-94e1-98af6cc6339e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.153685 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 550/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:24 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:27.353290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a23d-672c-4d6f-9804-14e1d917e1bb None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.353831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a23d-672c-4d6f-9804-14e1d917e1bb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.353831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a23d-672c-4d6f-9804-14e1d917e1bb None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.355139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 561/1111] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:27.361499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.362081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.362081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.381586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:27.382802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:27.419595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:27.452339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 551/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:27.721308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a23d-672c-4d6f-9804-14e1d917e1bb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:27.826212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a23d-672c-4d6f-9804-14e1d917e1bb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:27.845309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:27.864755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:27.865417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.865691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.865956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] PATH_INFO: `/v3/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.867951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] RBAC: Authorizing `identity:get_role(role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:27.869371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:27.870706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 562/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:27.876742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:27.977991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e013f7-9c03-4922-93a1-1a621aa56048 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.013196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.013837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.014116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.014388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] PATH_INFO: `/v3/users/adb7a62e9ec5469ca77ec24b99036f61` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.030455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] RBAC: Authorizing `identity:get_user(user_id=adb7a62e9ec5469ca77ec24b99036f61)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.031919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.033728 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 552/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/users/adb7a62e9ec5469ca77ec24b99036f61 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.039940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.148240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea20a5-0386-4cfe-b6b6-0c27e2d57cea None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.182588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.183190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.183465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.183729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.238680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.252834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.254310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.350175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 563/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:28.356709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.386928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.457223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c824-e166-4d93-964c-64d89263ba8c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.496000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.496547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.496827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.497135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.498330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.499798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe59a7-d343-42d6-8354-96e3ebc92a0f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.501604 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 553/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.511339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.601180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.616624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d8390-035c-4d67-bac1-2124a6adaf54 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.652151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.652779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.653170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.653445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.654192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=fede6766c8d74dbbb9aba6bb9e628168, user.id=adb7a62e9ec5469ca77ec24b99036f61) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.654502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.655988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466dd46-f5c2-4342-aa07-9ade22741de0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.662440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 564/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/role_assignments?user.id=adb7a62e9ec5469ca77ec24b99036f61&scope.project.id=fede6766c8d74dbbb9aba6bb9e628168&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:30.825016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b829-17a5-4889-bb64-fda7ced328fd None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.825560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b829-17a5-4889-bb64-fda7ced328fd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.825701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770b829-17a5-4889-bb64-fda7ced328fd None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.827052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 554/1118] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:30.832790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.833341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.833431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.860105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:30.861972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:30.984931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 565/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:31.255016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770b829-17a5-4889-bb64-fda7ced328fd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.360597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.366394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770b829-17a5-4889-bb64-fda7ced328fd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.402987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.403609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.403880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.404144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] PATH_INFO: `/v3/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.405586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] RBAC: Authorizing `identity:get_role(role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.406938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.408283 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 555/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:31.417852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.552898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.574922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5529f59-c854-489f-be12-f5a913a26fb3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.611020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.611655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.611929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.612196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] PATH_INFO: `/v3/users/adb7a62e9ec5469ca77ec24b99036f61` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.613329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=adb7a62e9ec5469ca77ec24b99036f61)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.614770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.616374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 566/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/users/adb7a62e9ec5469ca77ec24b99036f61 => generated 286 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.622299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.727926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9874a-43ab-4a6d-a873-791b7eebdb56 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.763525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.764152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.764425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.764689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.765864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.767292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c8a5-825a-44f5-8f04-824ccfcb0384 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.768988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 556/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.775637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.876164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52996-0545-4b48-98b5-9ab8f49a9cd2 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.910777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.911462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.911738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.912004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168/users/adb7a62e9ec5469ca77ec24b99036f61/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.914407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fede6766c8d74dbbb9aba6bb9e628168, user_id=adb7a62e9ec5469ca77ec24b99036f61, role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.915887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81f1b-a9c5-4b9a-9599-f07a3806e6d3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.931561 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 567/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:31 2022] PUT /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168/users/adb7a62e9ec5469ca77ec24b99036f61/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:36:34.097345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e96d-7848-4c54-bf46-bff66a363575 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.097990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e96d-7848-4c54-bf46-bff66a363575 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.097990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e96d-7848-4c54-bf46-bff66a363575 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:34.099211 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 557/1124] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:34.105078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.105629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.105629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:34.128075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:34.129344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:34.131705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:34.202074 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 568/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:34.475934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e96d-7848-4c54-bf46-bff66a363575 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:34.526015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:34.622151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e96d-7848-4c54-bf46-bff66a363575 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:34.656923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:34.657567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.657846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.658117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] PATH_INFO: `/v3/roles/026d8032164042e9ac28ed77b7a2c5ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:34.659523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] RBAC: Authorizing `identity:get_role(role_id=026d8032164042e9ac28ed77b7a2c5ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:34.660886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:34.662271 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 558/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:34 2022] GET /identity/v3/roles/026d8032164042e9ac28ed77b7a2c5ca => generated 223 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:34.668426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:34.778018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ec823-53a3-41f8-988d-4485ce0d0aac None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:34.813450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:34.814069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.814344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.814609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] PATH_INFO: `/v3/users/adb7a62e9ec5469ca77ec24b99036f61` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:34.815713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] RBAC: Authorizing `identity:get_user(user_id=adb7a62e9ec5469ca77ec24b99036f61)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:34.817158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:34.818728 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 569/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:34 2022] GET /identity/v3/users/adb7a62e9ec5469ca77ec24b99036f61 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:34.824775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:34.925759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93a3ce-77ab-4c0f-8196-84c0c86125cf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:34.927319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:34.964244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:34.965148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.965431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.965692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.040388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:35.041776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:35.148888 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 559/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:36:35.155626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:35.165740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:35.266475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94776-9d4d-44bc-acc2-013ee207fa50 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:35.301111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:35.301662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.301939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.302209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] PATH_INFO: `/v3/projects/fede6766c8d74dbbb9aba6bb9e628168` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.303343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=fede6766c8d74dbbb9aba6bb9e628168)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:35.304787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e49757-4f8c-4b25-ba7f-3df2199f7fb2 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:35.306560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 570/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/projects/fede6766c8d74dbbb9aba6bb9e628168 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:35.313079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:35.315352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:35.420974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb67d02-6a49-4479-b3dc-b827a709be6e None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:35.460719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:35.461365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.461640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.461907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.462642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] RBAC: Adding query filter params (role.id=026d8032164042e9ac28ed77b7a2c5ca, scope.project.id=fede6766c8d74dbbb9aba6bb9e628168, user.id=adb7a62e9ec5469ca77ec24b99036f61) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:35.462945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:35.464374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022586c-83fd-44d4-aa21-498a852777d8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:35.471127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 560/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/role_assignments?user.id=adb7a62e9ec5469ca77ec24b99036f61&scope.project.id=fede6766c8d74dbbb9aba6bb9e628168&role.id=026d8032164042e9ac28ed77b7a2c5ca => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:37.775727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a25d-cfa3-4fcc-8a10-dc12aa6cef3c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.776284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a25d-cfa3-4fcc-8a10-dc12aa6cef3c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.776284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a25d-cfa3-4fcc-8a10-dc12aa6cef3c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.777674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 571/1131] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:37.784024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.784597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.784597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.805018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:37.806835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:37.877966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.886188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 561/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:38.154980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314a25d-cfa3-4fcc-8a10-dc12aa6cef3c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.241561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.268734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314a25d-cfa3-4fcc-8a10-dc12aa6cef3c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.305467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.306102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.306381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.306650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.307763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.309240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f1b8a-d095-4bf1-b350-ada6799251b1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.310821 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 572/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:38.318596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.429171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ff37-cfb2-4b97-920f-2df363ebcfb5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.468283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.468947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.469228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.469503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.470178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.471655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74ace5-3c66-49fd-a8ec-1d96f509812a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.502683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 562/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:38 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:40.972173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca752-41f2-458b-a22a-674947c0d31d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:40.972713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca752-41f2-458b-a22a-674947c0d31d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:40.972713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca752-41f2-458b-a22a-674947c0d31d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:40.974085 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 573/1135] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:40.979635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:40.980078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:40.980174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:40.998816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:41.000136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:41.043913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:41.068883 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 563/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:41.350190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eca752-41f2-458b-a22a-674947c0d31d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.450633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eca752-41f2-458b-a22a-674947c0d31d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:41.482715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:41.483332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.483602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.483888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.484965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:41.486399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835286d0-e8a5-4e01-8702-ba6cd1752243 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:41.487931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 574/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:41.494253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.590359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80a105-e8b6-430d-a382-8ef4e9b772b0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:41.624679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:41.625242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.625522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.625794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.626453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:41.627887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc7fed-7303-4c21-88cb-946991b5cd61 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:41.650723 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 564/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:41 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:43.826178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94a86-cdb4-4d52-ac88-acc9a325f9d7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.826725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94a86-cdb4-4d52-ac88-acc9a325f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.826725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94a86-cdb4-4d52-ac88-acc9a325f9d7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.828026 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 575/1139] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:43.833373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.833822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.833929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.852853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:43.854008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:43.881085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.922198 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 565/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:44.193516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f94a86-cdb4-4d52-ac88-acc9a325f9d7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.206836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.297856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f94a86-cdb4-4d52-ac88-acc9a325f9d7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.330555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.331174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.331450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.331719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.343548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:44.348315 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:44.349539 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:44.350562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 576/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:44.355731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.453837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79530b0-cafd-4e4b-b104-9b5139ba175a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.488343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.488990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.489275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.489541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.490204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:44.490507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.491873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.500509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 566/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:44.506427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.575366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.608357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e909-b4c2-4df3-9a4f-a7559d006fdb None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.649031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.649687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.649977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.650245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] PATH_INFO: `/v3/users/7052efb8b3cc42c094d96374c7c99ea9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.663594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] RBAC: Authorizing `identity:get_user(user_id=7052efb8b3cc42c094d96374c7c99ea9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.665076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.666978 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 577/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/users/7052efb8b3cc42c094d96374c7c99ea9 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:44.672982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.702971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.776697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308085c1-084a-4a7b-b0f5-071a03910558 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.811441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.812045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.812321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.812588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.880682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.882162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.908261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.981455 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 567/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:44.987481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:45.091137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b610-a054-4d59-bed3-16da278979ba None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:45.122796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:45.131793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:45.132446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:45.132721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:45.133026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] PATH_INFO: `/v3/projects/caca347b62c040cebbe1966c2379c02b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:45.134285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] RBAC: Authorizing `identity:get_project(project_id=caca347b62c040cebbe1966c2379c02b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:45.135762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e578a57-0f17-4e74-9adb-94df82847d86 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:45.137549 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 578/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/projects/caca347b62c040cebbe1966c2379c02b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:45.143942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:45.252105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5104c-d678-43e9-b00b-f14c26695a07 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:45.277997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:45.286790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:45.287385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:45.287658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:45.287921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:45.288639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=caca347b62c040cebbe1966c2379c02b, user.id=7052efb8b3cc42c094d96374c7c99ea9) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:45.288963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:45.290431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416040-9019-4778-aace-f8dd2d092ae8 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:45.296280 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 568/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:45 2022] GET /identity/v3/role_assignments?user.id=7052efb8b3cc42c094d96374c7c99ea9&scope.project.id=caca347b62c040cebbe1966c2379c02b&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:47.415750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9cade-a3f1-4430-9a3d-db294fb4bb72 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.416316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9cade-a3f1-4430-9a3d-db294fb4bb72 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.416316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9cade-a3f1-4430-9a3d-db294fb4bb72 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.417674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 579/1147] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:47.423231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.423691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.423788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.442346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:47.443461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:47.509078 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 569/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:47.779726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9cade-a3f1-4430-9a3d-db294fb4bb72 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.881267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9cade-a3f1-4430-9a3d-db294fb4bb72 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.916550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.917211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.917488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.917754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.928031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:47.933478 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:47.934800 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:47.935743 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 580/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:47.940712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.037324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013134-b889-421f-b5df-d9c8ce786c70 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.058354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.072626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.073279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.073559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.073831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.074609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:48.074917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.076282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.084486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 570/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.090718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.149782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.194008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d242-0a61-4021-9f48-b60abe3a044b None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.229362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.229991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.230269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.230539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] PATH_INFO: `/v3/users/7052efb8b3cc42c094d96374c7c99ea9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.231660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] RBAC: Authorizing `identity:get_user(user_id=7052efb8b3cc42c094d96374c7c99ea9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.233125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.234708 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 581/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/users/7052efb8b3cc42c094d96374c7c99ea9 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.240575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.342334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e763c9e-95ec-491e-955e-1c83c50fdaca None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.376232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.376863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.377173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.377442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] PATH_INFO: `/v3/projects/caca347b62c040cebbe1966c2379c02b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.378549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] RBAC: Authorizing `identity:get_project(project_id=caca347b62c040cebbe1966c2379c02b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.379974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77dfd-f478-479e-931b-cd1b8e6c45b2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.381677 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 571/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/projects/caca347b62c040cebbe1966c2379c02b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.388357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.486098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ea44a-8cab-4d6e-8919-2e1751260255 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.511372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.522571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.523201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.523474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.523743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] PATH_INFO: `/v3/projects/caca347b62c040cebbe1966c2379c02b/users/7052efb8b3cc42c094d96374c7c99ea9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.525706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] RBAC: Authorizing `identity:create_grant(project_id=caca347b62c040cebbe1966c2379c02b, user_id=7052efb8b3cc42c094d96374c7c99ea9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.527166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6b749-1a85-4c98-b696-5309d8cadb34 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.540283 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 582/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:48 2022] PUT /identity/v3/projects/caca347b62c040cebbe1966c2379c02b/users/7052efb8b3cc42c094d96374c7c99ea9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:50.725044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e32b-d14c-4a69-9446-32f2267fdcfc None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.725597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e32b-d14c-4a69-9446-32f2267fdcfc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.725597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e32b-d14c-4a69-9446-32f2267fdcfc None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.726899 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 572/1154] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:50.732310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.732742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.732843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.751033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:50.752221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:50.818089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 583/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:51.092455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e32b-d14c-4a69-9446-32f2267fdcfc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.149030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.204745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e32b-d14c-4a69-9446-32f2267fdcfc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.240231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.240855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.241162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.241428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.251973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:51.256810 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:51.257929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:36:51.258996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 573/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:51.264673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.361663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13652eda-fa4c-490e-ab5f-480fd5e24f52 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.375662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.396277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.396881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.397191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.397458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.398115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:51.398414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.399790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.408464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 584/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:51.414733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.518799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e21681-a632-486c-98fc-96ea04dfaea6 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.530435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.554682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.555315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.555590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.555855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] PATH_INFO: `/v3/users/7052efb8b3cc42c094d96374c7c99ea9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.557053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] RBAC: Authorizing `identity:get_user(user_id=7052efb8b3cc42c094d96374c7c99ea9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.558482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.560084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 574/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/users/7052efb8b3cc42c094d96374c7c99ea9 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:51.566278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.673815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5ecbb-9fae-4ff0-9381-6caa66869a26 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.708295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.708896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.709217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.709487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.755841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.779733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.781216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.881802 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 585/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:51.888679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.993820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188e4f-d12d-444f-b665-a389dcccc29a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.031775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.032414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.032692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.032991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] PATH_INFO: `/v3/projects/caca347b62c040cebbe1966c2379c02b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.034125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] RBAC: Authorizing `identity:get_project(project_id=caca347b62c040cebbe1966c2379c02b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:52.035559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b09eb-f5e5-4cbc-abc3-f5a2203f4be7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:52.037258 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 575/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/projects/caca347b62c040cebbe1966c2379c02b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:52.044099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.121962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:52.145212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0407836-7a8d-4e4b-9e9a-475d7a53ba1d None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.180302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.181136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.181413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.181750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.182735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=caca347b62c040cebbe1966c2379c02b, user.id=7052efb8b3cc42c094d96374c7c99ea9) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:52.183044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:52.184480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c404-2971-4c94-87e8-564792a581d3 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:52.190675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 586/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/role_assignments?user.id=7052efb8b3cc42c094d96374c7c99ea9&scope.project.id=caca347b62c040cebbe1966c2379c02b&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:54.374348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47368-e5f5-4786-a2c0-880cf6ff6832 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.374890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47368-e5f5-4786-a2c0-880cf6ff6832 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.374890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47368-e5f5-4786-a2c0-880cf6ff6832 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.376233 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 576/1162] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:54.381488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.381946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.382049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.404356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:54.405589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:54.472196 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 587/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:54.746444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b47368-e5f5-4786-a2c0-880cf6ff6832 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.795361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.852918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b47368-e5f5-4786-a2c0-880cf6ff6832 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.886891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.887488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.887765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.888032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.963681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.965182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.014203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:55.072663 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 577/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:55.082110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:55.197257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:55.234751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475302f4-eff6-4b77-b67f-76c67c34ec8f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.282485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.283023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.283296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.283558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.291125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.292586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-de6bce3a-c3cc-4f9a-9d5f-c6b1d2084d05 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:55.304857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:55.306392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:36:55.307314 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 588/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:55.312524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:55.417392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4e6c1-f0ae-492f-b406-9f1c68bbc127 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.453534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.454135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.454407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.454671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.455304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:55.455598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.456975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe74a19-a21a-4a93-ab9f-0c7e9ddb3af2 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.465049 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 578/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:57.637514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e7d6-5774-4b5a-a066-f29a0e0f5697 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.638058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e7d6-5774-4b5a-a066-f29a0e0f5697 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.638058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e7d6-5774-4b5a-a066-f29a0e0f5697 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.639375 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 589/1167] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:57.645066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901573f-170b-4648-9799-85f78724a2ec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.645530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901573f-170b-4648-9799-85f78724a2ec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.645658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901573f-170b-4648-9799-85f78724a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.663592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0901573f-170b-4648-9799-85f78724a2ec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:57.664786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0901573f-170b-4648-9799-85f78724a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:57.668402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.733563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 579/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:58.001679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e7d6-5774-4b5a-a066-f29a0e0f5697 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:58.107273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e7d6-5774-4b5a-a066-f29a0e0f5697 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:58.140208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:58.147087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:58.147708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.147984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.148250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.148963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:58.150370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d756a74-7501-443a-bde2-cc19afa955ee None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:58.169695 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 590/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Fri Oct 28 09:36:58 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:00.383705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12e6e-d6af-4e56-83c2-8b2238c4e645 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.384584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12e6e-d6af-4e56-83c2-8b2238c4e645 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.384867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12e6e-d6af-4e56-83c2-8b2238c4e645 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.386356 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 580/1170] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:00.391913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.392352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.392443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.411761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:00.413009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:00.486421 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 591/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:00.754263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb12e6e-d6af-4e56-83c2-8b2238c4e645 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.853216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb12e6e-d6af-4e56-83c2-8b2238c4e645 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.886928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.887561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.887841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.888114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] PATH_INFO: `/v3/domains/d4109f437b7849cab6fe21de7729a372` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.896420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.899003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=d4109f437b7849cab6fe21de7729a372)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.901195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc00e-090a-4a33-8409-bf09b698eb2f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.903362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 581/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/domains/d4109f437b7849cab6fe21de7729a372 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:00.909287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:01.007013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d2e0-7e9b-49b2-b759-9046b8fc2bb6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:01.027121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.042344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:01.042962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:01.043238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:01.043505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.044149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.045630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4254-69a4-447a-aa00-4aa023bc5569 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.072132 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 592/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:00 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:03.267131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5fe-1e87-4c0d-97a8-5d8187c22cc4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.267783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5fe-1e87-4c0d-97a8-5d8187c22cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.267783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb5fe-1e87-4c0d-97a8-5d8187c22cc4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.269014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 582/1174] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:03.274636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.275168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.275168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.295107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:03.296343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:03.364611 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 593/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:03.638783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb5fe-1e87-4c0d-97a8-5d8187c22cc4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.737048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb5fe-1e87-4c0d-97a8-5d8187c22cc4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.769680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.770302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.770578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.770843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] PATH_INFO: `/v3/domains/d4109f437b7849cab6fe21de7729a372` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.771944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=d4109f437b7849cab6fe21de7729a372)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.773403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1575-ab41-4eab-a0f3-d0426e5a08ae None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.774968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 583/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/domains/d4109f437b7849cab6fe21de7729a372 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:03.781065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.878699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa4c8-74a6-4911-a767-4f6071b16ffd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.880151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.914689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.915299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.915574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.915840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.916483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.918536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f87bd-15cc-4488-8436-a0880b72d11b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.940805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 594/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:37:03 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:06.166678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5d7d-8d72-42e3-94bd-6e980ccb5e10 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.167242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5d7d-8d72-42e3-94bd-6e980ccb5e10 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.167242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5d7d-8d72-42e3-94bd-6e980ccb5e10 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.168540 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 584/1178] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:06.173817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.174223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.174368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.193864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:06.195035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:06.260647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 595/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:06.530381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf5d7d-8d72-42e3-94bd-6e980ccb5e10 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.602164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.636892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf5d7d-8d72-42e3-94bd-6e980ccb5e10 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.670149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.670772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.671048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.671314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.681378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:06.686348 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:06.687884 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:37:06.689671 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 585/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:06.693708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.780998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.795074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84764cf-2502-4452-a297-52ac75aa541f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.829613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.830225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.830502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.830772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.831438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:06.831738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.833132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.842036 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 596/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:06.848465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.945058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0e71-aedb-4496-81f8-5c42eab94ebe None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.970956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.978541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.979159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.979429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.979694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] PATH_INFO: `/v3/users/95ed85256f6a4c14b9edc1443fbd5605` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.992266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed85256f6a4c14b9edc1443fbd5605)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.993711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.995287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 586/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/users/95ed85256f6a4c14b9edc1443fbd5605 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:07.001817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.099238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0fd4-4634-4057-938d-356419d5d290 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.131926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.132529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.132808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.133108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.152851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.204013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.205516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.305433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 597/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:07.311789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.409678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed142dc9-ad60-41de-bded-176a409173b7 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.443626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.444246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.444520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.444786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] PATH_INFO: `/v3/projects/85b856df4ff54163a20c08f6963a64d8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.445925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] RBAC: Authorizing `identity:get_project(project_id=85b856df4ff54163a20c08f6963a64d8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.447353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4a362-2105-4d67-9290-ac2ef788be44 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.449091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 587/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/projects/85b856df4ff54163a20c08f6963a64d8 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:07.455312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.506604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.556376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f58c9-f0c4-4138-9b6c-531f94b41a47 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.590476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.591084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.591361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.591630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.592351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=85b856df4ff54163a20c08f6963a64d8, user.id=95ed85256f6a4c14b9edc1443fbd5605) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:07.592655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.594407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719607-ffff-4340-8930-d0a3056f6fa4 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.600950 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 598/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/role_assignments?user.id=95ed85256f6a4c14b9edc1443fbd5605&scope.project.id=85b856df4ff54163a20c08f6963a64d8&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:09.744633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf03b0-6411-4986-bf22-789a69eaa1da None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.745315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf03b0-6411-4986-bf22-789a69eaa1da None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.745315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf03b0-6411-4986-bf22-789a69eaa1da None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.746569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 588/1186] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:09.751985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.752453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.752570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.771526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:09.772724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:09.839273 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 599/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:10.108448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf03b0-6411-4986-bf22-789a69eaa1da None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.167089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.218522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf03b0-6411-4986-bf22-789a69eaa1da None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.253924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.254547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.254824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.255094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.265950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:10.270784 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:10.272162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:37:10.273360 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 589/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:10.278119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.326126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.381098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291754a-83af-4b2c-817d-15492a05d775 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.414223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.414828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.415106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.415377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.416036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:10.416335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.418252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.426388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 600/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:10.432321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.532349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a100f-11de-4d65-a432-9c20b27f0c4a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.547647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.572232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.572865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.573177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.573448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] PATH_INFO: `/v3/users/95ed85256f6a4c14b9edc1443fbd5605` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.574637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed85256f6a4c14b9edc1443fbd5605)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.576051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.577703 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 590/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/users/95ed85256f6a4c14b9edc1443fbd5605 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:10.583897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.688274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091100c1-6157-4a9a-9f7b-7fa2c58341b0 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.695390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.723919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.724746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.725056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.725331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] PATH_INFO: `/v3/projects/85b856df4ff54163a20c08f6963a64d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.726503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] RBAC: Authorizing `identity:get_project(project_id=85b856df4ff54163a20c08f6963a64d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.727960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ce3a1-77af-4ed2-87fd-658cb943f89f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.729690 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 601/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/projects/85b856df4ff54163a20c08f6963a64d8 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:10.736600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.837232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ada905-0e24-4cb8-8d6c-3e18011f74a4 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.872028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.872687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.872989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.873259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] PATH_INFO: `/v3/projects/85b856df4ff54163a20c08f6963a64d8/users/95ed85256f6a4c14b9edc1443fbd5605/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.875139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] RBAC: Authorizing `identity:create_grant(project_id=85b856df4ff54163a20c08f6963a64d8, user_id=95ed85256f6a4c14b9edc1443fbd5605, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.876547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ecc21-2dba-498f-9428-ba390acddb4b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.891148 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 591/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:10 2022] PUT /identity/v3/projects/85b856df4ff54163a20c08f6963a64d8/users/95ed85256f6a4c14b9edc1443fbd5605/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:37:13.071284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0533-f7f5-42f4-b9ca-551f0ee8afbb None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.071975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0533-f7f5-42f4-b9ca-551f0ee8afbb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.071975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0533-f7f5-42f4-b9ca-551f0ee8afbb None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.073239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 602/1193] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:13.079903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.080432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.080432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.099633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:13.100849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:13.136868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.170287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 592/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:13.443506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa0533-f7f5-42f4-b9ca-551f0ee8afbb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.548184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa0533-f7f5-42f4-b9ca-551f0ee8afbb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.582166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.582804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.583089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.583362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.595157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:13.600042 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:13.601247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:37:13.602123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 603/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:13.607422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.707148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa102b4-ff46-45bb-9573-9c978771e93b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.740587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.741220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.741501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.741766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.742436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.742732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.744096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.752858 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 593/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:13.758938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.793106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.862316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7fa2f-2604-4d61-880c-a4ba80fcd6ca None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.896723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.897372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.897645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.897911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] PATH_INFO: `/v3/users/95ed85256f6a4c14b9edc1443fbd5605` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.899000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed85256f6a4c14b9edc1443fbd5605)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.900427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.902022 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 604/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/users/95ed85256f6a4c14b9edc1443fbd5605 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:13.907926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.941584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.008022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f42a-55c5-4132-a044-8422fe3eb342 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.040429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.041182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.041457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.041721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.108301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.109763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.142089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.212038 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 594/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:14.218272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.317935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d41a-eb5e-4ec9-80f3-f2df8058bc84 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.319380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.352265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.352885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.353183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.353447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] PATH_INFO: `/v3/projects/85b856df4ff54163a20c08f6963a64d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.354528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] RBAC: Authorizing `identity:get_project(project_id=85b856df4ff54163a20c08f6963a64d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.356496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7103a-c451-4a85-a478-5b2ac9ac5931 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.358137 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 605/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/projects/85b856df4ff54163a20c08f6963a64d8 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:14.364317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.461362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b4016-7545-4778-ab6e-11e4430b092a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.494203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.494824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.495097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.495363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.496593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=85b856df4ff54163a20c08f6963a64d8, user.id=95ed85256f6a4c14b9edc1443fbd5605) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.496895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.498332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cfcd8-1927-4b24-8e66-77cbca38d775 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.500122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.505180 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 595/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/role_assignments?user.id=95ed85256f6a4c14b9edc1443fbd5605&scope.project.id=85b856df4ff54163a20c08f6963a64d8&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:24.348036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=15 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:24.505996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:12.874879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf433d7-91ea-4cf6-a8f6-41492cb1b51d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:12.875452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf433d7-91ea-4cf6-a8f6-41492cb1b51d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:12.875452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf433d7-91ea-4cf6-a8f6-41492cb1b51d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:12.877224 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 606/1201] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:12.882974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:12.883849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:12.883849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:12.909336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:12.910562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:13.067113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 596/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:38:13.566665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf433d7-91ea-4cf6-a8f6-41492cb1b51d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:13.762220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf433d7-91ea-4cf6-a8f6-41492cb1b51d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:13.836078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:13.837095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:13.837573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:13.838044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:13.863236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:13.865979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:13.896155 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:13.897898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:13.898898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:13.898898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:13.898898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:13.905130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 607/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:13.908724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:14.070774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ddfa-930d-458f-ae5c-6e6c80fdb1a1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:14.130128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:14.138964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:14.140204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:14.140503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:14.140776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:14.141510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:14.141875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:14.143839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747669-f46d-470b-943f-f253f8da0b44 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:14.163708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 597/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:14.173222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:14.244236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:14.332656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174638f-b4ef-4321-89e6-32f631606c32 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:14.382512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:14.383437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:14.383888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:14.384322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:14.385282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:14.387045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f00f6-311e-4c84-8330-06a4963edfd5 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:14.421760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 608/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Oct 28 09:38:14 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:38:17.613894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89599-72dc-4fc7-b60f-91670d6ef5c7 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:17.614451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89599-72dc-4fc7-b60f-91670d6ef5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:17.614451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89599-72dc-4fc7-b60f-91670d6ef5c7 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:17.616203 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 598/1206] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:38:17.625106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:17.625106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:17.626148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:17.654240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:17.656583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:17.757308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 609/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:18.088210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89599-72dc-4fc7-b60f-91670d6ef5c7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:18.264022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89599-72dc-4fc7-b60f-91670d6ef5c7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:18.327551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:18.328388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:18.328857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:18.330855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:18.353378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:18.360747 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:18.361942 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:18.362805 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:18.368260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 599/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:38:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:18.370930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:18.422231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:18.515145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75979087-7da7-4d0e-8a35-9545098bcf4f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:18.581074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:18.582234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:18.582532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:18.582807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:18.583801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:18.584186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:18.585844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:18.601373 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 610/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:38:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:38:18.609866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:18.708932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:18.773134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5b984-1ac4-432d-a9f5-a9a7ec6826d0 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:18.836610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:18.837776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:18.839363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:18.839363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:18.859150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:18.862832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:18.888608 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:18.890002 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:18.891476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:18.891476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:18.891476 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:18.891476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 600/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:18.896468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:19.031742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:19.036708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986930b-66cb-4d11-bd1d-bf0279642d07 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:19.082404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:19.083936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:19.083936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:19.083936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:19.084455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:19.084455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:19.086059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:19.104951 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 611/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:19.112433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:19.258144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53a88c-46b5-4e1a-9e0a-6bcc2fe6500b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:19.259922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:19.318784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:19.319554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:19.319897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:19.320174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:19.328749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:19.330801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:19.345671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:19.348374 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:19.350695 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:19.352856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 601/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:19.353657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:19.520817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e7b0-c3fb-4d0f-802b-2119e6e16bc8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:19.585073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:19.585073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:19.585073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:19.585073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:19.585715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:19.585715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:19.588383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:19.620845 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 612/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:19.630395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:19.762748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd88e-547d-45db-9cc6-10699f0f5623 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:19.819402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:19.820193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:19.820503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:19.820782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:19.860533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:19.910249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:19.911858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:20.056834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 602/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:38:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:38:20.062751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:20.090142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:20.186007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37552c-ff0e-420f-81b0-759cc35527fe None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:20.230941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:20.231635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:20.231972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:20.232258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:20.243728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:20.245378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:20.265300 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:20.267304 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:20.269415 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:20.269415 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:20.269415 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:20.269415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 613/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:20.273620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:20.346661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:20.395975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad0c-06af-418b-a70c-13ba0bd343ef None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:20.435912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:20.436528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:20.436805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:20.437105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:20.437757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:20.438073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:20.440037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:20.452695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 603/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:20.459446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:20.550187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:20.586939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8feb80-72a6-4708-a3a5-94e3e0bf724c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:20.625576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:20.626139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:20.626412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:20.626681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:20.634970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:20.636473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:20.650361 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:20.651845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:20.653073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 614/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:20.658331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:20.772270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ad88-5eeb-456c-9bac-005bc0bae1fc None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:20.798306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:20.813035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:20.813630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:20.813941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:20.814178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:20.815707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:20.816479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:20.817460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f44c0-e531-4a17-b904-4242877c97ba None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:20.832055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 604/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:20.839616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:20.961586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133bbd-a6be-46fd-9267-886a49446002 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:20.995554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:21.002911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:21.003670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:21.004017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:21.004282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:21.005069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=f8d91f2fd8b44f6790078a7c19984b11) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:21.005348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:21.006808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff00c5-ef79-4dac-8214-d9aee4746324 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:21.012992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 615/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:38:20 2022] GET /identity/v3/role_assignments?user.id=f8d91f2fd8b44f6790078a7c19984b11&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:23.214544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653646aa-dcab-4344-a6f6-2ae3526ffcf5 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:23.215141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653646aa-dcab-4344-a6f6-2ae3526ffcf5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:23.215141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653646aa-dcab-4344-a6f6-2ae3526ffcf5 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:23.216450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 605/1220] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:23.223643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:23.224477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:23.224477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:23.245069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:23.246309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:23.356540 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 616/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:23.650583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653646aa-dcab-4344-a6f6-2ae3526ffcf5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:23.782108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653646aa-dcab-4344-a6f6-2ae3526ffcf5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:23.817907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:23.818550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:23.818832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:23.819101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:23.829669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:23.834645 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:23.839197 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:23.840284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 606/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:38:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:23.844575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:23.963501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432991d-04e8-4ef3-8bff-f9d0d34d364e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:23.990433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:24.002310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:24.003460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:24.003737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:24.004005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:24.004674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] RBAC: Adding query filter params (name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:24.005003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:24.006397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:24.017191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 617/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:38:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:24.024594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:24.074525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:24.144957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fbc1a-1769-4e47-936c-817974916c56 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:24.189302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:24.190139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:24.190472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:24.190820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:24.205503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:24.207423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:24.226903 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:24.228931 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:24.229955 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:24.229955 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:24.229955 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:24.229955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 607/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:38:24.235332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:24.368198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a8952-8675-40b7-ab8b-b04e11ffa5da None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:24.407237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:24.407837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:24.408113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:24.408381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:24.409615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:24.409919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:24.411375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:24.429291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 618/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:38:24.435381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:24.544361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:24.554690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cc74-a1a3-4844-8f63-cd811fc1d36b None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:24.604750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:24.605841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:24.606311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:24.606779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:24.617562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:24.619026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:24.631751 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:24.633014 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:24.634145 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 608/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:24.639010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:24.693093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:24.770562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c989-fd33-48e8-8414-ff9410b2fbb9 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:24.815223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:24.815839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:24.816114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:24.816382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:24.817148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:24.817450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:24.818907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:24.839426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 619/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:38:24.845717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:24.969928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d363-557a-43cb-b6ee-571181a5c923 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:25.022623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:25.023600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:25.024080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:25.024540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:25.039254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:25.041328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:25.068596 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:25.070192 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:25.072234 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:25.072234 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:25.072234 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:25.072234 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 609/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:38:25.078095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:25.212396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a5ca-5a6a-4b02-957f-83ccbf47f92f None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:25.216473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:25.265254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:25.266141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:25.266617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:25.267097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:25.269277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:25.269889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:25.272537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:25.292076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 620/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:25.299116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:25.310225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:25.447257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5f38-a115-4f14-a136-109cf13b26cf None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:25.484981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:25.485656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:25.485959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:25.486334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:25.495202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:25.497021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:25.509902 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:25.516462 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:25.517671 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 610/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:38:25.518491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:25.636013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0545e-07e2-4ca7-82a4-dea5a7094f62 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:25.680379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:25.681209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:25.681606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:25.682074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:25.683023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:25.683455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:25.685440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691f36-a426-4ab3-a251-ce965e68391b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:25.701666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 621/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:25.708555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:25.783426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:25.823563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9f621-383f-4121-8caa-8cafe3f35669 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:25.862586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:25.863686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:25.864174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:25.864644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/f8d91f2fd8b44f6790078a7c19984b11/roles/df4dacc12df14673b339919b0bdedbcd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:25.882891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=f8d91f2fd8b44f6790078a7c19984b11, role_id=df4dacc12df14673b339919b0bdedbcd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:25.884375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28defc-7e06-46f0-8b18-bb0588620632 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:25.901530 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 611/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:38:25 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/f8d91f2fd8b44f6790078a7c19984b11/roles/df4dacc12df14673b339919b0bdedbcd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:38:28.144178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29566a-1ab9-4e34-a6b8-5c1f2012acd7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:28.144848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29566a-1ab9-4e34-a6b8-5c1f2012acd7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:28.144848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29566a-1ab9-4e34-a6b8-5c1f2012acd7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:28.146328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 622/1233] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:28.152204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:28.153744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:28.153744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:28.173218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:28.174860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:28.253709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 612/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:38:28.528654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29566a-1ab9-4e34-a6b8-5c1f2012acd7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:28.555376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:28.644181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29566a-1ab9-4e34-a6b8-5c1f2012acd7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:28.684871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:28.685567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:28.685844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:28.686107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:28.698490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:28.703389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:28.704627 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:28.705580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 623/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Oct 28 09:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:28.711496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:28.763106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:28.825597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4681-cb01-4734-ba01-c878d3ea389b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:28.865755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:28.866459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:28.866814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:28.867194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:28.867983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:28.868438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:28.869914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:28.879973 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 613/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Oct 28 09:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:28.886496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:28.983291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:29.000439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0727c-7bb8-4047-8772-077724cc5dec None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:29.042388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:29.043008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:29.046990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:29.046990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:29.059504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:29.064380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:29.079276 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:29.080440 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:29.081935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:29.081935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:29.081935 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:29.081935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 624/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:38:29.087358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:29.215833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b625-857b-4518-9555-739e66b3beb5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:29.227863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:29.258397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:29.259008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:29.259313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:29.259547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:29.260257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:29.260555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:29.262073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:29.276026 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 614/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:38:29.282007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:29.406313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69989-26a4-4352-8a27-0fca0f707942 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:29.444013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:29.444728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:29.445058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:29.445471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:29.449023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:29.454409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:29.455936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:29.469422 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:29.470982 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:29.472167 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 625/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:29.477056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:29.592282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e73aa-6fef-4da4-8807-7e8c1ab9bfce None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:29.645206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:29.645831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:29.646104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:29.646372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:29.647144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:29.647459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:29.649138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:29.671145 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 615/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:29.677338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:29.787410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38672a40-0a21-4dc2-a305-86a74bbce47c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:29.822712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:29.823323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:29.823599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:29.824860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:29.894431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:29.902847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:29.904384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.026640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:38:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:30.032559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:30.068093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:30.152896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88262-9d24-4e3e-bac9-33bf2b39f432 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:30.197761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:30.198441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:30.198720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:30.199049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:30.211317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:30.212802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:30.229910 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:30.231607 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:30.232724 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:30.232724 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:30.232724 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:30.232724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 616/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:30.237722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:30.349933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:30.358735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16b307-601f-49d7-bb38-19dcd6fedcf8 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:30.400948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:30.401736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:30.402042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:30.402433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:30.403202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:30.403628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:30.405324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.418914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 627/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:30.425104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:30.512433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:30.536827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2a30-f389-431d-b738-ca2fcb4a4559 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:30.581150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:30.581792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:30.582065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:30.582330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:30.591169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:30.593139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:30.610279 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:30.611430 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:30.612891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 617/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:30.618077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:30.735565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701515-6bab-4d0d-9a23-6a99efb38965 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:30.776357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:30.777036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:30.777294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:30.777564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:30.778322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:30.778661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:30.780154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93f66-42fe-4d00-9675-ebad5008b8ce None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.793128 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 628/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:30.799489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:30.912586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aee9a-22e1-4616-8e0e-84befdce200c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:30.950945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:30.951667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:30.951956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:30.952264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:30.953148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] RBAC: Adding query filter params (role.id=df4dacc12df14673b339919b0bdedbcd, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=f8d91f2fd8b44f6790078a7c19984b11) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:30.953454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:30.955077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19d71f-40f6-4efa-b1ec-b26e192143ed None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:30.961848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 618/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:38:30 2022] GET /identity/v3/role_assignments?user.id=f8d91f2fd8b44f6790078a7c19984b11&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=df4dacc12df14673b339919b0bdedbcd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:33.273619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa0e0-f140-44fd-b662-bd1dd2fe7e65 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:33.274193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa0e0-f140-44fd-b662-bd1dd2fe7e65 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:33.274193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa0e0-f140-44fd-b662-bd1dd2fe7e65 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:33.275665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 629/1247] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:33.282737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:33.283313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:33.283417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:33.290817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:33.304991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:33.306464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:33.385755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 619/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:38:33.687640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa0e0-f140-44fd-b662-bd1dd2fe7e65 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:33.707530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:33.802829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa0e0-f140-44fd-b662-bd1dd2fe7e65 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:33.839970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:33.840568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:33.840847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:33.841149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:33.852774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:33.858018 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:33.859718 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:33.861083 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 630/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:33.866123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:33.991044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f93a1-e05f-470d-b909-71b9237baa7b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.024757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:34.031506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.032246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.032530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.032803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:34.033539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:34.033842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:34.035989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:34.048122 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 620/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:34.054569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:34.142843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:34.171677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9218-62f5-41fe-9cd3-5f0699538f24 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.217234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.217899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.218177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.219351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:34.233030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:34.234503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:34.256127 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:34.257469 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:34.263356 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:34.263356 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:34.263356 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:34.263356 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 631/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:34.263617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:34.382576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316207b-2beb-42eb-83b5-cf26a0aa65db None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.421692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.422308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.422587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.422857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:34.423504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:34.423803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:34.425701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:34.438579 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 621/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:34.445005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:34.551085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a1c2-787a-4a66-96cd-d9686a54e4fa None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.578261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:34.591355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.591998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.592277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.592554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:34.601828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:34.603299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:34.615541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:34.616737 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:34.617966 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 632/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:34.622880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:34.691922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:34.746432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dd8fd-0ffb-4853-a1a1-fe73aaf987ec None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.786831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.787483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.787759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.788047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:34.788831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:34.789167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:34.790660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:34.815424 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 622/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:34.817228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:34.933561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f7848-30d5-491c-9927-abaf1d641bf7 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:34.971927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:34.973081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:34.973358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:34.973628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:35.047084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:35.060429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:35.061945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:35.171952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 633/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:38:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:35.178110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:35.313513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22db3a-f350-4954-99ab-2968c86ceb8a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:35.328772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:35.352220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:35.352850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:35.353151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:35.353413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:35.364641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:35.366118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:35.384727 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:35.387168 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:35.389001 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:35.389001 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:35.389001 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:35.389001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 623/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:35.392381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:35.501233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:35.515694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f34d-6594-499a-9f74-7f538b39a484 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:35.553458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:35.554004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:35.554277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:35.554543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:35.555175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:35.555532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:35.556838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:35.569651 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 634/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:35.575617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:35.696834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11fef3-7551-49a0-b73b-9c761e5ea8ad None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:35.737081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:35.737791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:35.738065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:35.738369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:35.747703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:35.750434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:35.773651 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:35.774929 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:35.776049 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 624/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:38:35.785077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:35.910729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8bd3-05e2-4c8c-a1f3-c5189576b579 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:35.950961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:35.951582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:35.951855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:35.952157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:35.952890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:35.953210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:35.954745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3edda-1260-4d75-8759-b4a42e90c3d6 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:35.968458 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 635/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:38:35.975100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:36.005929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:36.090725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbcac-2bff-45c5-82d4-046e0a79f8e1 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:36.129415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:36.130021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:36.130339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:36.130604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:36.131385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=f8d91f2fd8b44f6790078a7c19984b11) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:36.131728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:36.133396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602b069-4465-441c-ade6-dd79846c1cd6 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:36.140092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 625/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:38:35 2022] GET /identity/v3/role_assignments?user.id=f8d91f2fd8b44f6790078a7c19984b11&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:38.311346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b2af-dc7a-412b-af16-bd4c811aa9fe None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:38.311919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b2af-dc7a-412b-af16-bd4c811aa9fe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:38.311919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b2af-dc7a-412b-af16-bd4c811aa9fe None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:38.313260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 636/1261] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:38.319041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:38.319500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:38.319610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:38.337647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:38.338845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:38.407178 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 626/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:38.671841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b2af-dc7a-412b-af16-bd4c811aa9fe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:38.682884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:38.776862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b2af-dc7a-412b-af16-bd4c811aa9fe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:38.811597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:38.812220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:38.812481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:38.812756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:38.823552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:38.828404 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:38.829577 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:38.830606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 637/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:38.835819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:38.853814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:38.934193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3b975-554f-4ed0-b55f-0b587a8b3ba3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:38.968337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:38.968955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:38.969232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:38.969500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:38.970138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:38.970432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:38.971775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:38.979475 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 627/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:38.985533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.052836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:39.086193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a65e2-3393-42fb-a422-67d37be6e4d6 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.121244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.121876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.122152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.122420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.133116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.134567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:39.149911 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:39.155683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:39.156847 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:39.156847 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:39.156847 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:39.156847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 638/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:39.157174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.256331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:39.279666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f70d2-262a-405d-92a5-476068a8a848 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.313368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.313972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.314245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.314509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.315136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:39.315433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.316839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.329180 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 628/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:39.335100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.434491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dee2-69e1-4e5d-a614-0d88fd509d87 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.454468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:39.468788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.469517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.469794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.470063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] PATH_INFO: `/v3/users/placement` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.478174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.479630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:39.491987 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:39.493201 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:39.494183 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 639/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:39.502039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.613524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c1052-3501-4198-9770-9be60a93b9ea None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.652196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.652807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.653112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.653380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.654103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:39.654406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.655818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.665403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:39.673879 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 629/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:39.679763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.777987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64322456-13d2-42e3-b21d-cc0920197eaa None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.810350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.810963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.811237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.811504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.821691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.823115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:39.837295 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:39.838389 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:39.839669 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:39.839669 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:39.839669 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:39.839669 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 640/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:39.844101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:39.940460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022afd8-ea4f-40a6-b79e-ccd3277733ea None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:39.973854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:39.974446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:39.974724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:39.974993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:39.975622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:39.975921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:39.977315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:39.989228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 630/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:39.994900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:40.026386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:40.097661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f706e75-ee26-4259-9635-8808941ce579 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:40.131565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:40.132179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:40.132452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:40.132715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:40.139317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:40.140751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:40.152502 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:40.153623 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:40.154584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 641/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:40.159478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:40.228421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:40.271686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9d7f-9e0f-474c-8292-6434bbf17c0a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:40.304846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:40.305473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:40.305748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:40.306014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:40.306690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:40.306984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:40.308402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c9952-3881-4c94-9e6c-30513edeaf75 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:40.320799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 631/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:40.326957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:40.415436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:40.424245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7ee7-fff7-45e7-a224-c57f541997e1 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:40.456702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:40.457891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:40.458165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:40.458432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] PATH_INFO: `/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/f8d91f2fd8b44f6790078a7c19984b11/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:40.460266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f7dfc41a456fa04ca6bb3a8a803e, user_id=f8d91f2fd8b44f6790078a7c19984b11, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:40.461712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c002cd2-d09a-4449-82dc-31941585db9c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:40.474068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 642/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Oct 28 09:38:40 2022] PUT /identity/v3/projects/52d3f7dfc41a456fa04ca6bb3a8a803e/users/f8d91f2fd8b44f6790078a7c19984b11/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:38:42.614179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1f8-defb-4470-8daf-0e1833609b00 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:42.614816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1f8-defb-4470-8daf-0e1833609b00 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:42.614816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1f8-defb-4470-8daf-0e1833609b00 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:42.616044 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 632/1274] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:42.621196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:42.621639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:42.621730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:42.641171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:42.642357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:42.707224 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 643/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:42.976788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89e1f8-defb-4470-8daf-0e1833609b00 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.081987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89e1f8-defb-4470-8daf-0e1833609b00 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.100758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:43.118295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.118923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.119200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.119466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.130473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:43.135527 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:43.136723 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:43.138052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 633/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Oct 28 09:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:43.143299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.242945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:43.266031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39919-3abc-4ca9-81a4-bd520001f726 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.302706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.303332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.303604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.303870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.304518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:43.304810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:43.306217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:43.314196 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 644/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:43.320193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.415778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428035a-4753-49ab-a3b9-99b8b2c289bd None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.448073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.448679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.448977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.449242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.459257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:43.460680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:43.474612 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:43.476306 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:43.478096 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:43.478096 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:43.478096 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:43.478096 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 634/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:43.481847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.580862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf633c-a905-4b6d-adc0-a9fb9f3c0959 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.616220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.616829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.617132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.617398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.618030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:43.618327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:43.619685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:43.632067 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 645/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:43.638162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.669256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:43.737554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369dbaf-92dc-4dac-8d45-7e4311fd651f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.770306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.770927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.771205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.771473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.778768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:43.780212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:38:43.791619 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:43.792746 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:43.793991 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 635/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:43.798539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:43.802351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:43.897164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fdaca-8e80-4a4b-8638-314fa449c30c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:43.931199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:43.931875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:43.932079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:43.932346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:43.933095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:43.933395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:43.934825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:43.952140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 646/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:43.957974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:44.046967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:44.056527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7a17-3e6c-4fe3-99a1-c96c9d53196a None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:44.090403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:44.091017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:44.091286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:44.091549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:44.159189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:44.160561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:44.256278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:44.267391 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 636/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Oct 28 09:38:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:44.273282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:44.335371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:44.375491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3b63a-3bdf-4991-8a28-4389d2a6d231 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:44.409546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:44.410090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:44.410365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:44.411178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:44.421030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:44.422466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:38:44.437931 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:44.439092 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:38:44.440450 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:38:44.440450 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:38:44.440450 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:44.440450 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 647/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:44.445008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:44.543410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd24d4-5934-4ce3-a3c1-f485c99112ac None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:44.577995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:44.578594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:44.578874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:44.579151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:44.579784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:44.580088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:44.581498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:44.593329 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 637/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Oct 28 09:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:44.599612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:44.698942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59eccc-b20d-4c7b-8a22-e06412564e3c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:44.712345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:44.733390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:44.734018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:44.734299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:44.734571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:44.741855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:44.743310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:38:44.754843 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:44.755939 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 09:38:44.756898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 648/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Oct 28 09:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:44.761986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:44.812300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:44.862297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a523-ba23-4462-a37e-aa65fcbcf8d5 None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:44.895863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:44.896470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:44.896748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:44.897052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:44.897729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:44.898030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:44.899442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb301f-741e-4182-bae2-cab8bd1aa7ba None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:44.912646 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 638/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Oct 28 09:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:44.919220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:45.026409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc11d-efde-42d5-8e55-ea004ef02508 None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:45.060531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:45.061160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:45.061439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:45.061706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:45.062425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] RBAC: Adding query filter params (role.id=2f6026da89244dcf8bb34fbb1d317246, scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e, user.id=f8d91f2fd8b44f6790078a7c19984b11) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:45.062730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:45.064169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a408c-f864-492e-b589-8396b74bae5d None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:45.070547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 649/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Oct 28 09:38:44 2022] GET /identity/v3/role_assignments?user.id=f8d91f2fd8b44f6790078a7c19984b11&scope.project.id=52d3f7dfc41a456fa04ca6bb3a8a803e&role.id=2f6026da89244dcf8bb34fbb1d317246 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:47.262423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519231-811b-41a1-b3cd-0f488db491dc None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:47.262987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519231-811b-41a1-b3cd-0f488db491dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:47.262987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519231-811b-41a1-b3cd-0f488db491dc None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:47.264288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 639/1288] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:47.270604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:47.271101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:47.271537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:47.290032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:47.291220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:47.321177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:47.359105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 650/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:47.628655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519231-811b-41a1-b3cd-0f488db491dc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:47.728812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519231-811b-41a1-b3cd-0f488db491dc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:47.739517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:47.763603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:47.764230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:47.764502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:47.764768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:47.765373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:47.766737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:47.776675 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:47.777944 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:47.778998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 640/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:38:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:47.784400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:47.885615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243265db-7a7c-492a-936b-84b2408bf318 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:47.918738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:47.919340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:47.919618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:47.919886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:47.920516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:47.920815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:47.922209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbae79a-6b61-458f-a9c7-44197cffbd42 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:47.927657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 651/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Oct 28 09:38:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:47.933525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:48.030947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833ab78-f79c-483e-9f50-c8ed7e2f656d None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:48.063900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:48.064500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:48.064778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:48.065075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:48.065702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:48.066004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:48.067935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb148-2afb-45e6-98bf-931adb866516 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:48.072543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 641/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Oct 28 09:38:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:50.222763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d3c5b-fb7e-4588-83f5-c56958f53432 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:50.223344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d3c5b-fb7e-4588-83f5-c56958f53432 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:50.223344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d3c5b-fb7e-4588-83f5-c56958f53432 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:50.225220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 652/1293] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:50.230487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc503d0-adb7-473f-a144-84eb95b844a6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:50.230900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc503d0-adb7-473f-a144-84eb95b844a6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:50.231273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc503d0-adb7-473f-a144-84eb95b844a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:50.249052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4dc503d0-adb7-473f-a144-84eb95b844a6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:50.250229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4dc503d0-adb7-473f-a144-84eb95b844a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:50.281641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:50.319446 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 642/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:50.588467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d3c5b-fb7e-4588-83f5-c56958f53432 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:50.619650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:50.724882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d3c5b-fb7e-4588-83f5-c56958f53432 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:50.759279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:50.759879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:50.760156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:50.760426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:50.761113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:50.762489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79ed84-2059-47c4-9820-2b2b89dc94ec None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:50.778614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 653/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Oct 28 09:38:50 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:38:52.921088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3b8ac-e199-4850-bde0-690f31b0aaa3 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:52.921602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3b8ac-e199-4850-bde0-690f31b0aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:52.921602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3b8ac-e199-4850-bde0-690f31b0aaa3 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:52.922964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 643/1296] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:52.928203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:52.928638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:52.928741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:52.947868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:52.949204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:53.019578 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 654/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:53.283836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3b8ac-e199-4850-bde0-690f31b0aaa3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:53.384119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3b8ac-e199-4850-bde0-690f31b0aaa3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:53.417740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:53.418370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:53.418645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:53.418914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:53.419489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:53.420862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:53.430275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:53.431281 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:53.432162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 644/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:38:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:53.437422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:53.455167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:53.536931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658240c-1673-4b9c-8a36-1f0046a5faa4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:53.570970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:53.571602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:53.571880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:53.572150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:53.572808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:53.573146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:53.574563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:53.581773 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 655/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Oct 28 09:38:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:53.586929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:53.622056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:53.693942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fc11-c0fd-4be2-a66e-b1f0d7b0c53f None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:53.727590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:53.728195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:53.728472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:53.728738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:53.729456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] RBAC: Adding query filter params (interface=public, service_id=682fd83e43b2437d994fd8527954ce2f, region_id=RegionOne) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:53.729762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:53.731118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cee03-52ea-4a27-aa7d-cbdb920c6d66 None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:53.736420 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 645/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Oct 28 09:38:53 2022] GET /identity/v3/endpoints?service_id=682fd83e43b2437d994fd8527954ce2f&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:53.742770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:53.825273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:53.844067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2055b2-3b63-4603-8219-6a8b67e5175c None admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:53.878607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:53.879223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:53.879496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:53.879765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:53.880529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:53.881938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af5bc-8d9d-4b11-b025-834afc76739b None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:53.888789 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 656/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Oct 28 09:38:53 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:38:56.041617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67e2-b45c-4902-a32b-057609b7c755 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:56.042192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67e2-b45c-4902-a32b-057609b7c755 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:56.042192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67e2-b45c-4902-a32b-057609b7c755 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:56.043495 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 646/1302] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:56.049063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:56.049535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:56.049630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:56.068655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:56.069889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:56.135192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 657/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:56.407447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b67e2-b45c-4902-a32b-057609b7c755 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:56.500893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:56.508182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b67e2-b45c-4902-a32b-057609b7c755 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:56.541524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:56.542149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:56.542428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:56.542697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:56.543275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:56.544628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:56.553973 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:56.555171 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 09:38:56.556431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 647/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Oct 28 09:38:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:56.561127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:56.638514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:56.662136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb6ed-2d85-4b05-ad92-b35fbbb99ed2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:56.695970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:56.696574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:56.696842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:56.697137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:56.697748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:56.698042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:56.699397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c612dfe-a065-4195-ba16-14338a5c9c16 None admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:56.704391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 658/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Oct 28 09:38:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:56.710334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:56.808355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f3fb-1212-48fb-a148-57b4146f680c None admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:56.842094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:56.842716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:56.842995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:56.843263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:56.843946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:56.845426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd00d-0d9b-4e71-bafd-5b9db5d30e5c None admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:56.869046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 648/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:38:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:39:06.701880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=30 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:06.863678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:02.858614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae6dd-e39e-4b88-a0da-9ca4a3885cd2 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:02.859140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae6dd-e39e-4b88-a0da-9ca4a3885cd2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:02.859140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae6dd-e39e-4b88-a0da-9ca4a3885cd2 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:02.864367 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 659/1307] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:02.866364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c66-ae82-49c5-a2cc-921c22953a15 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:02.866898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c66-ae82-49c5-a2cc-921c22953a15 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:02.867291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140c66-ae82-49c5-a2cc-921c22953a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:02.987690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-be140c66-ae82-49c5-a2cc-921c22953a15 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:02.989483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be140c66-ae82-49c5-a2cc-921c22953a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:03.131763 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 649/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:03.438957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:03.439239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:03.439508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:03.440939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 660/1309] 10.222.0.16 () {54 vars in 964 bytes} [Fri Oct 28 09:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:03.447949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef4fd-d2c0-454f-8173-650f80439ca5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:03.448392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef4fd-d2c0-454f-8173-650f80439ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:03.448777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef4fd-d2c0-454f-8173-650f80439ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:03.535392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-555ef4fd-d2c0-454f-8173-650f80439ca5 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:03.536761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-555ef4fd-d2c0-454f-8173-650f80439ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:03.560136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:03.627591 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 650/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Oct 28 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:03.637534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:03.639633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:03.755346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b4ba-cabb-4edf-9d7b-471c2c1ee6ba None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:03.832115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:03.832897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:03.833308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:03.833688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:03.835402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:03.909481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:03.969766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:03.971382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b15b5-d960-466b-82b8-38606bc4b301 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:03.991592 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 661/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:06.460999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:06.461533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:06.461533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:06.462826 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 651/1312] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:06.468390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d10f5-72b4-40df-b1b2-e7ac2236beff None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:06.468838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d10f5-72b4-40df-b1b2-e7ac2236beff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:06.469102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d10f5-72b4-40df-b1b2-e7ac2236beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:06.543853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f98d10f5-72b4-40df-b1b2-e7ac2236beff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:06.545025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f98d10f5-72b4-40df-b1b2-e7ac2236beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:06.657733 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 662/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:06.944385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:06.945972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:07.053797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76902e7-f438-4ae1-b6a9-d5836806c8ff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:07.133255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:07.135899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:07.136557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:07.137632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:07.138129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:07.140008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:07.252789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:07.254526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825df2e-e8a3-4600-ade2-469157a7dc5f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:07.274854 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 652/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:09.747275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:09.747815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:09.747815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:09.749160 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 663/1315] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:09.754445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946c24-00ee-4d84-a91e-6abfc95afae6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:09.754917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946c24-00ee-4d84-a91e-6abfc95afae6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:09.755024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946c24-00ee-4d84-a91e-6abfc95afae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:09.820128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ae946c24-00ee-4d84-a91e-6abfc95afae6 None None] MFA Rules not processed for user `a4535d070e134ce68ed8ab7ee4c3c88a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:09.821359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae946c24-00ee-4d84-a91e-6abfc95afae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:09.873099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:09.931160 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 653/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:10.211964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:10.213509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:10.223691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:10.316554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ec56-946b-4bee-8e95-2542e0e1ed8f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:10.390461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:10.391058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:10.391325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:10.391586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:10.393172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:10.453640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:10.502359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:10.503973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061888f5-322b-48e4-b6b9-aaab87210921 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:10.522601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 664/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:13.196777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:13.197486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:13.197486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:13.198721 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 654/1318] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:13.204662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4513b-db01-4f4d-92e4-843d880f9b51 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:13.205179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4513b-db01-4f4d-92e4-843d880f9b51 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:13.205285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4513b-db01-4f4d-92e4-843d880f9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:13.272772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d3d4513b-db01-4f4d-92e4-843d880f9b51 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:13.274002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3d4513b-db01-4f4d-92e4-843d880f9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:13.370576 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 665/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:13.651320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:13.653367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:13.763905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92317a2e-92ed-4c18-bf33-9ab09ea9e1ee None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:13.837927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:13.838432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:13.838706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:13.838969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:13.840625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:13.847470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:13.947255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:13.948679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173958e-d871-4c9a-b859-7a2259ef1239 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:13.967920 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 655/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:16.841923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:16.842467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:16.842467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:16.843760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 666/1321] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:16.849275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776913-6d6d-44dd-b615-51d23e74531e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:16.849762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776913-6d6d-44dd-b615-51d23e74531e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:16.849879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776913-6d6d-44dd-b615-51d23e74531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:16.920295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9776913-6d6d-44dd-b615-51d23e74531e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:16.921536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9776913-6d6d-44dd-b615-51d23e74531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:16.988030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:17.033941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 656/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:17.318662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:17.320215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:17.341278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:17.427700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d615e42-64d7-472c-aa79-ec3deaa96195 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:17.505600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:17.506180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:17.506448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:17.506707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:17.508276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:17.587277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:17.632577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:17.634088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a182e-3353-4340-8c3e-46cdb5aa8b79 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:17.656585 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 667/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:19.905487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:19.906024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:19.906024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:19.907422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 657/1324] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:19.912979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c946d-78fd-47e9-aa2e-09703305088d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:19.913450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c946d-78fd-47e9-aa2e-09703305088d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:19.913559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c946d-78fd-47e9-aa2e-09703305088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:19.980735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7e4c946d-78fd-47e9-aa2e-09703305088d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:19.982533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e4c946d-78fd-47e9-aa2e-09703305088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:20.090841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 668/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:20.371309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:20.373498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:20.479329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab2f3-85a0-487d-ab5e-1fa25029811b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:20.557803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:20.558423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:20.558696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:20.558960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:20.560668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:20.583491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:20.686233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:20.687673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1e16-9d53-4483-872c-4e9b5256e837 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:20.706900 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 658/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:22.941714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2763ed-3d71-4a85-ba06-6893d2784742 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:22.942279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2763ed-3d71-4a85-ba06-6893d2784742 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:22.942279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2763ed-3d71-4a85-ba06-6893d2784742 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:22.943589 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 669/1327] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:22.949066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311f7b-8be0-4061-84da-54161612e741 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:22.949483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311f7b-8be0-4061-84da-54161612e741 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:22.949576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311f7b-8be0-4061-84da-54161612e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:23.018870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-45311f7b-8be0-4061-84da-54161612e741 None None] MFA Rules not processed for user `a4535d070e134ce68ed8ab7ee4c3c88a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:23.020074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45311f7b-8be0-4061-84da-54161612e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:23.085783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:23.120498 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 659/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:23.425040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:23.425324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:23.425590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:23.426982 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 670/1329] 10.222.0.16 () {54 vars in 964 bytes} [Fri Oct 28 09:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:23.433324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc06b-a813-42e2-b0ed-d009740faca3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:23.433616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc06b-a813-42e2-b0ed-d009740faca3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:23.433882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc06b-a813-42e2-b0ed-d009740faca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:23.516437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-24fcc06b-a813-42e2-b0ed-d009740faca3 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:23.517890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24fcc06b-a813-42e2-b0ed-d009740faca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:23.603218 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 660/1330] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Oct 28 09:40:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:23.613382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:23.614957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:23.649180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:23.723713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25f7bf-5226-4cbc-ae7f-c3539df85bc0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:23.798481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:23.799086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:23.799353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:23.799618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:23.801222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:23.894032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:23.929318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:23.930766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd65e6-8a12-4209-9e95-29e7c8b1fde6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:23.950359 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 671/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:26.770973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:26.771536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:26.771536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:26.772878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 661/1332] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:26.778381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf84f0-7a0d-49c9-ae79-7dbb80f8f14c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:26.778901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf84f0-7a0d-49c9-ae79-7dbb80f8f14c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:26.778901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf84f0-7a0d-49c9-ae79-7dbb80f8f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:26.850129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dabf84f0-7a0d-49c9-ae79-7dbb80f8f14c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:26.851241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dabf84f0-7a0d-49c9-ae79-7dbb80f8f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:26.947052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 672/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:27.229392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:27.230931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:27.303700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:27.338144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20dfd3-7586-4921-9ff6-fb08b5d9a250 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:27.411071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:27.411675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:27.411952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:27.412220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:27.413867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:27.520971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:27.522313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f88a5-4464-4d46-ad72-932d6be8fe79 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:27.532762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:27.541070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 662/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:29.747335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:29.747870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:29.747985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:29.749271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 673/1335] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:29.754611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77f60-233c-4079-80f5-8919ca1695a1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:29.755057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77f60-233c-4079-80f5-8919ca1695a1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:29.755155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77f60-233c-4079-80f5-8919ca1695a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:29.822615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-00b77f60-233c-4079-80f5-8919ca1695a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:29.823836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-00b77f60-233c-4079-80f5-8919ca1695a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:29.919121 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 663/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:30.206949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:30.208470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:30.248828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:30.311862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684b52-cf6a-44ad-ad93-e82c7861f2bc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:30.384303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:30.384928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:30.385200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:30.385463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:30.387035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:30.469902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:30.495269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:30.496691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318ac1-0e96-460d-a2bd-89309f8c2792 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:30.514619 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 674/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:33.171248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:33.171826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:33.171826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:33.173231 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 664/1338] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:33.178621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922dc9-7c64-4d4e-9a02-7946b591d236 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:33.179057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922dc9-7c64-4d4e-9a02-7946b591d236 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:33.179153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922dc9-7c64-4d4e-9a02-7946b591d236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:33.248079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-77922dc9-7c64-4d4e-9a02-7946b591d236 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:33.250014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77922dc9-7c64-4d4e-9a02-7946b591d236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:33.344562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 675/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:33.624382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:33.626059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:33.704295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:33.731619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2567a9d-f82d-4b55-88b0-122eb15e7720 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:33.804221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:33.804820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:33.805206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:33.805473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:33.807078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:33.914181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:33.915619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc417-f811-4197-a343-68e40f69c233 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:33.933750 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 665/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:38.059493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:38.060024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:38.060024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:38.061590 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 676/1341] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:38.066776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bb6d-8276-4f7b-9e18-9da7c82ab433 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:38.067200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bb6d-8276-4f7b-9e18-9da7c82ab433 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:38.067290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bb6d-8276-4f7b-9e18-9da7c82ab433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:38.073251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:38.142261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8d99bb6d-8276-4f7b-9e18-9da7c82ab433 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:38.143363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d99bb6d-8276-4f7b-9e18-9da7c82ab433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:38.244731 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 666/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:38.528217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:38.529795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:38.580000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:38.640058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cf665-577f-438e-abb4-5ad0411549c1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:38.716547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:38.717185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:38.717463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:38.717761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:38.719365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:38.819404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:38.837110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:38.838555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fbf15-0f5f-4c31-8f23-39460394078c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:38.857358 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 677/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:41.597100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:41.597612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:41.597612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:41.598981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 667/1344] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:41.604198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21326-e097-443a-b7eb-996f9e5401f1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:41.604626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21326-e097-443a-b7eb-996f9e5401f1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:41.604737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21326-e097-443a-b7eb-996f9e5401f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:41.674888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a3e21326-e097-443a-b7eb-996f9e5401f1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:41.676081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a3e21326-e097-443a-b7eb-996f9e5401f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:41.771648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 678/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:42.053983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:42.055596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:42.148553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:42.167595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b147b8-eee4-4b06-af0c-b027a2e9e35a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:42.250114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:42.250716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:42.250986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:42.251247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:42.252830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:42.367726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:42.369089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba56b-ce28-4c8c-aed7-67d67dbc3811 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:42.387389 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 668/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:46.665701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:46.666292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:46.666292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:46.667596 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 679/1347] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:46.673434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb9ed-87c8-4151-8dfc-b631ac7bbe84 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:46.673976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb9ed-87c8-4151-8dfc-b631ac7bbe84 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:46.673976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb9ed-87c8-4151-8dfc-b631ac7bbe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:46.691190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:46.748936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ee3bb9ed-87c8-4151-8dfc-b631ac7bbe84 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:46.750719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ee3bb9ed-87c8-4151-8dfc-b631ac7bbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:46.859689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 669/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:47.148694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:47.150255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:47.210392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:47.258671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53453-7564-4966-90b2-e13d61041382 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:47.332557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:47.333202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:47.333481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:47.333736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:47.335333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:47.442281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:47.446702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:47.448163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceac385-6f21-4d5f-8542-86ae14ab32ad service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:47.467097 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 680/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:52.413007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ea21-6d97-4cb3-bc2b-d83c357a0a81 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:52.414245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ea21-6d97-4cb3-bc2b-d83c357a0a81 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:52.414245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ea21-6d97-4cb3-bc2b-d83c357a0a81 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:52.415920 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 670/1350] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:52.422107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615459e-b31e-4adf-9b41-c7be237095b9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:52.422107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615459e-b31e-4adf-9b41-c7be237095b9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:52.422107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615459e-b31e-4adf-9b41-c7be237095b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:52.537474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5615459e-b31e-4adf-9b41-c7be237095b9 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:52.538917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5615459e-b31e-4adf-9b41-c7be237095b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:52.736929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 681/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:56.857749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=59 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:57.191108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25646ee-3b70-4aa9-ba9d-ab21c085b745 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:57.191626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25646ee-3b70-4aa9-ba9d-ab21c085b745 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:57.191917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25646ee-3b70-4aa9-ba9d-ab21c085b745 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:57.193324 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 671/1352] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:57.199861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e61a-4c15-42cd-a16c-775c0cc88a58 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:57.200410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e61a-4c15-42cd-a16c-775c0cc88a58 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:57.200493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e61a-4c15-42cd-a16c-775c0cc88a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:57.270822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:57.299914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5b73e61a-4c15-42cd-a16c-775c0cc88a58 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:57.301546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5b73e61a-4c15-42cd-a16c-775c0cc88a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:57.421518 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 682/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:58.487290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca892f-b174-49bf-813e-dba75785b0ed None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:58.487837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca892f-b174-49bf-813e-dba75785b0ed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:58.487837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca892f-b174-49bf-813e-dba75785b0ed None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:58.489238 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 672/1354] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:58.494834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabab4-e07d-4be1-b799-d5d04ad659cb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:58.495291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabab4-e07d-4be1-b799-d5d04ad659cb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:58.495384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabab4-e07d-4be1-b799-d5d04ad659cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:58.577237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-31aabab4-e07d-4be1-b799-d5d04ad659cb None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:58.578449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31aabab4-e07d-4be1-b799-d5d04ad659cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:58.627750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:58.700816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 683/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:02.416804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75ed6-d6c7-4e8d-a15d-6f49523bfa88 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:02.418669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75ed6-d6c7-4e8d-a15d-6f49523bfa88 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:02.419094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75ed6-d6c7-4e8d-a15d-6f49523bfa88 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:02.422399 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 673/1356] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:02.428322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228a902-84f0-41a0-8281-e206b67e4144 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:02.429247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228a902-84f0-41a0-8281-e206b67e4144 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:02.429787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228a902-84f0-41a0-8281-e206b67e4144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:02.515332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7228a902-84f0-41a0-8281-e206b67e4144 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:02.516735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7228a902-84f0-41a0-8281-e206b67e4144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:02.637078 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 684/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:02.957692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:02.957982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:02.958213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:02.959795 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 674/1358] 10.222.0.16 () {54 vars in 960 bytes} [Fri Oct 28 09:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:02.966081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b636-87c3-4bf2-9c53-c8f7dbda2101 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:02.966997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b636-87c3-4bf2-9c53-c8f7dbda2101 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:02.967450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b636-87c3-4bf2-9c53-c8f7dbda2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:02.985723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:03.069536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-14a4b636-87c3-4bf2-9c53-c8f7dbda2101 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:03.070845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-14a4b636-87c3-4bf2-9c53-c8f7dbda2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:03.237009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 685/1359] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 09:41:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:03.245854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:03.247810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:03.413818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e26e3-7f51-4e21-954c-8d78ba00323e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:03.493176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:03.547309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:03.548132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:03.548526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:03.548896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:03.550832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:03.662597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:03.664568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d84631-3396-4d29-82b1-b5ada89bbc94 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:03.687019 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 675/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:06.184306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:06.185221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:06.185221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:06.186300 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 686/1361] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:06.191933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28ae1-1392-4c5b-9c17-039a681c73e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:06.192453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28ae1-1392-4c5b-9c17-039a681c73e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:06.192453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28ae1-1392-4c5b-9c17-039a681c73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:06.279766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-28c28ae1-1392-4c5b-9c17-039a681c73e9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:06.281112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-28c28ae1-1392-4c5b-9c17-039a681c73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:06.322734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:06.393410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 676/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:06.690583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:06.692120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:06.767876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:06.877544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56ae1-6904-42fb-a35b-dba0795cc0ff None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:07.034909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:07.035606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:07.035983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:07.036177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:07.037820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:07.064329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:07.153439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:07.155064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce604-3df8-4ef7-a5ea-362d1ed4943d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:07.174370 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 687/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:09.714957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa516-5181-4fde-a49a-a1c6c6331a76 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:09.715485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa516-5181-4fde-a49a-a1c6c6331a76 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:09.715485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa516-5181-4fde-a49a-a1c6c6331a76 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:09.716848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 677/1364] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:09.722526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedb5c-5f2f-4279-a87b-fcc42aa64b52 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:09.723313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedb5c-5f2f-4279-a87b-fcc42aa64b52 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:09.723587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedb5c-5f2f-4279-a87b-fcc42aa64b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:09.793344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-08aedb5c-5f2f-4279-a87b-fcc42aa64b52 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:09.794568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08aedb5c-5f2f-4279-a87b-fcc42aa64b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:09.911185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:09.912959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 688/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:10.222842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:10.223129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:10.223395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:10.225568 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 678/1366] 10.222.0.16 () {54 vars in 960 bytes} [Fri Oct 28 09:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:10.232269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291913bc-bb4a-4823-a05c-8ecdb0c536ab None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:10.232669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291913bc-bb4a-4823-a05c-8ecdb0c536ab None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:10.233076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291913bc-bb4a-4823-a05c-8ecdb0c536ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:10.324896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-291913bc-bb4a-4823-a05c-8ecdb0c536ab None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:10.326356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-291913bc-bb4a-4823-a05c-8ecdb0c536ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:10.485018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 689/1367] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 09:41:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:10.494445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:10.496000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:10.700084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc704d8-7e51-440d-a307-a2dd1dddc79d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:10.727007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:10.869317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:10.869975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:10.870297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:10.870919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:10.872327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:10.994154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:10.996079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e768de7-81eb-4c73-95df-b4986b8f84ab service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:11.022026 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 679/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:13.490891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:13.491964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:13.492459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:13.498735 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 690/1369] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:13.500190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e9f9-e7cf-4a00-873a-f1a431254870 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:13.501273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e9f9-e7cf-4a00-873a-f1a431254870 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:13.501712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e9f9-e7cf-4a00-873a-f1a431254870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:13.544277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:13.601419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-67c7e9f9-e7cf-4a00-873a-f1a431254870 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:13.603075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67c7e9f9-e7cf-4a00-873a-f1a431254870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:13.730652 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 680/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:14.093963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:14.096485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:14.193345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:14.325877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc55a1-6e3c-4c3b-89bd-17762041691c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:14.557168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:14.558247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:14.558721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:14.559269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:14.562932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:14.592366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:14.741686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:14.743540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50f21c-b786-42dc-ad03-c43dabe166ea service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:14.767195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 691/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:14.800079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7508-fc2b-4e06-acf6-2e28b5c00aa9 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:14.801770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7508-fc2b-4e06-acf6-2e28b5c00aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:14.802464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7508-fc2b-4e06-acf6-2e28b5c00aa9 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:14.804848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 681/1372] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:14.812141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f282-99ae-4e84-8a5a-c5b0d68d0987 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:14.812141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f282-99ae-4e84-8a5a-c5b0d68d0987 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:14.812141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f282-99ae-4e84-8a5a-c5b0d68d0987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:14.900711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f804f282-99ae-4e84-8a5a-c5b0d68d0987 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:14.902359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f804f282-99ae-4e84-8a5a-c5b0d68d0987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:15.003344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:15.027288 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 692/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:15.373822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:15.373822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:15.373822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:15.375439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 682/1374] 10.222.0.16 () {54 vars in 957 bytes} [Fri Oct 28 09:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:15.380919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085a48-f4cb-4f37-96ca-c9785e62780b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:15.381429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085a48-f4cb-4f37-96ca-c9785e62780b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:15.381633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085a48-f4cb-4f37-96ca-c9785e62780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:15.464503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e5085a48-f4cb-4f37-96ca-c9785e62780b None None] MFA Rules not processed for user `95ff200fd16445debdaa322bf2123ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:15.465743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e5085a48-f4cb-4f37-96ca-c9785e62780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:15.549640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 693/1375] 10.222.0.16 () {58 vars in 1054 bytes} [Fri Oct 28 09:41:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:15.557801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:15.559324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:15.683617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ae707-21d6-4555-b7c6-1ac3f86d6cf3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:15.687780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:15.768507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:15.769149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:15.769426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:15.769692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:15.771836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:15.893004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:15.894598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f539d-2d0b-48b6-934d-75465e3499d8 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:15.916878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 683/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:17.174378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382326-6268-4297-be65-9be9a583de93 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:17.175280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382326-6268-4297-be65-9be9a583de93 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:17.175685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382326-6268-4297-be65-9be9a583de93 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:17.177287 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 694/1377] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:17.187559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fab7b-ede1-47c9-b3e3-1bf1e41f3a6b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:17.187559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fab7b-ede1-47c9-b3e3-1bf1e41f3a6b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:17.187559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fab7b-ede1-47c9-b3e3-1bf1e41f3a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:17.248197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:17.276523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e01fab7b-ede1-47c9-b3e3-1bf1e41f3a6b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:17.277942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e01fab7b-ede1-47c9-b3e3-1bf1e41f3a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:17.413056 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 684/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:17.708799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a382326-6268-4297-be65-9be9a583de93 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:17.710404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a382326-6268-4297-be65-9be9a583de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:17.823068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:17.929150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a382326-6268-4297-be65-9be9a583de93 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:18.093591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:18.094701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:18.095181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:18.095646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:18.098885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:18.165029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:18.252266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:18.258015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381050-56f3-4727-bcd1-cf714b68f8d3 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:18.293585 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 695/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:20.662871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:20.663945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:20.664616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:20.671131 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 685/1380] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:20.672500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702e5c-b079-46a2-99ca-6cb2254b0e36 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:20.672985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702e5c-b079-46a2-99ca-6cb2254b0e36 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:20.673097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702e5c-b079-46a2-99ca-6cb2254b0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:20.754064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1f702e5c-b079-46a2-99ca-6cb2254b0e36 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:20.756090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f702e5c-b079-46a2-99ca-6cb2254b0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:20.874197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 696/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:21.164780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:21.166100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:21.308186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:21.356473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000d11e-b284-45a3-82cb-5fdce2552573 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:21.537320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:21.538233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:21.538618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:21.538997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:21.541459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:21.672383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:21.693409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:21.695727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303aca9-924b-476e-a1e5-6735df2a99ad service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:21.721476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 686/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:24.054657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:24.054657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:24.056747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:24.056747 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 697/1383] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:24.064284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770973fe-c847-41b6-8c5a-e718143471a8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:24.066994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770973fe-c847-41b6-8c5a-e718143471a8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:24.066994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770973fe-c847-41b6-8c5a-e718143471a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:24.203576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-770973fe-c847-41b6-8c5a-e718143471a8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:24.205920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-770973fe-c847-41b6-8c5a-e718143471a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:24.323274 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 687/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:24.623788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:24.625555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:24.648004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:24.798253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791249f-4c5c-44f6-90c3-c7ad9923d768 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:24.914124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:24.942802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:24.943523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:24.943863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:24.945205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:24.947353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:25.042789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:25.044403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43cba8-9280-4fe6-951e-0aba6e1581ff service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:25.064524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 698/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:27.308883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:27.309499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:27.309845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:27.311783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 688/1386] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:27.319151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73310-1166-43a9-805b-966a1167ad91 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:27.319864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73310-1166-43a9-805b-966a1167ad91 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:27.319864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73310-1166-43a9-805b-966a1167ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:27.401027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ae73310-1166-43a9-805b-966a1167ad91 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:27.402796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ae73310-1166-43a9-805b-966a1167ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:27.469564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:27.529282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 699/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:27.890079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:27.891704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:27.962896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:28.074050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa11f2-90e4-4d19-a3f5-c765f34fb11f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:28.211283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:28.212103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:28.212442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:28.212718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:28.215176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:28.232248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:28.343289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:28.345110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5362-c952-4481-96d8-92da908506f7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:28.367545 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 689/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:30.626355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:30.626985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:30.626985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:30.628225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 700/1389] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:30.633592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992505-4ae8-4047-aec2-7dd70d769a1f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:30.634382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992505-4ae8-4047-aec2-7dd70d769a1f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:30.634382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b992505-4ae8-4047-aec2-7dd70d769a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:30.706661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8b992505-4ae8-4047-aec2-7dd70d769a1f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:30.708061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8b992505-4ae8-4047-aec2-7dd70d769a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:30.798389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:30.810653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 690/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:31.100057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:31.102311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:31.268827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8eef-460c-4112-85fe-1a8e82ab79d8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:31.309091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:31.388968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:31.389502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:31.389772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:31.390034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:31.391619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:31.485085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:31.486698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03cff0-726f-43f1-a845-68f588b34fff service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:31.506145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 701/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:31.961128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112fea4-6b95-4ed1-9a0a-ae5340618a83 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:31.961716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112fea4-6b95-4ed1-9a0a-ae5340618a83 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:31.961716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112fea4-6b95-4ed1-9a0a-ae5340618a83 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:31.963136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 691/1392] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:31.969564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891ca4-0c40-4213-b43a-5f3479162953 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:31.970086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891ca4-0c40-4213-b43a-5f3479162953 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:31.970086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891ca4-0c40-4213-b43a-5f3479162953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.025055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:32.040704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-39891ca4-0c40-4213-b43a-5f3479162953 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:32.042007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-39891ca4-0c40-4213-b43a-5f3479162953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.141205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 702/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:32.446018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.446297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.446569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.448531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 692/1394] 10.222.0.16 () {54 vars in 962 bytes} [Fri Oct 28 09:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:32.454178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42570d-276e-4368-96cd-01b66b382d3b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.454545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42570d-276e-4368-96cd-01b66b382d3b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.454826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42570d-276e-4368-96cd-01b66b382d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.534216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8b42570d-276e-4368-96cd-01b66b382d3b None None] MFA Rules not processed for user `b6f23fb45ed14020a6d15f834881d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:32.535347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8b42570d-276e-4368-96cd-01b66b382d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.608154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:32.628194 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 703/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Oct 28 09:41:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:32.638280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:32.639793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.751071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b241-ea82-4184-8018-65b52956a92b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:32.827842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:32.828364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.828642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.828934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.830545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.991624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:33.069433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:33.071311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684976f-1cf8-4615-9b52-18106f45ce9a service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:33.094067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 693/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:33.736443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb545-70a8-48a2-8343-2282ff5a82a2 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:33.737035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb545-70a8-48a2-8343-2282ff5a82a2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:33.737035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb545-70a8-48a2-8343-2282ff5a82a2 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:33.738322 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 704/1397] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:33.744421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd40f-a721-4a7d-80ea-4501a885ebc7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:33.744704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd40f-a721-4a7d-80ea-4501a885ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:33.745011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd40f-a721-4a7d-80ea-4501a885ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:33.813661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-581dd40f-a721-4a7d-80ea-4501a885ebc7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:33.814899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-581dd40f-a721-4a7d-80ea-4501a885ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:33.852965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097761-15a9-4180-8fe7-c62c25af0b45 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:33.853311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097761-15a9-4180-8fe7-c62c25af0b45 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:33.853585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097761-15a9-4180-8fe7-c62c25af0b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:33.917769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:33.920342 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 694/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:33.921009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4f097761-15a9-4180-8fe7-c62c25af0b45 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:33.922212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4f097761-15a9-4180-8fe7-c62c25af0b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.010580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 705/1399] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:41:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:34.051876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.052400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.052573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.054106 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 695/1400] 10.222.0.16 () {54 vars in 943 bytes} [Fri Oct 28 09:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:34.061385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.061765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.061929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.142136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] MFA Rules not processed for user `35c19dc65ad64a8eaa5d0f64e7e14079`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:34.143358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.165587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.215275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:34.216855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.266085 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 706/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Fri Oct 28 09:41:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:34.276183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:34.285916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad391cc-6d63-4424-97bb-5aca4072c946 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:34.370752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e44d79-54c0-46c0-a3e6-1798c4d64ece None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:34.396555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:34.397189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.397461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.397724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.399440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.427639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.454774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.493509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:34.495131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480adfe-4a9e-4033-a3be-e0f864bf3fab service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:34.501825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259581-dac7-4723-bc24-495b87202193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:34.502430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259581-dac7-4723-bc24-495b87202193 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.502801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259581-dac7-4723-bc24-495b87202193 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.503208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259581-dac7-4723-bc24-495b87202193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.503622 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 707/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:41:34.504822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73259581-dac7-4723-bc24-495b87202193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.612497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259581-dac7-4723-bc24-495b87202193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:34.614748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259581-dac7-4723-bc24-495b87202193 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:34.644662 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 696/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:36.933999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:36.934540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:36.934540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:36.936237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 708/1404] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:36.941141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed229a-5932-4d4b-84a6-695057d160b9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:36.941569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed229a-5932-4d4b-84a6-695057d160b9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:36.941741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed229a-5932-4d4b-84a6-695057d160b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:37.014563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-feed229a-5932-4d4b-84a6-695057d160b9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:37.015783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-feed229a-5932-4d4b-84a6-695057d160b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:37.057522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:37.124964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 697/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:37.418778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:37.420401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:37.587520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c315a-34e6-43cb-af9e-b6190b2abca9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:37.609417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:37.713265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:37.713791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:37.714066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:37.714333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:37.716006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:37.819409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:37.821085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698b121-8b82-4014-8fc3-5dc5110cb0ae service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:37.840189 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 709/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:40.065227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:40.065828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:40.066088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:40.068951 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 698/1407] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:40.073164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17c111-335c-4905-8fd0-be4b0c40fbbe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:40.073572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17c111-335c-4905-8fd0-be4b0c40fbbe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:40.073742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17c111-335c-4905-8fd0-be4b0c40fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:40.107103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:40.147480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ec17c111-335c-4905-8fd0-be4b0c40fbbe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:40.148718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ec17c111-335c-4905-8fd0-be4b0c40fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:40.268962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 710/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:40.551677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:40.553398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:40.734847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c5f0-746c-41bb-b900-43bdd9d3474b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:40.757016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:40.862481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:40.863354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:40.863808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:40.864240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:40.865892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:40.967710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:40.969498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ca8b0-cb52-4143-979f-f30d459fc193 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:40.994004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 699/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:50.260283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=54 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:50.990772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:58.061857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d249e-0bc3-4952-a141-74995a9111c8 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.062440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d249e-0bc3-4952-a141-74995a9111c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.062440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d249e-0bc3-4952-a141-74995a9111c8 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.063741 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 711/1410] 10.222.0.16 () {54 vars in 918 bytes} [Fri Oct 28 09:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:58.068828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e2b2f-8e1f-472a-baa2-a37d116930b0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.069335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e2b2f-8e1f-472a-baa2-a37d116930b0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.069437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e2b2f-8e1f-472a-baa2-a37d116930b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.145384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9e7e2b2f-8e1f-472a-baa2-a37d116930b0 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:58.146594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9e7e2b2f-8e1f-472a-baa2-a37d116930b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:58.253041 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 700/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Oct 28 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:58.267776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89791-54db-494e-9441-dba7f5d69ea9 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.268062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89791-54db-494e-9441-dba7f5d69ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.268350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89791-54db-494e-9441-dba7f5d69ea9 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.269707 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 712/1412] 10.222.0.16 () {54 vars in 918 bytes} [Fri Oct 28 09:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:58.274941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8baaf3-6a20-41d9-b02e-f8721992993d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.275252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8baaf3-6a20-41d9-b02e-f8721992993d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.275523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8baaf3-6a20-41d9-b02e-f8721992993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.351228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:58.353946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-da8baaf3-6a20-41d9-b02e-f8721992993d None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:58.355835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-da8baaf3-6a20-41d9-b02e-f8721992993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:58.473520 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 701/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Oct 28 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:01.029942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:01.030521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:01.030521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:01.031805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:01.037352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eeb8-abaa-4701-ad38-36f6324c11b5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:01.037786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eeb8-abaa-4701-ad38-36f6324c11b5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:01.037882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eeb8-abaa-4701-ad38-36f6324c11b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:01.104182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-10f8eeb8-abaa-4701-ad38-36f6324c11b5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:01.105970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10f8eeb8-abaa-4701-ad38-36f6324c11b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:01.159995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:01.202806 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:01.491239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:01.492748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:01.644746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da0f3c-5804-4805-bb36-378ed9cf29f4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:01.717636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:01.758202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:01.758811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:01.759093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:01.759363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:01.761548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:01.852163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:01.853764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c216c-faed-490b-97f4-9c0a5d8045af service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:01.872582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 714/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:03.022584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:03.023115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:03.023115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:03.024486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:03.031470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf568-bebd-449c-8aaf-0d21f18b8ade None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:03.031966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf568-bebd-449c-8aaf-0d21f18b8ade None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:03.032076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf568-bebd-449c-8aaf-0d21f18b8ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:03.112993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3e4bf568-bebd-449c-8aaf-0d21f18b8ade None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:03.114211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e4bf568-bebd-449c-8aaf-0d21f18b8ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:03.141940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:03.211213 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:03.373763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:03.375291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:03.520634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf057e-a71f-46d5-b326-53791934dc05 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:03.563498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:03.637424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:03.638030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:03.638306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:03.638576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:03.640166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:03.732656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:03.734249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f45e1b-744b-4f15-9195-efe9cf6f8585 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:03.751596 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 704/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:04.888182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:04.888762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:04.888762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:04.890068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:04.896786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ebf2-1c20-42ab-832c-343524767f33 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:04.897311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ebf2-1c20-42ab-832c-343524767f33 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:04.897406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ebf2-1c20-42ab-832c-343524767f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:04.954835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:04.979602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2382ebf2-1c20-42ab-832c-343524767f33 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:04.980771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2382ebf2-1c20-42ab-832c-343524767f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:05.079785 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:05.239524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:05.241016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:05.386754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80830c9e-13d8-4350-b6a2-6bc414e8690f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:05.399010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:05.500402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:05.500924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:05.501208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:05.501468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:05.503078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:05.596748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:05.598377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed380e-6789-4397-aa41-f6361b9b2c87 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:05.616432 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 717/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:06.732407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:06.732987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:06.732987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:06.734332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:06.740925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d48a-b3c8-4d4b-b0d9-07412f718a8c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:06.741386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d48a-b3c8-4d4b-b0d9-07412f718a8c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:06.741511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d48a-b3c8-4d4b-b0d9-07412f718a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:06.761491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:06.816405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ba09d48a-b3c8-4d4b-b0d9-07412f718a8c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:06.817623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba09d48a-b3c8-4d4b-b0d9-07412f718a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:06.914573 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:07.065523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:07.067324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:07.176087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:07.213737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b4d13-bac2-44bf-b9a8-644bf28d08a9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:07.326995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:07.327600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:07.327875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:07.328140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:07.329754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:07.404730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:07.418160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:07.419750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbf1f5-0c49-4382-afce-5df7da336bc9 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:07.438201 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 707/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:08.640504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:08.641136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:08.641136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:08.642409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:08.650355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a7ae-76ab-4200-9ae8-a807d55131e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:08.650881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a7ae-76ab-4200-9ae8-a807d55131e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:08.650881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a7ae-76ab-4200-9ae8-a807d55131e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:08.731609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c3e2a7ae-76ab-4200-9ae8-a807d55131e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:08.733445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3e2a7ae-76ab-4200-9ae8-a807d55131e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:08.836112 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:08.984451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:08.985991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:09.071494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:09.137511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b18823-e334-4e06-bf1d-a9fb3aacd9df None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:09.252413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:09.253080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:09.253356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:09.253623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:09.255222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:09.304863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:09.347038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:09.348638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2006ec-87b5-4728-8014-da9aa1470703 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:09.366920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 720/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:10.436933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:10.437469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:10.437469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:10.438841 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:10.445622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fbaa-55ff-45d1-a1b4-28b1f63f2574 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:10.446065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fbaa-55ff-45d1-a1b4-28b1f63f2574 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:10.446162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fbaa-55ff-45d1-a1b4-28b1f63f2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:10.522001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5284fbaa-55ff-45d1-a1b4-28b1f63f2574 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:10.523640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5284fbaa-55ff-45d1-a1b4-28b1f63f2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:10.623891 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:10.776873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:10.778327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:10.826641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:10.922819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f487f5f-9119-41ad-863d-dfebdc787c3f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:11.034475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:11.035004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:11.035277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:11.035539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:11.037153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:11.044982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:11.126972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:11.128642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6cfac-98c3-4fab-bd41-3c9c0e46dd47 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:11.146530 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 710/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:12.290101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:12.290658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:12.290943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:12.292420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:12.299286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f448a-27a6-4698-aeb2-0d6dc9c9f357 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:12.299815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f448a-27a6-4698-aeb2-0d6dc9c9f357 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:12.299941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f448a-27a6-4698-aeb2-0d6dc9c9f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:12.383247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c64f448a-27a6-4698-aeb2-0d6dc9c9f357 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:12.384851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c64f448a-27a6-4698-aeb2-0d6dc9c9f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:12.466246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:12.498153 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:12.657813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:12.660209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:12.687903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:12.821676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c1a6-0521-427b-9437-3cac0709c35d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:12.921892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:12.954204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:12.954832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:12.955102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:12.955368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:12.957350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:13.061942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:13.063596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef489266-a784-4675-9a0b-74d683cd7e5a service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:13.085102 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 723/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:14.139809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:14.140392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:14.140392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:14.141716 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:14.149580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdca35-116e-4fd2-b2cb-dc784baffded None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:14.150050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdca35-116e-4fd2-b2cb-dc784baffded None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:14.150157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdca35-116e-4fd2-b2cb-dc784baffded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:14.237373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ecdca35-116e-4fd2-b2cb-dc784baffded None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:14.239181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ecdca35-116e-4fd2-b2cb-dc784baffded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:14.285881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:14.344709 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:14.501653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:14.503204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:14.654636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a669d-9639-46cf-98b1-7969b8a6d804 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:14.711497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:14.785306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:14.786035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:14.786307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:14.786572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:14.788170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:14.883193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:14.884816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868396f7-5be1-4fc4-bf04-e2a5fbf6a26d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:14.902675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 713/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:16.000049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:16.000630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:16.000630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:16.001945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:16.008889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279578-a8ac-4ed3-b263-8998d84648e7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:16.009383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279578-a8ac-4ed3-b263-8998d84648e7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:16.009502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279578-a8ac-4ed3-b263-8998d84648e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:16.085632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-24279578-a8ac-4ed3-b263-8998d84648e7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:16.086839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24279578-a8ac-4ed3-b263-8998d84648e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:16.088849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:16.182668 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:16.329554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:16.331319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:16.476239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a3b4-79d8-4fd0-8c4e-931864181388 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:16.504557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:16.591966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:16.592577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:16.592851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:16.593223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:16.594777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:16.684122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:16.685880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f3705-7727-4f36-93ef-1b766bea3c0e service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:16.703834 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 726/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:18.767485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:18.768086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:18.768086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:18.770046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:18.775511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e53cb-0dff-4acf-9342-d4e573585534 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:18.775947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e53cb-0dff-4acf-9342-d4e573585534 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:18.776063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e53cb-0dff-4acf-9342-d4e573585534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:18.816414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:18.842195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e29e53cb-0dff-4acf-9342-d4e573585534 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:18.843327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e29e53cb-0dff-4acf-9342-d4e573585534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:18.938609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:19.225523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:19.227061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:19.330696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a01617-d51c-41c7-b85d-9253f3e53921 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:19.361901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:19.404281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:19.404871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:19.405238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:19.405503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:19.407074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:19.514549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:19.515890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b4f8-92d6-4094-aa8a-04ce82288c7d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:19.534384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 716/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:21.824842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:21.825427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:21.825427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:21.826735 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:21.832437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecbccb-083c-4785-b049-e5ef241bb974 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:21.832870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecbccb-083c-4785-b049-e5ef241bb974 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:21.833004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecbccb-083c-4785-b049-e5ef241bb974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:21.901014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48ecbccb-083c-4785-b049-e5ef241bb974 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:21.902217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48ecbccb-083c-4785-b049-e5ef241bb974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:21.915144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:22.000109 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:22.280484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:22.282052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:22.385680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4060f-7db5-44bf-87b1-e3d3bae0dfcf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:22.398828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:22.461307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:22.461911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:22.462187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:22.462456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:22.464103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:22.573451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:22.574807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88f4d8-1471-4536-9b18-4a3ab40c6b79 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:22.595178 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 729/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:25.034535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:25.035075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:25.035075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:25.036414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:25.041766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ed64-8471-4746-acb4-ad51dd101edc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:25.042207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ed64-8471-4746-acb4-ad51dd101edc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:25.042385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ed64-8471-4746-acb4-ad51dd101edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:25.091339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:25.110311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4472ed64-8471-4746-acb4-ad51dd101edc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:25.111526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4472ed64-8471-4746-acb4-ad51dd101edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:25.207113 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:25.492616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:25.494228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:25.598406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536cd9-b8e4-4037-91b3-42e4cf6f67ff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:25.639813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:25.674318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:25.674921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:25.675198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:25.675469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:25.677217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:25.790097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:25.791471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793a3e7-d82e-46f5-bf29-ad7baac1ac3e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:25.809427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 719/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:28.094573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:28.095163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:28.095163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:28.096446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:28.101949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ce16-586d-44d5-b283-84179e032ae9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:28.102364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ce16-586d-44d5-b283-84179e032ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:28.102478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ce16-586d-44d5-b283-84179e032ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:28.167693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3553ce16-586d-44d5-b283-84179e032ae9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:28.168946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3553ce16-586d-44d5-b283-84179e032ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:28.189179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:28.266771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:28.558506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:28.560046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:28.669308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b499db-e962-44e0-ae9a-07f9bdcd2362 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:28.690053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:28.742997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:28.743601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:28.743877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:28.744145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:28.745767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:28.855295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:28.856649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ec007-8f46-4bd5-8f4a-70c1112f19d5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:28.874204 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 732/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:31.066318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:31.066934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:31.066934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:31.068242 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:31.073724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705956d1-7061-4dea-aa20-bb73cd745678 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:31.074151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705956d1-7061-4dea-aa20-bb73cd745678 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:31.074274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705956d1-7061-4dea-aa20-bb73cd745678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:31.137218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:31.140292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-705956d1-7061-4dea-aa20-bb73cd745678 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:31.142087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-705956d1-7061-4dea-aa20-bb73cd745678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:31.238155 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:31.530152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:31.531699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:31.639426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d49fa9-1823-4153-9d07-aa4bbef72b26 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:31.688134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:31.713071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:31.713674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:31.713953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:31.714223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:31.715813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:31.824117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:31.825782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265fb33-df12-46cf-8432-447172247240 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:31.847675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 722/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:34.045442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:34.046056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:34.046056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:34.047337 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:34.052800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146fa0-ae80-44a2-a96a-30d59cc7a96c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:34.053398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146fa0-ae80-44a2-a96a-30d59cc7a96c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:34.053676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146fa0-ae80-44a2-a96a-30d59cc7a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:34.123803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0e146fa0-ae80-44a2-a96a-30d59cc7a96c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:34.125045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e146fa0-ae80-44a2-a96a-30d59cc7a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:34.154580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:34.221823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:34.506931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:34.508474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:34.613547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a994-ed93-49fd-ab73-0085760b521c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:34.642351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:34.692224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:34.692839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:34.693147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:34.693420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:34.695046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:34.806017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:34.807339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816dfe9-5026-4364-a570-2416d139420e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:34.825888 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 735/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:37.068038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:37.068598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:37.068598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:37.069952 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:37.076110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57d7b-5ed0-4898-add0-4f344d5ece71 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:37.076640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57d7b-5ed0-4898-add0-4f344d5ece71 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:37.076640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57d7b-5ed0-4898-add0-4f344d5ece71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:37.142250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-30a57d7b-5ed0-4898-add0-4f344d5ece71 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:37.143470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-30a57d7b-5ed0-4898-add0-4f344d5ece71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:37.151815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:37.243328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:37.530411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:37.531989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:37.640810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e377-a867-419e-bd76-6b69d381aa79 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:37.695912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:37.715010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:37.715616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:37.715896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:37.716163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:37.717779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:37.829071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:37.830419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d58a2-2a9d-4c69-9f7d-db006ee9b75a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:37.848611 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 725/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:40.075472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:40.076012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:40.076012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:40.077593 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:40.082740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2a3b-b565-40fa-9156-6a9be66738b1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:40.083177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2a3b-b565-40fa-9156-6a9be66738b1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:40.083346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2a3b-b565-40fa-9156-6a9be66738b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:40.147963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4c7d2a3b-b565-40fa-9156-6a9be66738b1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:40.149195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c7d2a3b-b565-40fa-9156-6a9be66738b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:40.187344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:40.246630 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:40.530547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:40.532054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:40.637319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ce24-f087-49ad-b655-a50b70abfb3e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:40.676839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:40.714009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:40.714615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:40.714893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:40.715157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:40.716763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:40.828134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:40.829560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d2ea-f0f5-402a-bca0-e0635a805d93 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:40.964520 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 738/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:43.134108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:43.134720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:43.134720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:43.136040 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:43.141466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396ae-9b9e-4acd-afc3-a66a37365994 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:43.141909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396ae-9b9e-4acd-afc3-a66a37365994 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:43.142017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396ae-9b9e-4acd-afc3-a66a37365994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:43.209293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-38c396ae-9b9e-4acd-afc3-a66a37365994 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:43.210397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38c396ae-9b9e-4acd-afc3-a66a37365994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:43.229769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:43.306892 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:43.589461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:43.590999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:43.695235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b6de-4511-46ae-b0b2-a69d0168be8f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:43.762944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:43.769998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:43.770625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:43.770934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:43.771203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:43.772794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:43.881326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:43.882663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7c14-20d1-4748-9f3f-d26e9aebfdb7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:43.901398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 728/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:46.081626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:46.082173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:46.082173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:46.083524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:46.089526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b3b1-ed87-47db-96a9-7730e1ae94fd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:46.090012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b3b1-ed87-47db-96a9-7730e1ae94fd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:46.090121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291b3b1-ed87-47db-96a9-7730e1ae94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:46.154602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5291b3b1-ed87-47db-96a9-7730e1ae94fd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:46.155796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5291b3b1-ed87-47db-96a9-7730e1ae94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:46.203984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:46.255032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:46.539473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:46.541603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:46.645041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471988-58fa-46b1-bd99-e62cb0c8ae76 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:46.692322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:46.718262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:46.718857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:46.719127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:46.719390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:46.721005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:46.829781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:46.831126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f29c3-9d68-437f-bd49-ae7405160152 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:46.849069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 741/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:56.253558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=22 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:56.846938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=66 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:00.629901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5800572-2479-40ac-bca2-08d78d077a05 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:00.630486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5800572-2479-40ac-bca2-08d78d077a05 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:00.630486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5800572-2479-40ac-bca2-08d78d077a05 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:00.631845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 730/1471] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:00.636985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35cc5d-cfb8-4d20-b778-95624ba950c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:00.637432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35cc5d-cfb8-4d20-b778-95624ba950c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:00.637539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35cc5d-cfb8-4d20-b778-95624ba950c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:00.701898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0a35cc5d-cfb8-4d20-b778-95624ba950c6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:00.703084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0a35cc5d-cfb8-4d20-b778-95624ba950c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:00.798845 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 742/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:01.095905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:01.096191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:01.096467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:01.098397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 731/1473] 10.222.0.16 () {54 vars in 962 bytes} [Fri Oct 28 09:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:01.103393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702e98-9668-4d55-8101-9aa175f63686 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:01.103678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702e98-9668-4d55-8101-9aa175f63686 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:01.103953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702e98-9668-4d55-8101-9aa175f63686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:01.180414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1d702e98-9668-4d55-8101-9aa175f63686 None None] MFA Rules not processed for user `b6f23fb45ed14020a6d15f834881d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:01.181664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d702e98-9668-4d55-8101-9aa175f63686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:01.202584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:01.260691 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 743/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Oct 28 09:43:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:01.269009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:01.270522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:01.377574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0f51-3a12-4a4a-b66d-223cec8ed7ba None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:01.454597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:01.455202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:01.455481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:01.455758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:01.457404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:01.512874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:01.572737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:01.574221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f044e59-c74b-4520-b9f2-db6cb8c7632c service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:01.593370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 732/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:03.866781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:03.867311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:03.867311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:03.868585 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 744/1476] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:03.873814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320d4d-fc7a-43af-9f5d-965583079d11 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:03.874222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320d4d-fc7a-43af-9f5d-965583079d11 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:03.874364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320d4d-fc7a-43af-9f5d-965583079d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:03.940446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74320d4d-fc7a-43af-9f5d-965583079d11 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:03.941707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74320d4d-fc7a-43af-9f5d-965583079d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:04.036542 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 733/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:43:04.302437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:04.304305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:04.438195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eca7f-10b2-4072-9a02-2ac7e42197be None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:04.491961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:04.537014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:04.537621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:04.537895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:04.538159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:04.538798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:04.540539 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:43:04.540539 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:43:04.540539 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:43:04.541773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4d2b3-edd9-48b3-9704-6436d4c0a830 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:04.561481 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 745/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Oct 28 09:43:04 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:43:06.743092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:06.743664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:06.743664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:06.745028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 734/1479] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:06.750542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab445-acd2-44cc-b579-970cb7554aec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:06.750982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab445-acd2-44cc-b579-970cb7554aec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:06.751086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fab445-acd2-44cc-b579-970cb7554aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:06.818790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-12fab445-acd2-44cc-b579-970cb7554aec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:06.820038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12fab445-acd2-44cc-b579-970cb7554aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:06.918158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 746/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:07.217220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:07.219328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:07.229769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:07.368294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7989-6829-4c95-b043-e253fdb04a85 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:07.450060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:07.482228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:07.482750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:07.483026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:07.483295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:07.484885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:07.577648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:07.579249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22a718-0c72-403a-a1cf-d781d6edae0a service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:07.600631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 735/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:09.949431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:09.949998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:09.949998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:09.951376 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 747/1482] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:09.957314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8e86-e1d8-4b25-87be-bdab50002ac7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:09.957775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8e86-e1d8-4b25-87be-bdab50002ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:09.957895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8e86-e1d8-4b25-87be-bdab50002ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:10.024532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d70b8e86-e1d8-4b25-87be-bdab50002ac7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:10.025775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d70b8e86-e1d8-4b25-87be-bdab50002ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:10.072450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:10.122266 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 736/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:10.405287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:10.406805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:10.430364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:10.509183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b59b6-6bcf-4ab9-9eea-bdf6f5a3465e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:10.583831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:10.584293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:10.584574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:10.584841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:10.586494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:10.662541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:10.698408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:10.699851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb783b2-c127-4eef-8370-6670c91c244b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:10.717767 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 748/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:12.929895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:12.930466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:12.930466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:12.931793 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 737/1485] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:12.937143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f81f0-706a-4824-86ac-a1607f427023 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:12.937596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f81f0-706a-4824-86ac-a1607f427023 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:12.937703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f81f0-706a-4824-86ac-a1607f427023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:13.010172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e10f81f0-706a-4824-86ac-a1607f427023 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:13.011409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e10f81f0-706a-4824-86ac-a1607f427023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:13.113133 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 749/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:13.397247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:13.398798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:13.508061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb108f3-c866-4c64-89eb-fd120d7c9dc2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:13.587930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:13.589632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:13.590295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:13.590618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:13.591103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:13.593384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:13.717492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:13.718951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d965e0-b4d1-4e5d-81ec-f99222d95ec8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:13.739102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 738/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:16.048318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:16.048893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:16.048893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:16.050212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 750/1488] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:16.055619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3709-4aec-45b8-9475-00c12959cef8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:16.056071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3709-4aec-45b8-9475-00c12959cef8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:16.056176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3709-4aec-45b8-9475-00c12959cef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:16.129642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1a1e3709-4aec-45b8-9475-00c12959cef8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:16.130892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1a1e3709-4aec-45b8-9475-00c12959cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:16.191142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:16.244195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 739/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:16.530847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:16.532988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:16.568785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:16.638619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa4f5-ec4b-44a5-b31e-b25290d15428 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:16.711413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:16.712024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:16.712326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:16.712596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:16.714239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:16.795845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:16.825366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:16.826734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e9ca9-4eff-4ca2-b828-3db06472beea service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:16.844752 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 751/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:19.186315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:19.187652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:19.187652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:19.189427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 740/1491] 10.222.0.16 () {54 vars in 927 bytes} [Fri Oct 28 09:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:43:19.195213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86044e-479b-49da-8d8f-46c830d06b70 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:19.195756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86044e-479b-49da-8d8f-46c830d06b70 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:19.195756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86044e-479b-49da-8d8f-46c830d06b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:19.268975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0b86044e-479b-49da-8d8f-46c830d06b70 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:43:19.270204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b86044e-479b-49da-8d8f-46c830d06b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:19.369278 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 752/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Oct 28 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:43:19.660826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:43:19.662385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:19.769087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37aeae6-9096-40e0-b103-e7de64830b83 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:43:19.844543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:43:19.845112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:43:19.845386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:43:19.845657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:43:19.847256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:43:19.856005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:19.967471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:43:19.968976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d85c3-d530-4145-9d17-3d1941284987 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:43:19.988055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 741/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:29.367706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:29.985459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=50 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:33.626246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:33.626824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:33.626824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:33.704230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:33.705474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:33.801378 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 753/1494] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:33.811103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:33.811636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:33.811636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:33.888424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:33.889583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:33.986975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 742/1495] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:33.991635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:33.992831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:34.005261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa21e08-63e1-4486-9934-0e86314c6d65 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.068140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:34.106007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.106604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.106878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.107146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.107817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:44:34.108109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.109160 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.109160 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:44:34.109160 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:44:34.110542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:34.122736 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 754/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:44:34.132951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:34.142182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d31f-3409-4674-bd38-a746f8a5f501 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.204140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:34.238709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.239316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.239592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.239860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.240491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.242237 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.242237 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:44:34.242237 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:44:34.243477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:34.300152 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 743/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:44:34 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:44:34.304620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:34.306207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:34.340106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637a9e-e7f2-4d72-868a-b1bad7beb5bb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.439179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.439781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.440061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.440380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.440967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.441986 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.441986 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:44:34.441986 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:44:34.443186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:34.491011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 755/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:44:34 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:44:34.495197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:34.496720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:34.561756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71b25-8b68-4cc6-9afc-4b17201243f5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.648937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:34.661095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.661708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.661986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.662254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.662898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.663908 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.663908 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:44:34.663908 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:44:34.664792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:34.678681 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 744/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:44:34.682685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:34.684468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:34.696955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530805-2d38-450f-873f-1ec23ec3065a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.722869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:34.793017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.793621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.793894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.794157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.794791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.795808 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.795808 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:44:34.795808 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:44:34.796692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51797a9f-0583-4ca9-b0ad-ecd9757bcc07 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:34.810125 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 756/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:44:34.814430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:34.815971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:34.852720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f11ff-6a23-4161-9d0a-5ee949260351 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:34.963228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:34.963803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:34.964081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:34.964351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] PATH_INFO: `/v3/projects/b358ccd1971a4b62ae08f1f4e9dd1441/users/3757fb81bccb44b584befc1129a96f4a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:34.997426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b358ccd1971a4b62ae08f1f4e9dd1441, user_id=3757fb81bccb44b584befc1129a96f4a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:34.998559 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:34.998559 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:44:34.998559 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:44:35.001138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf02fc4-d822-47bc-bdfe-22aa9074084c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:35.027826 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 745/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:44:34 2022] PUT /identity/v3/projects/b358ccd1971a4b62ae08f1f4e9dd1441/users/3757fb81bccb44b584befc1129a96f4a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:44:35.038983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34bf1-93cd-4e47-af85-348ae3668304 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.039349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34bf1-93cd-4e47-af85-348ae3668304 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.039698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34bf1-93cd-4e47-af85-348ae3668304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.099770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-59e34bf1-93cd-4e47-af85-348ae3668304 None None] MFA Rules not processed for user `3757fb81bccb44b584befc1129a96f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:35.101543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-59e34bf1-93cd-4e47-af85-348ae3668304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:35.182683 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 757/1502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:44:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:35.196471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.196753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.197063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.198474 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 746/1503] 10.222.0.16 () {54 vars in 957 bytes} [Fri Oct 28 09:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:44:35.204264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ba73-9328-4bf4-928a-c6358066b89e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.204681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ba73-9328-4bf4-928a-c6358066b89e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.204991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ba73-9328-4bf4-928a-c6358066b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.237224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:35.285152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f664ba73-9328-4bf4-928a-c6358066b89e None None] MFA Rules not processed for user `95ff200fd16445debdaa322bf2123ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:35.286391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f664ba73-9328-4bf4-928a-c6358066b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:35.360562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 758/1504] 10.222.0.16 () {58 vars in 1054 bytes} [Fri Oct 28 09:44:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:44:35.368393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:35.369976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:35.420140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:35.475548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21436-a359-40ad-8dc2-5b90e78672b5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:35.549766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:35.550375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.550649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.550916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.552507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:35.653496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:35.654972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:35.659141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:35.675107 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 747/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:44:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:44:35.721838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686d4a8-04df-430c-80a9-3584c5d68d69 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.722271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686d4a8-04df-430c-80a9-3584c5d68d69 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.722398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686d4a8-04df-430c-80a9-3584c5d68d69 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.723666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 759/1506] 10.222.0.16 () {52 vars in 830 bytes} [Fri Oct 28 09:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:44:35.727257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:35.728526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:35.830368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7284-6c1d-49d9-93d0-3382563fcd13 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:35.923194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:35.923803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:35.924073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:35.924589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] PATH_INFO: `/v3/users/3757fb81bccb44b584befc1129a96f4a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:35.937707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3757fb81bccb44b584befc1129a96f4a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:35.938834 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:35.938834 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:44:35.938834 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:44:35.940034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:35.949859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:36.008204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3757fb81bccb44b584befc1129a96f4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:36.008743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3757fb81bccb44b584befc1129a96f4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:36.009189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3757fb81bccb44b584befc1129a96f4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:36.019250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3757fb81bccb44b584befc1129a96f4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:36.034664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3757fb81bccb44b584befc1129a96f4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:36.063723 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 748/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:44:35 2022] DELETE /identity/v3/users/3757fb81bccb44b584befc1129a96f4a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:44:36.068114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:36.068393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:36.068665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:36.127062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:36.128239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:36.203524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:36.218026 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 760/1508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:36.239413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:36.240725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:36.341237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa545-4896-490d-8ab2-a1f4c0aab11a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:36.400866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:36.423069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:36.423696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:36.423974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:36.424493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:36.426136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:36.534316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:36.535760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6fc7-4da9-42b8-aaf9-d8e1a7df92ba service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:36.554555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 749/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:44:36.884765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:36.886131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:36.897892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a12a93-49cd-4a62-8a24-bb70fcb6c876 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:36.997304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:36.997852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:36.998126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:36.998393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] PATH_INFO: `/v3/projects/b358ccd1971a4b62ae08f1f4e9dd1441` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:37.008342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b358ccd1971a4b62ae08f1f4e9dd1441)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:37.009404 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:37.009404 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:44:37.009404 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:44:37.010602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:37.071518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b358ccd1971a4b62ae08f1f4e9dd1441', 'request_id': 'req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:37.077593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b358ccd1971a4b62ae08f1f4e9dd1441', 'request_id': 'req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:37.088149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b358ccd1971a4b62ae08f1f4e9dd1441', 'request_id': 'req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:37.120605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] The token cache is being invalidate because project b358ccd1971a4b62ae08f1f4e9dd1441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:44:37.120893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:37.121328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6758862d-9d38-4fc9-9ad1-80808b4e2ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:37.122743 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 761/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:44:36 2022] DELETE /identity/v3/projects/b358ccd1971a4b62ae08f1f4e9dd1441 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:44:46.552320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=62 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:47.118503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:02.965722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8aea8-8a97-4714-8433-0c4427b0d964 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:02.966378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8aea8-8a97-4714-8433-0c4427b0d964 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:02.966378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8aea8-8a97-4714-8433-0c4427b0d964 None None] PATH_INFO: `/v3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:02.967570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 750/1511] 10.222.0.36 () {54 vars in 925 bytes} [Fri Oct 28 09:48:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:48:02.977806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44995a-fbb2-472f-b454-f76ecf302e9a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:02.978375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44995a-fbb2-472f-b454-f76ecf302e9a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:02.978375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44995a-fbb2-472f-b454-f76ecf302e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:03.070297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3a44995a-fbb2-472f-b454-f76ecf302e9a None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:03.071552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a44995a-fbb2-472f-b454-f76ecf302e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:03.217965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 762/1512] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Oct 28 09:48:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:08.145346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ca87-6718-43e4-b0b7-45614919054a None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:08.145942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ca87-6718-43e4-b0b7-45614919054a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:08.145942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ca87-6718-43e4-b0b7-45614919054a None None] PATH_INFO: `/v3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:08.147245 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 751/1513] 10.222.0.13 () {54 vars in 925 bytes} [Fri Oct 28 09:48:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:48:08.153561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011f1f-a233-4d7b-bdf3-6d39a6a82a6a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:08.153971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011f1f-a233-4d7b-bdf3-6d39a6a82a6a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:08.154101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011f1f-a233-4d7b-bdf3-6d39a6a82a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:08.174320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b0011f1f-a233-4d7b-bdf3-6d39a6a82a6a None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:08.175550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b0011f1f-a233-4d7b-bdf3-6d39a6a82a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:08.184474 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 763/1514] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 28 09:48:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:11.746159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1042b-44b4-4af3-988f-4b29dd4d5e81 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:11.746645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1042b-44b4-4af3-988f-4b29dd4d5e81 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:11.746758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1042b-44b4-4af3-988f-4b29dd4d5e81 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:11.748058 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 752/1515] 10.222.0.16 () {54 vars in 961 bytes} [Fri Oct 28 09:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:11.753733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:11.754174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:11.754315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:11.773581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:11.774775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:11.783318 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 764/1516] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Oct 28 09:48:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:11.791163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1042b-44b4-4af3-988f-4b29dd4d5e81 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:11.806091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1042b-44b4-4af3-988f-4b29dd4d5e81 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:11.811220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:11.811811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:11.812087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:11.812353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:11.821173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:11.822744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abff24-18eb-4766-bbf7-ba28082025b3 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:11.832194 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 753/1517] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:16.756529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:16.766799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaefa7-2bd0-48ef-aa18-6edca2ad57d2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:16.773037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:16.773653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:16.773930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:16.774204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:16.783487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:16.785131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a698290-afb9-4c1a-aed3-ef803a5c2add service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:16.795692 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 765/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:21.828267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:26.791658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:26.927921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:26.928797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:26.928797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:26.929897 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 754/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:26.935590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345372-5ab4-4cd7-824e-26bf0e278174 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:26.935875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345372-5ab4-4cd7-824e-26bf0e278174 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:26.936150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345372-5ab4-4cd7-824e-26bf0e278174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:26.997076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7e345372-5ab4-4cd7-824e-26bf0e278174 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:26.998312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e345372-5ab4-4cd7-824e-26bf0e278174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:27.080376 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 766/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:27.243230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:27.245922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:27.363867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087f08-e0fc-43f7-9efd-76e559da01a2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:27.369518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:27.370133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:27.370413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:27.370686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:27.379458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:27.381085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a966c4-5baa-4ad8-9cac-ccc7f7728194 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:27.391605 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 755/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:28.534520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d092-ff5c-4975-acce-91e8e1787f2c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:28.535102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d092-ff5c-4975-acce-91e8e1787f2c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:28.535102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d092-ff5c-4975-acce-91e8e1787f2c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:28.536465 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:28.543864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda405e-5dcc-4f07-95a9-dc413f12aec5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:28.544415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda405e-5dcc-4f07-95a9-dc413f12aec5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:28.544415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda405e-5dcc-4f07-95a9-dc413f12aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:28.569546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dcda405e-5dcc-4f07-95a9-dc413f12aec5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:28.570807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dcda405e-5dcc-4f07-95a9-dc413f12aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:28.579571 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:28.734870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d092-ff5c-4975-acce-91e8e1787f2c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:28.750308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d092-ff5c-4975-acce-91e8e1787f2c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:28.756174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:28.756787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:28.757094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:28.757363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:28.766891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:28.768492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e1a5e-3b69-45c2-bc46-34606b414be6 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:28.778870 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 768/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:32.694681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.695292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.695292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.696598 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:32.702361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339408-01af-480f-b020-5971f5a5820b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.702868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339408-01af-480f-b020-5971f5a5820b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.702962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339408-01af-480f-b020-5971f5a5820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.723545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-85339408-01af-480f-b020-5971f5a5820b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:32.724764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-85339408-01af-480f-b020-5971f5a5820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:32.732760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:33.021492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:33.023229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:33.105333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39cfe5-8a6f-48fd-8b3d-1b8d6bf19b5e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:33.109385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:33.110523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:33.110858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:33.111131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:33.120502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:33.121969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060959-fb44-44d0-ba99-8d176a5da491 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:33.132081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 758/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:35.308099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162c53-cfd7-44c1-a747-7e8fbca1f23e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:35.308727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162c53-cfd7-44c1-a747-7e8fbca1f23e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:35.308727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162c53-cfd7-44c1-a747-7e8fbca1f23e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:35.310003 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:35.315661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206e2-9389-446f-89ed-b9b79ec5be4e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:35.316204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206e2-9389-446f-89ed-b9b79ec5be4e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:35.316204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206e2-9389-446f-89ed-b9b79ec5be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:35.337432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-aa1206e2-9389-446f-89ed-b9b79ec5be4e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:35.338639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aa1206e2-9389-446f-89ed-b9b79ec5be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:35.347709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:35.641344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162c53-cfd7-44c1-a747-7e8fbca1f23e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:35.652107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162c53-cfd7-44c1-a747-7e8fbca1f23e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:35.655656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:35.656244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:35.657085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:35.657353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:35.666639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:35.668158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edadf3-a601-4d42-825d-8ed0ff1fa4dd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:35.677563 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 771/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:45.337047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:45.673721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=65 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:28.547306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e835-913f-4286-adde-f3b0caac2f37 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:28.547829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e835-913f-4286-adde-f3b0caac2f37 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:28.547903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e835-913f-4286-adde-f3b0caac2f37 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:28.549479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 760/1531] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:28.555618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a52f4-e845-49ea-804a-7848cb9ad09e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:28.556146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a52f4-e845-49ea-804a-7848cb9ad09e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:28.556146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a52f4-e845-49ea-804a-7848cb9ad09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:28.577147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a13a52f4-e845-49ea-804a-7848cb9ad09e None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:28.578880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a13a52f4-e845-49ea-804a-7848cb9ad09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:28.587967 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 772/1532] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:38.571989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:03.333361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:03.333980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:03.333980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:03.372033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:03.376309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:03.391386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 761/1533] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:03.405565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:03.406129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:03.406208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:03.446326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:03.447605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:03.467944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 773/1534] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:03.473979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:03.488163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859fb96-cc63-4761-9a82-463635fe9da9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:03.504411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:03.506007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:03.506515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:03.507085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:03.508094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:03.508675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:03.510104 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:03.510104 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:50:03.510104 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:50:03.511517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:03.538262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 762/1535] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:03.545931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:03.566081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256f1d-1c94-494a-85df-81472fcc98b0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:03.582473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:03.583555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:03.584053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:03.584538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:03.585801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:03.587755 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:03.587755 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:50:03.587755 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:50:03.590742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:03.725936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 774/1536] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:03 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:03.734562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:03.747680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55230a4-219c-4d28-8d39-f24e705751c3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:03.898152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:03.900009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:03.900978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:03.901815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:03.904256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:03.907399 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:03.907399 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:50:03.907399 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:50:03.912950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45665f5-f56f-4142-8155-54df5e798aef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:03.985887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 763/1537] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:03 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:03.990847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:04.010380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a718c1-33c2-4de5-806d-9b742d9148ac admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:04.019639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73f1-c734-45ae-8643-4307d6f9deec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.019923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:04.020526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.020809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.025233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.025233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:04.025233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:04.028360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73f1-c734-45ae-8643-4307d6f9deec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.036879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e73f1-c734-45ae-8643-4307d6f9deec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.044962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 775/1538] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:04.058143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:04.082420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5632791-fc26-49fc-82b3-6b63692e0318 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:04.096376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:04.097121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.097311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.097632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.098262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:04.100147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:04.128936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 776/1539] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:04.136373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:04.142832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-425e73f1-c734-45ae-8643-4307d6f9deec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.150321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-425e73f1-c734-45ae-8643-4307d6f9deec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.166081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d43c4-10da-4c8d-b4f0-970d5d70275d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:04.202197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:04.202926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.203226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.203478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] PATH_INFO: `/v3/projects/386a18c232b949b793bf7ec70ed3b6c9/users/9dc12014773b4f9fb34ff214c07d7f61/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.205475 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 764/1540] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.214569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037b7a-2bd9-43a5-95f0-dab9956f6c2f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.215499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037b7a-2bd9-43a5-95f0-dab9956f6c2f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.216386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037b7a-2bd9-43a5-95f0-dab9956f6c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.262843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386a18c232b949b793bf7ec70ed3b6c9, user_id=9dc12014773b4f9fb34ff214c07d7f61, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:04.263976 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:04.263976 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:50:04.263976 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:50:04.269100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78116ea9-4a2a-486e-9d6c-f1a005efdec0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:04.293422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-78037b7a-2bd9-43a5-95f0-dab9956f6c2f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.295029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-78037b7a-2bd9-43a5-95f0-dab9956f6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.301023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 777/1541] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:04 2022] PUT /identity/v3/projects/386a18c232b949b793bf7ec70ed3b6c9/users/9dc12014773b4f9fb34ff214c07d7f61/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:04.301023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890f9-29bd-4941-b128-b4035b47c4f0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.301023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890f9-29bd-4941-b128-b4035b47c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.301023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890f9-29bd-4941-b128-b4035b47c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.325218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ab9890f9-29bd-4941-b128-b4035b47c4f0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.328068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ab9890f9-29bd-4941-b128-b4035b47c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.649772 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 778/1542] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.655312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.655312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.661847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.709656 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 765/1543] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.711970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b929-a4b1-49cb-a75a-af2dfa45b488 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.712474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b929-a4b1-49cb-a75a-af2dfa45b488 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.721273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b929-a4b1-49cb-a75a-af2dfa45b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.809911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1f09b929-a4b1-49cb-a75a-af2dfa45b488 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.819139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1f09b929-a4b1-49cb-a75a-af2dfa45b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.836018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] MFA Rules not processed for user `9dc12014773b4f9fb34ff214c07d7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.837359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.847367 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 766/1544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.849142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea26e-c92e-42ae-9a54-60ee2347f7f8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.849558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea26e-c92e-42ae-9a54-60ee2347f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.849992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea26e-c92e-42ae-9a54-60ee2347f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.908422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-414ea26e-c92e-42ae-9a54-60ee2347f7f8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.910248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-414ea26e-c92e-42ae-9a54-60ee2347f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.925310 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 767/1545] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.927874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a36b6-fd76-4c39-850e-bb631e912cb2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.928737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a36b6-fd76-4c39-850e-bb631e912cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.929486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a36b6-fd76-4c39-850e-bb631e912cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.960844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3c7a36b6-fd76-4c39-850e-bb631e912cb2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:04.963536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c7a36b6-fd76-4c39-850e-bb631e912cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:04.966609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 779/1546] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.972644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:04.979103 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 768/1547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:04.983668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b931c8-a47c-4608-b006-5b4d12fd7d50 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:04.983976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b931c8-a47c-4608-b006-5b4d12fd7d50 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:04.984254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b931c8-a47c-4608-b006-5b4d12fd7d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:04.992056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52f1fc-d511-4a8f-aca9-95eb35435f68 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.002162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.003601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.004171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.004728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.006162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.006712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.007102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-69b931c8-a47c-4608-b006-5b4d12fd7d50 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.008463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-69b931c8-a47c-4608-b006-5b4d12fd7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.010903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73bdd5-f572-4797-9b5a-bcd18ebcc047 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.014321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:05.019473 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 769/1548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.021734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c7963-3b66-4b25-abc1-6839b0fcac9e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.022235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c7963-3b66-4b25-abc1-6839b0fcac9e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.022696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c7963-3b66-4b25-abc1-6839b0fcac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.039558 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 780/1549] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.039558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eeb7-7543-467b-af3d-ed3946308046 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.039558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eeb7-7543-467b-af3d-ed3946308046 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.039558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eeb7-7543-467b-af3d-ed3946308046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.051358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f84c7963-3b66-4b25-abc1-6839b0fcac9e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.052849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f84c7963-3b66-4b25-abc1-6839b0fcac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.063332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 770/1550] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.065202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.065656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.066105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.081958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b5c2eeb7-7543-467b-af3d-ed3946308046 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.083229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b5c2eeb7-7543-467b-af3d-ed3946308046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.092824 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 781/1551] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.094259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70c33-740d-46eb-b63a-442dc93b6010 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.094546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70c33-740d-46eb-b63a-442dc93b6010 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.094821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec70c33-740d-46eb-b63a-442dc93b6010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.096802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.098866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.109347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 771/1552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.110577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.122977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ec70c33-740d-46eb-b63a-442dc93b6010 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.125601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ec70c33-740d-46eb-b63a-442dc93b6010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.125781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39667c26-6f04-4949-9ec2-4aa0d4616d44 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.133550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.134558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.135010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.135527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.136566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.139729 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 782/1553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.140699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.141638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.142118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.142532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.176002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.177513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.191023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 772/1554] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.191269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 783/1555] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.191269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.194318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.205512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:05.206250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15e0ed-8e19-440b-a87c-2d188d22332b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.286952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.287662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.287947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.288585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.288934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.289264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.290947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0ebe5-328f-46e2-af14-bbb60a6d5d17 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.305940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 784/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.314584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.314584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.314584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.328354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70971f41-f69f-4ff8-a899-82729ddfc96c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.330414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.331672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.336346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.337442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.337927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.338405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.339558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.340188 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 785/1557] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.341075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.343313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.351883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3241-3f1b-4e8d-9b52-d23f560ce7a1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.357182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.358343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.358629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.358899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.359619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.359880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.361568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232de34-17c0-4ee3-b782-f3a52be51303 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.375991 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 786/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.378935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.379523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.380113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.403181 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 773/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.404541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.408191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.409716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.493101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 787/1560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.494128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.496143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6889a-7241-4d16-a05a-4b35c47416dc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.505586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.506466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.506748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.507022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.507702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.508118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.509943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.510811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287519b-0588-4b62-ac80-7bc1dfb5f489 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.515971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.516597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.516885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.517184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.517826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.519788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.525378 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 774/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.529280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.544438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abaeb3-4323-49a6-82f1-5f117a11ee98 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.545098 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 788/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.546741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.555507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.556382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.556773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.557186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.557504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13488330-cc7f-4f4e-ba46-ec80907dea68 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.558200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.558645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.561398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.563514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.564245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.564526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.564808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.565485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.567463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.585573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 775/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.585573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.593310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122bcd-0dc1-418d-af3c-635ca5bcd958 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.603078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.604029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.604380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.604792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.605684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.606111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.608577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.617825 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 789/1564] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.617825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.628255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 776/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.629662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.633593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:05.645798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c630-d4ec-46cc-8057-c482147a3efd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.711671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b06-bb79-4e54-b7bd-f5184b11986d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.716733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.717940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.718217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.718489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.719132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.719576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:05.721184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.729301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.730125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.730521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.731058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.732119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.735324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.754681 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 790/1566] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.756120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.768601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 777/1567] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.769303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.780227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751267f-da47-43b3-83a6-5b4959a66985 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.838741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867f2e-7721-451b-9737-0910284fed10 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.844390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.845090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.845527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.845803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.846464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:05.846770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.848417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.862084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.862718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.863065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.863318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.863966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.873326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 791/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:05.873326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.873617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.883132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ff347-8845-4039-92c6-8aaad36f3168 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.890376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.891321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.891777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.892061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.893179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.895405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.913417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 778/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:05.913417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.913792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 792/1570] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:05.915224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.933049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92231a99-4eb5-4809-a6ea-6341ac8c1c4c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.994982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9d74-6897-4854-b267-b9f95f4b724b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.002299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.003125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.003592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.004045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.005298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.009128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.025775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.026557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.026958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.027313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.028062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.031111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.051358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 779/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.051358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.069415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 793/1572] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.069415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.078067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edcac-f898-4bda-885f-3140a06e4e68 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.082553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.147831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.156306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1c27-3daf-4133-a453-ca8368a04cd2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.156768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.157460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.157737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.158144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.158831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.160870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.163556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.164203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.164484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.164758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.165459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.167755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.192812 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 794/1573] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.194761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.205290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 780/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.206476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.215572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baf137-dbb9-45c7-a420-efdd35ddfd6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.291281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0e7d-5804-4a4f-b5fd-77e8377e2752 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.296731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.297459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.297738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.298007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.298667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.301336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.308169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.309115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.309503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.309788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.310467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.312191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.323461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 795/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.324676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.335933 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 781/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.337172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb747fb-0656-4aef-9bb9-60b9b41e6543 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.337329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.401589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.402214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.402491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.402764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.403395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.405935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.411104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2995b-ab62-40f8-98cc-9bd8557da9b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.415902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.416655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.417321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.417580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] PATH_INFO: `/v3/projects/0844f17c02294217954ad90f41b9e2fd/users/8f6e3fb8d6584717b71970da75f27541/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.429547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 796/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.430377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.436705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0844f17c02294217954ad90f41b9e2fd, user_id=8f6e3fb8d6584717b71970da75f27541, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.439437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.441601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea462-419c-4b93-97cf-a12f65c4d0a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.446867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.447477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.447824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.448189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.448804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.450788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.454352 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 782/1578] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:06 2022] PUT /identity/v3/projects/0844f17c02294217954ad90f41b9e2fd/users/8f6e3fb8d6584717b71970da75f27541/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:06.455201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.475279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 797/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.476362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.482849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.487667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a17d-64b9-49e3-b183-69baf83ba382 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.514994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.536782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb3f3-91d2-45a3-a9f2-c0f406d7c7a5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.541607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.542500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.542781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.543059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.543726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.545595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.554057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.554685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.554963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.555232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.555916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.560329 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 783/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.560521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.560605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.569729 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 798/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.570413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.571540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a2e9c-b42b-487e-b29d-d717534dbeff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.578134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.578784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.579089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.579359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.580011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.581912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81971-c8a3-4ed4-98ae-44076f1c6d85 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.582118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.587331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.587943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.588217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.588484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.589152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.590850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.605003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 784/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.605593 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 799/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.605800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.606445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.617830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd04ae-a6b1-47ed-9ce0-28f789efda54 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.618067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2f4-8bc9-4027-8059-2dc75b749f39 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.623179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.624050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.624050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.624210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.624283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.624363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.624589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.624953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.625271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.625384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.626938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.627196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.639970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 800/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.640455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.651543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f134-7a03-4fb1-8595-1c18c470db2c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.653661 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 785/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:06 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:06.654618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.656990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.657627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.657880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.658142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.658771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.660439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.669824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92087350-cadc-45be-97e4-db7016bc4991 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.675050 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 801/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.675050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.675307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.675307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.675706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.675856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.676498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.678116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.687441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b7d9-545e-4b77-96ee-d5c274947901 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.689543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 786/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.690475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.693243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.693864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.694148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.694418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.695069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.696685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.700659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c29db-70ca-4956-b976-2db231eef935 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.708092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 802/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.708979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.711493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.712418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.712800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.713269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.714506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.716688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.722889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf08-b9bc-4771-ad2f-4191591bced9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.727806 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 787/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.728740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.733259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.733876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.734157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.734426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.735075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.736745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.739717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ec06-b689-47d7-bce6-14bd8e135ba1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.745380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.746256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.746542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.746814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] PATH_INFO: `/v3/projects/40af626471a9471d94974b2fa497f903/users/f106553152274aae929db0aad88bda5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.747407 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 803/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.748778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.758778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194ece-3d0f-4574-8d20-4e543ac32653 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.765301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.765569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40af626471a9471d94974b2fa497f903, user_id=f106553152274aae929db0aad88bda5c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.766134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.766561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.766917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.767649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.768316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.769567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.781203 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 804/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.782123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.792808 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 788/1592] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:06 2022] PUT /identity/v3/projects/40af626471a9471d94974b2fa497f903/users/f106553152274aae929db0aad88bda5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:06.792808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.794094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3ab27-ede2-4285-8c1e-e6c804531836 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.854544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.855299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.855578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.855842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.856479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.857144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f4059-26e7-461c-b1da-349bafabf3f7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.858660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.862424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.863083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.863359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.863623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] PATH_INFO: `/v3/projects/0844f17c02294217954ad90f41b9e2fd/users/8f6e3fb8d6584717b71970da75f27541/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.865533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0844f17c02294217954ad90f41b9e2fd, user_id=8f6e3fb8d6584717b71970da75f27541, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.868161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.869008 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 805/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.869834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.880842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c9764-17c8-4f47-adf5-30aa8807febd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.881164 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 789/1594] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:06 2022] PUT /identity/v3/projects/0844f17c02294217954ad90f41b9e2fd/users/8f6e3fb8d6584717b71970da75f27541/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:06.881868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.912539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.944447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.945131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.945482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.945668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.946307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.946720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.948294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.951064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddc7af-3b37-4a86-bc95-d4cc914ca1f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.957794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.958613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.959117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.959387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] PATH_INFO: `/v3/projects/e4bf7a1694754ab495d0630ae8580735/users/ea106b2a3de84ea28bbad06ca62f2bda/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.959958 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 806/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:06.960790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:06.975092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf694d9-5b25-47b1-80d1-ee052a303701 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:06.976716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bf7a1694754ab495d0630ae8580735, user_id=ea106b2a3de84ea28bbad06ca62f2bda, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:06.979457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:06.980377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:06.981272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:06.981708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:06.981984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] PATH_INFO: `/v3/projects/a01b83f9af02492bbefb6ccc4ea0c170/users/745a691d9088440da7260c2d5fbd37e6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:06.994276 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 790/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:06 2022] PUT /identity/v3/projects/e4bf7a1694754ab495d0630ae8580735/users/ea106b2a3de84ea28bbad06ca62f2bda/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:06.995225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.000999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01b83f9af02492bbefb6ccc4ea0c170, user_id=745a691d9088440da7260c2d5fbd37e6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.003771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.019681 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 807/1597] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:06 2022] PUT /identity/v3/projects/a01b83f9af02492bbefb6ccc4ea0c170/users/745a691d9088440da7260c2d5fbd37e6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:07.020852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.078425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae07-d437-47a2-95ce-608ead8fd6c1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.100354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0c0b-6b0d-468b-84e7-b0fceab95629 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.105468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.106393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.106686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.106956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] PATH_INFO: `/v3/projects/f75fc6889d564010966a8f1806d0d93d/users/c5991ee8e3634d2f9b3a355ba48ffecc/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.122975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75fc6889d564010966a8f1806d0d93d, user_id=c5991ee8e3634d2f9b3a355ba48ffecc, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.125740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3974aa-a5dd-4ece-91ea-88208a89187f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.144726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 808/1598] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:07 2022] PUT /identity/v3/projects/f75fc6889d564010966a8f1806d0d93d/users/c5991ee8e3634d2f9b3a355ba48ffecc/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:07.144726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfed-aa78-4d2d-99c0-8894b17a32ec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.144726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfed-aa78-4d2d-99c0-8894b17a32ec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.144726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfed-aa78-4d2d-99c0-8894b17a32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.146122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.147041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.147506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.147994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.148989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.150796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.165755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 791/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:07.165755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.174366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652478-8612-4d2a-9eb9-6849f42830bc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.176488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a467dfed-aa78-4d2d-99c0-8894b17a32ec None None] MFA Rules not processed for user `f106553152274aae929db0aad88bda5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.177948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a467dfed-aa78-4d2d-99c0-8894b17a32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.243063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.243791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.244069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.244348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.245033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.246774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.254684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 809/1600] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.255963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bb3c-95cf-4804-be99-7f357aaa08ab None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.256243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bb3c-95cf-4804-be99-7f357aaa08ab None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.256510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8bb3c-95cf-4804-be99-7f357aaa08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.261526 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 792/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:07.261526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.270381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8188b-cee3-4f2a-b5d7-44a645a98cfe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.276158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.276861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.277193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.277471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] PATH_INFO: `/v3/projects/2f4dca7afa40438cba45411cead48103/users/a60610c78b5844f78f3ac3a7d421df53/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.290307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-32d8bb3c-95cf-4804-be99-7f357aaa08ab None None] MFA Rules not processed for user `8f6e3fb8d6584717b71970da75f27541`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.291551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-32d8bb3c-95cf-4804-be99-7f357aaa08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.293828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4dca7afa40438cba45411cead48103, user_id=a60610c78b5844f78f3ac3a7d421df53, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.296224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.296562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ccac7-58f2-4a43-8b9b-1e04a4014790 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.299979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.312690 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 793/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:07 2022] PUT /identity/v3/projects/2f4dca7afa40438cba45411cead48103/users/a60610c78b5844f78f3ac3a7d421df53/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:07.317782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108debe-72a8-449f-bc09-705cfcd05464 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.318064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108debe-72a8-449f-bc09-705cfcd05464 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.318365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108debe-72a8-449f-bc09-705cfcd05464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.349309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4108debe-72a8-449f-bc09-705cfcd05464 None None] MFA Rules not processed for user `ea106b2a3de84ea28bbad06ca62f2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.350442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4108debe-72a8-449f-bc09-705cfcd05464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.370392 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 810/1603] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.371585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.371862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.372132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.402332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] MFA Rules not processed for user `745a691d9088440da7260c2d5fbd37e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.403563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.431941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 794/1604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.437028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183996bd-3139-482d-aa93-979547cb472c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.437028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183996bd-3139-482d-aa93-979547cb472c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.437028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183996bd-3139-482d-aa93-979547cb472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.468076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-183996bd-3139-482d-aa93-979547cb472c None None] MFA Rules not processed for user `c5991ee8e3634d2f9b3a355ba48ffecc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.469364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-183996bd-3139-482d-aa93-979547cb472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.487389 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 811/1605] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.491800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.548386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 795/1606] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.549521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183996bd-3139-482d-aa93-979547cb472c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.562714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6afa7-759e-46be-ba19-081b82e6e8cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.568729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.569658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.569971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.570245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] PATH_INFO: `/v3/projects/340ea03cddd04e83aaabb5e6810892d2/users/791f2111f74a452eaa525d16ce0b6448/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.588704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340ea03cddd04e83aaabb5e6810892d2, user_id=791f2111f74a452eaa525d16ce0b6448, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.592895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.612688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 812/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:07 2022] PUT /identity/v3/projects/340ea03cddd04e83aaabb5e6810892d2/users/791f2111f74a452eaa525d16ce0b6448/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:07.613438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.640475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.647012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183996bd-3139-482d-aa93-979547cb472c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.682204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.707757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d97c45-68fa-4936-97f3-72f2332b4ae5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.712809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.713551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.713822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.714123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] PATH_INFO: `/v3/projects/5b682726fc4b40909ff68883cb657fad/users/df8c883886b54a8bb9592bc0ae1d5d05/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.723026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.723651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.723930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.724200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.724849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.726855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a621-7d25-439e-814e-1998ae93db18 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.735235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b682726fc4b40909ff68883cb657fad, user_id=df8c883886b54a8bb9592bc0ae1d5d05, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.738068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd906f-b886-4aa0-aba8-a8c5544ceb88 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.753192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 813/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:07 2022] PUT /identity/v3/projects/5b682726fc4b40909ff68883cb657fad/users/df8c883886b54a8bb9592bc0ae1d5d05/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:07.761916 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 796/1609] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:07.761916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.761916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.761916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.764414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.764740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.765038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.784804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] MFA Rules not processed for user `9dc12014773b4f9fb34ff214c07d7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.785572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.786074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.786756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:07.850856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 797/1610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.851875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.863005 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 814/1611] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:07.864613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.872371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75a693-bc84-4de7-9230-3602d81bce25 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.883054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.883741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6cf04-4868-4a33-aee8-3d29fd09a493 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:07.884011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.884533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.885086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.886193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.889826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.890914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:07.891436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.891938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.892258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.893529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:07.895875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf152-2545-4ca4-84a6-5bdf5bf9a149 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:07.927796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 798/1612] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:07.929032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:07.933148 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 815/1613] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:07.934742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:07.935030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:07.935272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:07.966599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] MFA Rules not processed for user `791f2111f74a452eaa525d16ce0b6448`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:07.969476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:08.006129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f8eb8-5bd0-4795-b061-ef7c8898d5f8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.046108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:08.049568 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 816/1614] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:08.050450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.057020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:08.075370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.076128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.076460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.076731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.077466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.079418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803aa50b-a0d8-46ec-a292-3579615a676c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.109639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 799/1615] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:07 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.110962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a74b-62d8-4b7b-950e-2a6f4b2698b7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.111243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a74b-62d8-4b7b-950e-2a6f4b2698b7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.111513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a74b-62d8-4b7b-950e-2a6f4b2698b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.140324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0ebd-e70f-4814-880f-83678cc8a504 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.142313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34e6a74b-62d8-4b7b-950e-2a6f4b2698b7 None None] MFA Rules not processed for user `df8c883886b54a8bb9592bc0ae1d5d05`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:08.143538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34e6a74b-62d8-4b7b-950e-2a6f4b2698b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:08.213770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.214549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.214933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.215263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.215983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.217487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 800/1616] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:08.218639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863519-6405-4cc0-8c2a-daf827fad5a4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.218919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863519-6405-4cc0-8c2a-daf827fad5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.219188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863519-6405-4cc0-8c2a-daf827fad5a4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.220496 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 801/1617] 10.222.0.16 () {54 vars in 960 bytes} [Fri Oct 28 09:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:08.221258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2863519-6405-4cc0-8c2a-daf827fad5a4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.224501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.254043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 817/1618] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.254912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.267578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab768-0790-46ef-96f9-1acf63a937eb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.273017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.273866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.274142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.274408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.275064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.277013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.292754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2863519-6405-4cc0-8c2a-daf827fad5a4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.297378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.298013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.298286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.298541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.302305 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 818/1619] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 306 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.303179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.310053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.311537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.313358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdf1d-06de-42d1-8ada-33e191168565 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.318380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.318998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.319269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.319525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.320181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.322134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.322837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 802/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:08.323659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.337177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c5a0-28ff-48fc-a3a3-8ed7f343eb89 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.343849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.344481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.344971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.345473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.346086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.348063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.354165 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 819/1621] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.354165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.362918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b9543-5e19-4fb5-b849-1cfc51ad72f7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.369947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.370577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.370887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.371204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.371851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.374071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771f49-0cc2-4ef9-b6e2-f0f7456e6176 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.395207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 803/1622] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.396153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.409511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 820/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 297 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.411879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.412484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.412484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.448946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:08.484497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:08.486684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:08.501300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0449a3-d1e2-4bfd-9318-219cb4e1ba20 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.512953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.515646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.516131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.516657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.517712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.520871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.570920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:08.591842 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 804/1624] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.593644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.657537 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 821/1625] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:08.659704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.673917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a7cea-7b3c-451f-976e-ff09631113de None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.716546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930782-590b-4ede-a541-5b003c7a5124 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.726774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.729338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.730056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.730683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.732886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.737532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.759186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.759826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.760160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.760439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.761552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.763213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.770860 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 805/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:08.773681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.795024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5e4d0-11e7-437c-8388-b5cafeaf1c1f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.799904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 822/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:08.801196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.809593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.811207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.811681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.812542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.813529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.816970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.836542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36674-9a02-4935-8f4d-3cf9da1c1a02 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.845374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 806/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:08.846874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.854167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.856613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.857160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.857805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.858713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.862637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.865848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a6be-7d67-47a6-8acb-afed91d79745 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.871377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.872030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.872300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.872636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.874734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.876588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.890588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 807/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:08.894756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.899816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 823/1630] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.901163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.910896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbf81-1bf7-4ca9-9146-627e17792e52 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.921143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.922312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.922884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.923454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:08.924971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:08.928277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:08.966323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 808/1631] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:08 2022] POST /identity/v3/users => generated 298 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:08.968040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:08.984300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86dafd-fa12-4ed4-be70-ded2c76ac4da admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:08.990899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:08.991923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:08.992460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:08.993029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] PATH_INFO: `/v3/projects/b9bb99f609d84679a29406443716d2f1/users/2095ad464f014a09b8383df800a24dfa/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.012851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9eac-0979-4ee9-941f-ce9fc9d35aed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.018477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bb99f609d84679a29406443716d2f1, user_id=2095ad464f014a09b8383df800a24dfa, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.021714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.022200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.022589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.022969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.024423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.055722 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 809/1632] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:08 2022] PUT /identity/v3/projects/b9bb99f609d84679a29406443716d2f1/users/2095ad464f014a09b8383df800a24dfa/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.058089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.094536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:09.142558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.144724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.159247 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 824/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:09.160119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.179237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcf829-1c75-4f48-987f-45a2ee3416ba service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.193462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:09.210930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d0d8-5de0-41c3-a4f7-4be0380639fd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.216864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.217640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.217923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.218294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] PATH_INFO: `/v3/projects/9b3878f8ee0f4a06abb8f252be0af556/users/654f1e57690f450c8269bf545ac8a214/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.236706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3878f8ee0f4a06abb8f252be0af556, user_id=654f1e57690f450c8269bf545ac8a214, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.239481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.277213 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 810/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/9b3878f8ee0f4a06abb8f252be0af556/users/654f1e57690f450c8269bf545ac8a214/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.278505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.299456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.300186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.300508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.300811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] PATH_INFO: `/v3/projects/3da414c799b34d0497eb980a21b99e7d/users/c56d5e1333c045ef8433d115f54a13ae/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.343804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da414c799b34d0497eb980a21b99e7d, user_id=c56d5e1333c045ef8433d115f54a13ae, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.352381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.388187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 825/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/3da414c799b34d0497eb980a21b99e7d/users/c56d5e1333c045ef8433d115f54a13ae/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.391969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.451467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49ae6b-54f7-4f82-bc93-21980ebbfe82 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.500290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cd61-8638-4882-ab75-eb00b5c77c7a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.505552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.506226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.506510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.506785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.507584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.509451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.524019 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 826/1636] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:09.527422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.541772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5aaf-343d-4589-ade1-12f6af47d2fd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.549263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.550018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.550798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.551075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.552313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.554283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.567482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 827/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:09.569383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.584223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9075-b7cb-49e9-8851-52cfaca84e50 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.589797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.590603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.590990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.591333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.593302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.597164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.603739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.604537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.605295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.605568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] PATH_INFO: `/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c/users/0558ebc9efa1407b8e7ec523317ec4c4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.610207 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 828/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:09.611443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.626216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62a4a-558a-445c-b53b-6f899b41b728 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.630917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0796e3f43b1f4b2192c5dc4a92af949c, user_id=0558ebc9efa1407b8e7ec523317ec4c4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.632320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.633168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.633516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.633894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.634619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.635033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.636486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.648799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 829/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:09.651999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.665037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3055b2-0a81-4a89-810d-427a64097563 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.665587 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 811/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c/users/0558ebc9efa1407b8e7ec523317ec4c4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.666727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.699036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:09.746410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.747137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.747485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.747928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.748836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.750655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5476-4881-4b85-9d4a-aaa602716a6e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.763053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 830/1641] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:09.764424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ddaf-240b-4fe2-8c57-ad7161ee0da9 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.764786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ddaf-240b-4fe2-8c57-ad7161ee0da9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.765117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ddaf-240b-4fe2-8c57-ad7161ee0da9 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.765558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d3ae6-287a-4561-9313-d487398088ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.767727 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 831/1642] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:09.768570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ddaf-240b-4fe2-8c57-ad7161ee0da9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.772068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.773673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.773957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.774236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] PATH_INFO: `/v3/projects/f46254807cd041168a380adb71aaf2ee/users/07d5a94be0ce409597bd6acee18779bb/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.785374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ddaf-240b-4fe2-8c57-ad7161ee0da9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.789874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:09.796049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:09.797095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:09.797454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:09.798012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] PATH_INFO: `/v3/projects/a642e19be2604d4984af9bbd55808426/users/b3b6d7fa60a04082af41472642f363b3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:09.813755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46254807cd041168a380adb71aaf2ee, user_id=07d5a94be0ce409597bd6acee18779bb, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.816845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.833678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a642e19be2604d4984af9bbd55808426, user_id=b3b6d7fa60a04082af41472642f363b3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:09.836881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:09.844669 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 812/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/f46254807cd041168a380adb71aaf2ee/users/07d5a94be0ce409597bd6acee18779bb/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.846276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.861994 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 832/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/a642e19be2604d4984af9bbd55808426/users/b3b6d7fa60a04082af41472642f363b3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:09.863201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:09.961316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48c2f-d0aa-4d8e-aadf-2cca76f108ac admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:09.997709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa4c-34e8-42f8-b431-736d31ab9335 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.005813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.006953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.007441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.008491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] PATH_INFO: `/v3/projects/9b3878f8ee0f4a06abb8f252be0af556/users/654f1e57690f450c8269bf545ac8a214/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.012430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3878f8ee0f4a06abb8f252be0af556, user_id=654f1e57690f450c8269bf545ac8a214, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.021550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.042917 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 833/1645] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/9b3878f8ee0f4a06abb8f252be0af556/users/654f1e57690f450c8269bf545ac8a214/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:10.050442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.050726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.051554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.051974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.052576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] PATH_INFO: `/v3/projects/b9bb99f609d84679a29406443716d2f1/users/2095ad464f014a09b8383df800a24dfa/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.054984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bb99f609d84679a29406443716d2f1, user_id=2095ad464f014a09b8383df800a24dfa, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.057930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.077552 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 813/1646] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:09 2022] PUT /identity/v3/projects/b9bb99f609d84679a29406443716d2f1/users/2095ad464f014a09b8383df800a24dfa/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:10.079353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.179526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8165-1d6a-4b1a-8584-ebfee04de0f5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.182754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72028-df5b-4ca3-8295-7eeea0cade6e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.186717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.187663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.188137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.188486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.188716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.189197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.189477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.189745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] PATH_INFO: `/v3/projects/3da414c799b34d0497eb980a21b99e7d/users/c56d5e1333c045ef8433d115f54a13ae/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.189974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.191900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113083a1-1323-40dc-8e1e-5cff18245bf8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.195688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da414c799b34d0497eb980a21b99e7d, user_id=c56d5e1333c045ef8433d115f54a13ae, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.198907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.210419 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 834/1647] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:10.215196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119343-f523-4f36-9a71-97c9f40bec4f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.215542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119343-f523-4f36-9a71-97c9f40bec4f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.215921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119343-f523-4f36-9a71-97c9f40bec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.228590 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 814/1648] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:10 2022] PUT /identity/v3/projects/3da414c799b34d0497eb980a21b99e7d/users/c56d5e1333c045ef8433d115f54a13ae/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:10.228590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.253979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d4119343-f523-4f36-9a71-97c9f40bec4f None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:10.255492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d4119343-f523-4f36-9a71-97c9f40bec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.258026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.309667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.324181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf167d1-8821-4fa8-b9f1-71568d4805ed admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.329696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.330633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.330840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.331110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.331771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.333489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.355416 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 815/1649] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:10.356312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.370138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b66f49-dbf4-4465-9bcf-33e74ccecddb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.373960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 835/1650] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:10.376032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.376765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.376875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.377443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.377725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.377920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.378018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.378841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.380471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c766-c7fc-43b9-8adf-cc33c85ae9d2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.395530 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 816/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:10.397023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.397339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.397507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.461271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] MFA Rules not processed for user `654f1e57690f450c8269bf545ac8a214`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:10.463324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.469647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] MFA Rules not processed for user `2095ad464f014a09b8383df800a24dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:10.471903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.590773 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 836/1652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:10.592058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.625594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad247-b741-4b78-9d0a-8527acb26678 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.631845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.632612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.632895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.633211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] PATH_INFO: `/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c/users/0558ebc9efa1407b8e7ec523317ec4c4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.635441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0796e3f43b1f4b2192c5dc4a92af949c, user_id=0558ebc9efa1407b8e7ec523317ec4c4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.640440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62d38d-a556-4ff4-9c74-3cd09b37bd62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.663734 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 837/1653] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:10 2022] PUT /identity/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c/users/0558ebc9efa1407b8e7ec523317ec4c4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:10.665221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.665774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.665774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.704867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 817/1654] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:10.714335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.741691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6da0-331f-4991-b35a-eb99a17dd049 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:10.750159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] MFA Rules not processed for user `c56d5e1333c045ef8433d115f54a13ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:10.753777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.864860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:10.865727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.865915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.866261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] PATH_INFO: `/v3/projects/f46254807cd041168a380adb71aaf2ee/users/07d5a94be0ce409597bd6acee18779bb/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.874591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46254807cd041168a380adb71aaf2ee, user_id=07d5a94be0ce409597bd6acee18779bb, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:10.879771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:10.905005 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 818/1655] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:10 2022] PUT /identity/v3/projects/f46254807cd041168a380adb71aaf2ee/users/07d5a94be0ce409597bd6acee18779bb/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:10.906422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.932230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 838/1656] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:10.932230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:10.933501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.989405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.991302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:11.041096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7656f-4c59-44f3-a101-72c00042b30d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:11.051020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:11.052141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.052503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.052849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] PATH_INFO: `/v3/projects/a642e19be2604d4984af9bbd55808426/users/b3b6d7fa60a04082af41472642f363b3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.055611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a642e19be2604d4984af9bbd55808426, user_id=b3b6d7fa60a04082af41472642f363b3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:11.059421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce5088-4715-4f6b-a8a1-db1ce9428fd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:11.081204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 819/1657] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:10 2022] PUT /identity/v3/projects/a642e19be2604d4984af9bbd55808426/users/b3b6d7fa60a04082af41472642f363b3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:11.081204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17628-5fbf-44a0-a312-4f6349957abd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.081204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17628-5fbf-44a0-a312-4f6349957abd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.081204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17628-5fbf-44a0-a312-4f6349957abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.083744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9389b4-10a2-4f90-938b-bd08f1530a7d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:11.114171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-98f17628-5fbf-44a0-a312-4f6349957abd None None] MFA Rules not processed for user `0558ebc9efa1407b8e7ec523317ec4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:11.115708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-98f17628-5fbf-44a0-a312-4f6349957abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:11.187008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:11.187759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.187972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.188151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.210755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 820/1658] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:11.212450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3beb0-1370-4773-8c23-20ecdc676421 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.212735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3beb0-1370-4773-8c23-20ecdc676421 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.213037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3beb0-1370-4773-8c23-20ecdc676421 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.219726 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 821/1659] 10.222.0.16 () {54 vars in 960 bytes} [Fri Oct 28 09:50:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:11.221345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b28-889c-4180-a6f5-09a7a807ec4c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.221345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b28-889c-4180-a6f5-09a7a807ec4c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.221658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b28-889c-4180-a6f5-09a7a807ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.272023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-83fe9b28-889c-4180-a6f5-09a7a807ec4c None None] MFA Rules not processed for user `07d5a94be0ce409597bd6acee18779bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:11.273411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83fe9b28-889c-4180-a6f5-09a7a807ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:11.277125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:11.278846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2368be-2503-44e3-8db6-f81e731532fb service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:11.299774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 839/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:11.303603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.304554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.305447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.378707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] MFA Rules not processed for user `b3b6d7fa60a04082af41472642f363b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:11.381365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:11.417440 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 822/1661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:11.418736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea304-d5af-4048-ba24-f709cb9babdc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.419020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea304-d5af-4048-ba24-f709cb9babdc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.419302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea304-d5af-4048-ba24-f709cb9babdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.448612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-072ea304-d5af-4048-ba24-f709cb9babdc None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:11.450090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-072ea304-d5af-4048-ba24-f709cb9babdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:11.462768 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 823/1662] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:11.464288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:11.477146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.478111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.479106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.518371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 840/1663] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:11.519272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:11.522854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] MFA Rules not processed for user `791f2111f74a452eaa525d16ce0b6448`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:11.524976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:11.539836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378277-d80e-4f35-b217-513a5efdb3ee None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:11.551129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:11.551843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:11.552118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:11.552420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:11.572769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:11.659989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 824/1664] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:11.664419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:11.666371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:11.697091 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 841/1665] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:12.003682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.065023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3043b-b1ee-49fd-bd38-411285976031 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.114183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.114889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.115363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.115832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.116384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.132686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c84-fccb-444b-bc89-3e5d267d2bcd service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.152439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.153512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.154001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.154548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.275762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.277724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e51d10-9f61-41ec-ad9a-7607040016c9 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.292652 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 842/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:12.293149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.294448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e8c1-6a99-4522-9cb1-b35dddbef299 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.294944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e8c1-6a99-4522-9cb1-b35dddbef299 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.295351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e8c1-6a99-4522-9cb1-b35dddbef299 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.296826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.297712 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 843/1667] 10.222.0.16 () {54 vars in 961 bytes} [Fri Oct 28 09:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:12.303328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.303709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.304076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.315484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 825/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:12.369064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.372354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:12.373649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:12.403528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c9f2-119a-4aa0-a7b9-8892f9b23fa7 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.431898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.432652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.432961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.437373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.449726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 844/1669] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Oct 28 09:50:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:12.457395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.464034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.466407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.475387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985be1f-8bbd-43ad-9956-2310294bb67a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.483074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 826/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:12.484262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.495507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.496823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.497547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.497824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.503407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82212d-92a9-4b6d-95ef-af4cd07e0d55 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.517119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.517303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.517484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.517740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:12.517849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.523280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.524141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:12.526158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.549614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 845/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:12.569452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.571024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308922b-d801-4d33-9c91-7292bb74f0c7 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.595165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 827/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:12.614603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:12.645014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15483fe-d613-4779-aca9-09a0b688147e service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:12.655303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:12.655950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.670959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.671354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.707969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:12.709633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32522ad5-9323-48a4-a265-d360b40614d7 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:12.742055 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 846/1673] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:12.936560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.937033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.937313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:12.939130 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 828/1674] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:12.957032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427ed5-553f-4f1a-9dd4-97b5e9ac6c26 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:12.957323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427ed5-553f-4f1a-9dd4-97b5e9ac6c26 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:12.957600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427ed5-553f-4f1a-9dd4-97b5e9ac6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:13.000662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-40427ed5-553f-4f1a-9dd4-97b5e9ac6c26 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:13.001967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-40427ed5-553f-4f1a-9dd4-97b5e9ac6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:13.019898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 847/1675] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:13.036743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:13.038501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:13.184746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc54b4-508b-485a-b719-eaaca28561d1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:13.190684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:13.191408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:13.191824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:13.192170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:13.210572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:13.213426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e98687-b14d-4f93-9181-f86e1bfe8d0d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:13.252990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 829/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:13.878750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473658-119a-4826-ac6c-007c852cbaf5 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:13.879324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473658-119a-4826-ac6c-007c852cbaf5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:13.879324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473658-119a-4826-ac6c-007c852cbaf5 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:13.881034 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 848/1677] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:13.890723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:13.891017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:13.891296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:13.915583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473658-119a-4826-ac6c-007c852cbaf5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:13.936876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:13.940403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:13.945300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473658-119a-4826-ac6c-007c852cbaf5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:13.956208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:13.957656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:13.958009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:13.958287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:13.966057 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 830/1678] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:14.004814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:14.022619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e8bf-1244-4f84-b7d6-482bb52b30ac None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:14.038545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:14.039219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:14.039437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:14.039711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:14.062364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:14.065912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:14.089833 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 831/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:14.121967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:14.124013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a853f73-08cc-487e-8ba3-3296d5639d9d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:14.139807 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 849/1680] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:14.345656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:14.455721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:14.618151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aea9d-72b9-454d-871e-b4592a253d43 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:14.634871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:14.635540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:14.635889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:14.636165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] PATH_INFO: `/v3/users/745a691d9088440da7260c2d5fbd37e6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:14.637573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745a691d9088440da7260c2d5fbd37e6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:14.640469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:14.735307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745a691d9088440da7260c2d5fbd37e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:14.735991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745a691d9088440da7260c2d5fbd37e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:14.736613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745a691d9088440da7260c2d5fbd37e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:14.749005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745a691d9088440da7260c2d5fbd37e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:14.770123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9df60000-7d64-42ac-b7ff-2ccc69e40ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745a691d9088440da7260c2d5fbd37e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:14.810082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e48e-715e-41b3-9605-be5ac5fe8569 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:14.811333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e48e-715e-41b3-9605-be5ac5fe8569 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:14.813003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e48e-715e-41b3-9605-be5ac5fe8569 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:14.816308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 850/1681] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:50:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:14.827505 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 832/1682] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:14 2022] DELETE /identity/v3/users/745a691d9088440da7260c2d5fbd37e6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:14.833744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:14.834288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:14.834405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:14.834656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:14.834930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:14.835368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:14.900142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:14.901454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:14.920435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:14.930336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:15.155446 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 833/1683] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:15.188326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:15.189880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:15.202413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 851/1684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:15.206507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d56daf-89c7-429d-96d1-87eebb8e9588 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:15.213473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:15.215040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:15.223610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:15.225549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:15.225726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:15.226428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:15.282786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:15.290170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:15.338777 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 834/1685] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:15.463569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e515e1-208f-43ed-96c8-b83b0ec6a8df None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:15.484029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:15.486458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:15.487374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:15.487668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:15.528855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:15.532429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d282-dd76-4960-9676-8bd893cde1f2 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:15.545276 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 852/1686] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:15.738932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:15.740704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:15.793524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:15.906152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b16c9-47c3-468f-a12c-419217a873ec service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:15.915306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:15.916253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:15.916732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:15.917510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:15.921055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.050424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:16.058193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:16.090082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609cc9-4a79-4846-8bcc-465eccd5e898 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:16.090704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609cc9-4a79-4846-8bcc-465eccd5e898 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:16.090704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609cc9-4a79-4846-8bcc-465eccd5e898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:16.104102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 835/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:16.156320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:16.227373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:16.239632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.240503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02609cc9-4a79-4846-8bcc-465eccd5e898 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:16.241991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02609cc9-4a79-4846-8bcc-465eccd5e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.280013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7128f-0026-47a9-9da5-a4b07bb1ed67 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:16.303433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:16.305238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:16.305775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:16.306255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] PATH_INFO: `/v3/users/f106553152274aae929db0aad88bda5c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:16.309708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f106553152274aae929db0aad88bda5c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:16.317536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:16.473433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 853/1688] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:16.489987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f106553152274aae929db0aad88bda5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:16.491665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f106553152274aae929db0aad88bda5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:16.491886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f106553152274aae929db0aad88bda5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:16.506059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f106553152274aae929db0aad88bda5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:16.535654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f106553152274aae929db0aad88bda5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:16.572405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 836/1689] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:16 2022] DELETE /identity/v3/users/f106553152274aae929db0aad88bda5c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:16.573766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121308-afa3-40fc-9251-a114f21d9f44 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:16.574043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121308-afa3-40fc-9251-a114f21d9f44 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:16.574473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121308-afa3-40fc-9251-a114f21d9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:16.609079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bb121308-afa3-40fc-9251-a114f21d9f44 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:16.610348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bb121308-afa3-40fc-9251-a114f21d9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.662186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:16.663418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.786723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:16.862382 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 854/1690] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:16.865886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:16.867390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:16.868218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:16.940402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e61d2-2f7f-43b3-a03a-f86c2edbd055 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:16.956576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:16.958499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:16.959525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:16.961394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:16.969297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:16.986840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] MFA Rules not processed for user `a60610c78b5844f78f3ac3a7d421df53`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:16.989182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:17.214091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:17.217362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:17.245436 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 855/1691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:17.246520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:17.250113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:17.267734 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 837/1692] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:50:17.292613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe7d3-5015-4617-8765-2dcb05c7ea82 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:17.300947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:17.308608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:17.308608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:17.308608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:17.309018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] PATH_INFO: `/v3/projects/a01b83f9af02492bbefb6ccc4ea0c170` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:17.310642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01b83f9af02492bbefb6ccc4ea0c170)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:17.316252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:17.317365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:17.377024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:17.545704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01b83f9af02492bbefb6ccc4ea0c170', 'request_id': 'req-8a0a195d-668e-4e63-a219-5406410a534f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:17.571807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01b83f9af02492bbefb6ccc4ea0c170', 'request_id': 'req-8a0a195d-668e-4e63-a219-5406410a534f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:17.589103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01b83f9af02492bbefb6ccc4ea0c170', 'request_id': 'req-8a0a195d-668e-4e63-a219-5406410a534f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:17.634328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] The token cache is being invalidate because project a01b83f9af02492bbefb6ccc4ea0c170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:17.638614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:17.655992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:17.658791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 856/1693] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:17 2022] DELETE /identity/v3/projects/a01b83f9af02492bbefb6ccc4ea0c170 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:17.666311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:17.674900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:17.675389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b59e9-90bb-4927-bf22-af6dc1b2ef7c service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:17.867561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a195d-668e-4e63-a219-5406410a534f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:17.885666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:17.887239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:17.887801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:17.888218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:17.891042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:17.897404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:17.985887 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 857/1694] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:17 2022] POST /identity/v3/projects => generated 403 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:17.985887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:17.988273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.063492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:18.071678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.073700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.074441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.090176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.162976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:18.166789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:18.187844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc17c6a-871a-4c85-b3eb-481d5f30c37b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:18.212633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:18.213503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.213865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.214145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] PATH_INFO: `/v3/users/df8c883886b54a8bb9592bc0ae1d5d05` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.217486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8c883886b54a8bb9592bc0ae1d5d05)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:18.218691 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:18.218691 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 09:50:18.218691 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 09:50:18.220014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:18.232461 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 838/1695] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 933 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:18.233950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:18.247425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.302497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c19e4-b181-406a-88ee-83335e3a3f39 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:18.322922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:18.324099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.326830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.328524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] PATH_INFO: `/v3/users/c56d5e1333c045ef8433d115f54a13ae` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.334954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56d5e1333c045ef8433d115f54a13ae)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:18.339596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:18.360131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:18.390528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:18.448001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8c883886b54a8bb9592bc0ae1d5d05'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.449745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8c883886b54a8bb9592bc0ae1d5d05'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.468500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8c883886b54a8bb9592bc0ae1d5d05'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.498464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8c883886b54a8bb9592bc0ae1d5d05'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.501141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8c883886b54a8bb9592bc0ae1d5d05'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.532584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56d5e1333c045ef8433d115f54a13ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.535563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56d5e1333c045ef8433d115f54a13ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.538739 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 858/1696] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:17 2022] DELETE /identity/v3/users/df8c883886b54a8bb9592bc0ae1d5d05 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:18.539987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:18.541749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.542513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56d5e1333c045ef8433d115f54a13ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.586559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56d5e1333c045ef8433d115f54a13ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.610009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-425ae749-f7d4-439e-90e7-bc8034784a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56d5e1333c045ef8433d115f54a13ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:18.668660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcabcd-2e71-48f9-b126-28265efbacd4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:18.700447 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 839/1697] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:18 2022] DELETE /identity/v3/users/c56d5e1333c045ef8433d115f54a13ae => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:18.712087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.712459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.712739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.720130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:18.728582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.731691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.732003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.737028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:18.747211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1864aa-e4f4-48ca-b502-f0c0ac853d88 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:18.788370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:18.793994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.821775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 859/1698] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:18 2022] POST /identity/v3/users => generated 308 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:18.823865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:18.824505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:18.825056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:18.857298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] MFA Rules not processed for user `c5991ee8e3634d2f9b3a355ba48ffecc`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:18.858061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:18.984132 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 860/1699] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:18.986143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:18.988779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:19.036219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 840/1700] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:19.040123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:19.063448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:19.102039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:19.160978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1210-7ea0-4afd-84e9-c4ba4681c484 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.187296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.190971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.196480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.197058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.205617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.214472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:19.267578 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 861/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:19.269673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:19.277624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:19.313640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8f20-ed43-486e-85c4-cbe759336322 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.343691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.346501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.347099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.348711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.353268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:19.385252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.390144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:19.436610 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 841/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:19.439948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:19.476844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad62f-2e44-47ec-9537-56007d52e88d service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.488227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.489832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.491307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.492024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] PATH_INFO: `/v3/projects/847a112052f840a89538a8284ec4d0c3/users/166235c454c143b3981b9ca4e44e5581/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.501305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:19.517685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c81742-a5f6-4f8c-9d80-b035cb9f66c7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.529654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.531121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.534294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=847a112052f840a89538a8284ec4d0c3, user_id=166235c454c143b3981b9ca4e44e5581, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.540214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:19.540678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.541176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.573076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.575251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:19.575858 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 842/1703] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:19 2022] PUT /identity/v3/projects/847a112052f840a89538a8284ec4d0c3/users/166235c454c143b3981b9ca4e44e5581/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:19.581868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:19.602070 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 862/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:19.831749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4409b-0303-4e68-9ae6-5626465e0b5f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.850630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.852328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.854331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.855393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.858183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.865236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:19.900746 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 843/1705] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:50:19.904230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:19.921664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c54f-0537-4e89-9962-512bba23f38b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:19.942949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:19.945489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:19.945804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:19.946059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] PATH_INFO: `/v3/projects/847a112052f840a89538a8284ec4d0c3/users/166235c454c143b3981b9ca4e44e5581/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:19.959579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847a112052f840a89538a8284ec4d0c3, user_id=166235c454c143b3981b9ca4e44e5581, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:19.974695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:20.005901 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 863/1706] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:19 2022] PUT /identity/v3/projects/847a112052f840a89538a8284ec4d0c3/users/166235c454c143b3981b9ca4e44e5581/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:21.532612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:21.538669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:21.563763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:21.565731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:21.602689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba76bc-2e3f-46ee-814d-1de9f7b33e00 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:21.834880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:21.835614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:21.835902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:21.836172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] PATH_INFO: `/v3/projects/3da414c799b34d0497eb980a21b99e7d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:21.837638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da414c799b34d0497eb980a21b99e7d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:21.838697 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:21.838697 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 09:50:21.838697 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 09:50:21.839947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:21.954404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58f20-9427-46c6-9800-c91be54d52b5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:21.991467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:21.996022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:21.996423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:21.996698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] PATH_INFO: `/v3/projects/40af626471a9471d94974b2fa497f903` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.002902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=40af626471a9471d94974b2fa497f903)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:22.020893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:22.047751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da414c799b34d0497eb980a21b99e7d', 'request_id': 'req-6e4b71ef-22c8-4b4c-9b2f-755086178d74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.071422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da414c799b34d0497eb980a21b99e7d', 'request_id': 'req-6e4b71ef-22c8-4b4c-9b2f-755086178d74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.085814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da414c799b34d0497eb980a21b99e7d', 'request_id': 'req-6e4b71ef-22c8-4b4c-9b2f-755086178d74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.162079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] The token cache is being invalidate because project 3da414c799b34d0497eb980a21b99e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:22.162437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.167494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6e4b71ef-22c8-4b4c-9b2f-755086178d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.178548 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 844/1707] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:21 2022] DELETE /identity/v3/projects/3da414c799b34d0497eb980a21b99e7d => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:22.182611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86a39-2291-40fd-8418-23283bf75ee1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:22.185553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86a39-2291-40fd-8418-23283bf75ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:22.203206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86a39-2291-40fd-8418-23283bf75ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.204279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40af626471a9471d94974b2fa497f903', 'request_id': 'req-76e7beb8-621b-4958-965e-83463accd1ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.221623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40af626471a9471d94974b2fa497f903', 'request_id': 'req-76e7beb8-621b-4958-965e-83463accd1ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.236269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40af626471a9471d94974b2fa497f903', 'request_id': 'req-76e7beb8-621b-4958-965e-83463accd1ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.242139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:22.269526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] The token cache is being invalidate because project 40af626471a9471d94974b2fa497f903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:22.270042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.271018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76e7beb8-621b-4958-965e-83463accd1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.281652 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 864/1708] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:21 2022] DELETE /identity/v3/projects/40af626471a9471d94974b2fa497f903 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:22.283344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:22.283749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:22.284128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.299044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:22.312344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:22.313856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.397625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eac86a39-2291-40fd-8418-23283bf75ee1 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:22.409172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eac86a39-2291-40fd-8418-23283bf75ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.441849 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 865/1709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:22.441849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:22.441849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.467681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30feb4-a520-41bc-8658-2c155d247a62 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:22.478542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:22.479320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:22.479676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:22.480043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] PATH_INFO: `/v3/users/2095ad464f014a09b8383df800a24dfa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.481545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2095ad464f014a09b8383df800a24dfa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:22.484435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:22.607832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 845/1710] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 28 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:22.611636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:22.613574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:22.613935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.710213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:22.714522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.747208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2095ad464f014a09b8383df800a24dfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.752201 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 846/1711] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:22.756522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2095ad464f014a09b8383df800a24dfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.782148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:22.798616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2095ad464f014a09b8383df800a24dfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.811945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc9bd8-efa1-41ec-bc1d-675810f909ff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:22.838870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:22.839591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:22.839882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:22.840155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:22.840827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:22.841167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:22.842126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2095ad464f014a09b8383df800a24dfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.847041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2095ad464f014a09b8383df800a24dfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:22.855045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:22.915555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 847/1712] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:22.918966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:22.928661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.956398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 866/1713] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:22 2022] DELETE /identity/v3/users/2095ad464f014a09b8383df800a24dfa => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:22.957878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:22.960093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:22.967922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6e278-db3f-40cb-ab92-8274a314e77b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:23.191265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f8c32-e138-40a6-8ef5-a4fbf66bcfbc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:23.197408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:23.198059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:23.198402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:23.198671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:23.200651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:23.232007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:23.235138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:23.290874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 867/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:23.292317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:23.294304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:23.339020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12729-f01a-4c80-b65e-06b1a0d92211 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:23.346318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:23.347035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:23.347319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:23.347589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:23.358037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:23.359195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:23.359500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:23.359826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] PATH_INFO: `/v3/projects/5b682726fc4b40909ff68883cb657fad` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:23.366242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b682726fc4b40909ff68883cb657fad)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:23.375719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:23.387422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:23.390363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:23.399428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:23.412282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 868/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:23.413705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:23.416444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:23.458457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165b61-b892-44e5-af9e-9a0780138979 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:23.464510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:23.465601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:23.465946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:23.467632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:23.469536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:23.473553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:23.590568 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 869/1716] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:23 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:23.608675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b682726fc4b40909ff68883cb657fad', 'request_id': 'req-f3817be6-c4f1-4a74-b634-a3cc433298ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:23.611041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:23.648691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b682726fc4b40909ff68883cb657fad', 'request_id': 'req-f3817be6-c4f1-4a74-b634-a3cc433298ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:23.680950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b682726fc4b40909ff68883cb657fad', 'request_id': 'req-f3817be6-c4f1-4a74-b634-a3cc433298ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:23.760548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] The token cache is being invalidate because project 5b682726fc4b40909ff68883cb657fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:23.760852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:23.770919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:23.790948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 848/1717] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:22 2022] DELETE /identity/v3/projects/5b682726fc4b40909ff68883cb657fad => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:23.794896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:23.801680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:23.909685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:24.121516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3817be6-c4f1-4a74-b634-a3cc433298ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:24.127841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68ff7e-88c3-46ce-a69d-a60add381683 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:24.135313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:24.139836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:24.140420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:24.141397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] PATH_INFO: `/v3/users/b3b6d7fa60a04082af41472642f363b3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:24.144071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b6d7fa60a04082af41472642f363b3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:24.148729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:24.174208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:24.175203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:24.175774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:24.176165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:24.177137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:24.195158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:24.336673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 870/1718] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:23 2022] POST /identity/v3/users => generated 301 bytes in 724 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:24.356949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:24.362417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:24.396219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b6d7fa60a04082af41472642f363b3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:24.398382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261605d-1db4-4ec9-bf5f-6b24a92b5006 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:24.398788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b6d7fa60a04082af41472642f363b3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:24.402570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b6d7fa60a04082af41472642f363b3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:24.423998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:24.433776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:24.436278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:24.437623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b6d7fa60a04082af41472642f363b3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:24.438315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:24.445452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:24.455552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fc779-976c-4473-9041-cab344586d82 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:24.478399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b6d7fa60a04082af41472642f363b3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:24.556129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 849/1719] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:23 2022] DELETE /identity/v3/users/b3b6d7fa60a04082af41472642f363b3 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:24.576824 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 871/1720] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:24.580643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:24.588156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:24.782316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:24.782666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:24.782946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:24.838997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:24.843521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:24.861526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d7a2-73de-4569-a6c4-4fd91a6e9c7b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:24.883762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:24.887571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:24.887851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:24.891094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:24.894498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:24.902029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:24.955513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 850/1721] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:24.957587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:24.986948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a71-645b-4433-bb0d-8ecbdb9c0b86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:25.002225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:25.003040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:25.003330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:25.003610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] PATH_INFO: `/v3/projects/6953e96131d3458fadd730f1f83307a9/users/cd8355b7da04450080c2cc59ab5b5857/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:25.048218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6953e96131d3458fadd730f1f83307a9, user_id=cd8355b7da04450080c2cc59ab5b5857, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:25.049210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 872/1722] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:25.065348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff908-5f6e-4b5e-be24-542e119d782b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:25.120977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:25.122424 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 851/1723] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:24 2022] PUT /identity/v3/projects/6953e96131d3458fadd730f1f83307a9/users/cd8355b7da04450080c2cc59ab5b5857/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:25.122567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:25.143903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:25.145961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:25.146925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:25.199740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:25.247739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] MFA Rules not processed for user `cd8355b7da04450080c2cc59ab5b5857`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:25.251626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:25.390548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:25.411061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d327-e99d-4b83-8fae-07db2ebef7d5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:25.599553 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 852/1724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:25 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:25.613766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:25.634902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:25.636046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:25.636341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:25.636674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:25.890644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:25.894005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:25.945523 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 873/1725] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 825 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:26.003171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551547e-8542-4659-88e9-97648dca98e9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:26.023559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:26.026057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:26.026432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:26.026713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:26.029474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:26.035297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:26.146508 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 853/1726] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:25 2022] POST /identity/v3/projects => generated 403 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:26.147714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:26.150820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:26.151340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:26.204245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999af2c-ba82-4b1e-9110-e9ea1f29e323 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:26.313683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914ee02-a49d-4b03-9cb3-7f737bd3b7a7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:26.322817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:26.323804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:26.324317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:26.325552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:26.327064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:26.334285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:26.389435 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 854/1727] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:26 2022] POST /identity/v3/users => generated 308 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:26.396377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:26.436815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb0036-f70a-41fd-9156-a37bc94072e9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:26.468895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:26.469430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:26.469696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:26.470002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:26.470764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:26.473092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:26.509843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:26.510732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:26.510885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:26.511061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] PATH_INFO: `/v3/projects/b9bb99f609d84679a29406443716d2f1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:26.520946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bb99f609d84679a29406443716d2f1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:26.523117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:26.538786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 855/1728] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:26.540985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:26.552189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:26.571058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f621-ab5b-40a6-bad3-9550aa63ea3e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:26.603947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:26.604557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:26.605078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:26.608055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] PATH_INFO: `/v3/projects/c78a88291147438bb1af6d84f4771343/users/8ffa907aef9a44918a14845e1171c7d3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:26.662327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a88291147438bb1af6d84f4771343, user_id=8ffa907aef9a44918a14845e1171c7d3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:26.665727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:26.707984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 856/1729] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:26 2022] PUT /identity/v3/projects/c78a88291147438bb1af6d84f4771343/users/8ffa907aef9a44918a14845e1171c7d3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:26.714009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:26.900980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:26.920674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bb99f609d84679a29406443716d2f1', 'request_id': 'req-c4e47e19-ed53-4148-be55-691632750047'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:26.980287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bb99f609d84679a29406443716d2f1', 'request_id': 'req-c4e47e19-ed53-4148-be55-691632750047'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:26.982259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4ae-6acc-4ab2-9adb-e7f77b512737 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:27.033639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bb99f609d84679a29406443716d2f1', 'request_id': 'req-c4e47e19-ed53-4148-be55-691632750047'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:27.114961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] The token cache is being invalidate because project b9bb99f609d84679a29406443716d2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:27.115259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:27.117585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4e47e19-ed53-4148-be55-691632750047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:27.130099 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 874/1730] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:26 2022] DELETE /identity/v3/projects/b9bb99f609d84679a29406443716d2f1 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:27.140819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258204-36a8-420e-b67c-f6902cf838f5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.141324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258204-36a8-420e-b67c-f6902cf838f5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.141858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258204-36a8-420e-b67c-f6902cf838f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.309747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bf258204-36a8-420e-b67c-f6902cf838f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:27.315137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf258204-36a8-420e-b67c-f6902cf838f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:27.360325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:27.361554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.362081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.362583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.363839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:27.391709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c498-b682-4123-842b-ac76bd6f39c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:27.451488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 857/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 737 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:50:27.455113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.455475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.455715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.461365 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 858/1732] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:50:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:27.464953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:27.471455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:27.512977 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 875/1733] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:27.537807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a36ad-056a-4bb7-b083-4192b97625cc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:27.537807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:27.538243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a6a7-bbf8-4661-817b-dff621f9910e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.538243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a6a7-bbf8-4661-817b-dff621f9910e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.538243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a6a7-bbf8-4661-817b-dff621f9910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.538617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.546168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.546168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] PATH_INFO: `/v3/projects/c78a88291147438bb1af6d84f4771343/users/8ffa907aef9a44918a14845e1171c7d3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.551011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a88291147438bb1af6d84f4771343, user_id=8ffa907aef9a44918a14845e1171c7d3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:27.561725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93573a9f-f91c-4cf1-9b52-612b5c20a1e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:27.637340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8d5a6a7-bbf8-4661-817b-dff621f9910e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:27.639416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8d5a6a7-bbf8-4661-817b-dff621f9910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:27.682934 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 859/1734] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:27 2022] PUT /identity/v3/projects/c78a88291147438bb1af6d84f4771343/users/8ffa907aef9a44918a14845e1171c7d3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:27.701899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:27.704071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:27.707969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:27.915104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] MFA Rules not processed for user `8ffa907aef9a44918a14845e1171c7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:27.924240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:28.071935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 876/1735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:28.076706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:28.079392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:28.084184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:28.174572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:28.176302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:28.437735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:28.557530 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 860/1736] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 856 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:28.557530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:28.605439 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 877/1737] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:50:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:28.615346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:28.633605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:28.677828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93736ac7-15f8-49f0-96a8-c9b2f90864b1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:28.727801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee39c-e6c9-4692-b53c-0da64b8ce2da None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:28.733734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:28.735015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:28.735554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:28.736079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:28.737320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:28.737921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:28.739998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:28.752226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:28.755891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:28.756312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:28.756505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] PATH_INFO: `/v3/projects/a642e19be2604d4984af9bbd55808426` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:28.761652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a642e19be2604d4984af9bbd55808426)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:28.764120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:28.774963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:28.779311 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 861/1738] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:28.780619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:28.782859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:28.822425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e83d1c-bc53-4feb-971f-04f10810b7a4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:28.831516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:28.835570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:28.836006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:28.836388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:28.867651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:28.869732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:28.905496 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 862/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:28 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:28.922866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:28.957928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4f452-a256-47ce-8306-aafddfc587c9 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:29.036976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a642e19be2604d4984af9bbd55808426', 'request_id': 'req-b3f7e0c9-430f-4797-952a-cb6f37847961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:29.056841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a642e19be2604d4984af9bbd55808426', 'request_id': 'req-b3f7e0c9-430f-4797-952a-cb6f37847961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:29.067841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a642e19be2604d4984af9bbd55808426', 'request_id': 'req-b3f7e0c9-430f-4797-952a-cb6f37847961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:29.103193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] The token cache is being invalidate because project a642e19be2604d4984af9bbd55808426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:29.103588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:29.108472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:29.116593 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 878/1740] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:28 2022] DELETE /identity/v3/projects/a642e19be2604d4984af9bbd55808426 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:29.118709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:29.122010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:29.203193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:29.204364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.205061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.206098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.206927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:29.211690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c9fb-a8db-4310-bba2-570190484016 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:29.306834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 863/1741] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:28 2022] POST /identity/v3/projects => generated 375 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:29.310292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.312186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.312611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.383129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:29.391003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:29.395466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e0c9-430f-4797-952a-cb6f37847961 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:29.544488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 864/1742] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:29.545694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:29.547398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:29.613179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74fb11-9179-4c8f-95cc-517b18c44a62 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:29.633680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:29.634380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.634676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.634954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.635644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:29.637765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7016ac5-2a2d-4b5a-97cd-c35e13c87c5d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:29.702382 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 865/1743] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:29 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:29.710288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.710727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.712226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:29.713009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.716445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.720769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.722056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.734242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:29.762953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:29.772234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:29.804702 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 866/1744] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:29.806009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:29.816263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:29.816678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:29.841823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fa2de-b205-4e4d-b18b-84b4fcdc24e3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:29.866483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:29.867367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.868684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.870339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.873645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:29.877940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 879/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:29.887753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:29.896444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:29.914674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c93df-1422-40c6-b225-5e010bec0eca service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:29.926485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:29.927786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:29.928323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:29.928783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:29.930175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:29.931711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:29.935949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:29.942166 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 867/1746] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:29.957803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:29.974811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:29.986500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 880/1747] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:29.990966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:30.006838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872abda-ccd4-4e8a-9f56-a99d11aba211 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:30.038670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db608a27-8ffb-485e-a8da-3fa870bf6ccd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:30.051521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:30.052222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:30.052506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:30.052778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:30.053487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:30.055156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:30.067858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:30.068831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:30.070457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:30.070948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:30.073666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:30.088256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:30.100503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 868/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:30.106727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:30.136242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60061-e0bf-4c7c-8d6a-6d2285b7ef23 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:30.173581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:30.174293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:30.174584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:30.174864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] PATH_INFO: `/v3/projects/52ff249ad8e3441885b7a01001a36628/users/3fab2b378c624925ba5eaf18d8d7a4e5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:30.188428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:30.234751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 881/1749] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:29 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:50:30.236799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:30.245337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ff249ad8e3441885b7a01001a36628, user_id=3fab2b378c624925ba5eaf18d8d7a4e5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:30.256879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:30.302970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 869/1750] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:30 2022] PUT /identity/v3/projects/52ff249ad8e3441885b7a01001a36628/users/3fab2b378c624925ba5eaf18d8d7a4e5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:30.306450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:30.534298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b30d42-3130-4403-8066-8a48eb8a1875 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:30.651460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d6ad-d02b-4dd5-80de-bbbfc8e4c97f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:30.682629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:30.684048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:30.686059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:30.687768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:30.699989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:30.907512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:30.916475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:30.920832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:30.921523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:30.937918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:30.953047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1648c-53ec-4e52-bd49-02f9cb2cc60f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:31.032567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:31.039741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:31.094221 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 882/1751] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:30 2022] POST /identity/v3/users => generated 285 bytes in 858 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:31.105319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.106737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.108370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:31.110497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 870/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:31.113827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:31.224552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6258-1b8c-4c1f-80cf-3eaebe7c1d44 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:31.295879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:31.298988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.306544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:31.312796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.315156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:31.316753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:31.320194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:31.322281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:31.400230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 883/1753] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:31.410997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 871/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:31.413243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:31.438753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abf27-306c-47b7-b98f-ae86640897e1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:31.447168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:31.448039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.448605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.449059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:31.450333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:31.459776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:31.489195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 884/1755] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:31.495189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:31.499605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:31.507725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:31.540621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc944066-8f03-4d42-8bf8-fcf1051a83bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:31.566751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:31.569043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.572191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.573666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] PATH_INFO: `/v3/projects/0707c089a50949f389081dd2783fd1c3/users/3c9cc34e6b9d4d5a9a449f146649881c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:31.647481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0707c089a50949f389081dd2783fd1c3, user_id=3c9cc34e6b9d4d5a9a449f146649881c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:31.661217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6adec-e5ae-4581-9538-b3f2b31fd7a6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:31.737287 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 885/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:31 2022] PUT /identity/v3/projects/0707c089a50949f389081dd2783fd1c3/users/3c9cc34e6b9d4d5a9a449f146649881c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:31.738789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a703cd-abdb-4932-b3ec-5a5e6680487c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:31.743158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.743755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.744052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:31.812729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:31.828296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] MFA Rules not processed for user `3c9cc34e6b9d4d5a9a449f146649881c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:31.842670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:31.939966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:31.948137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:31.949157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:31.949621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:31.950529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:32.163509 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 886/1757] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:32.165335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:32.213237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:32.214861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:32.244127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 872/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:32.367321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72a53-e89e-4ea8-908e-a6a140979017 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:32.405066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:32.414620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:32.415219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:32.418461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:32.419909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:32.432232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:32.554976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:32.558495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:32.567548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 887/1759] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:32 2022] POST /identity/v3/projects => generated 371 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:32.573829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:32.590012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac15b8-e7c0-450d-ada1-eebb7dd8570b service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:32.854367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:32.856023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:32.856523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:32.857056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] PATH_INFO: `/v3/users/cd8355b7da04450080c2cc59ab5b5857` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:32.873369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8355b7da04450080c2cc59ab5b5857)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:32.877591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:32.966002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe91a7e-f4bf-4727-81ab-ddc1dea35fbf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:32.994769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:32.995930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:32.996408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:33.008898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:33.027285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:33.035509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:33.063952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8355b7da04450080c2cc59ab5b5857'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:33.065460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8355b7da04450080c2cc59ab5b5857'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:33.082250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8355b7da04450080c2cc59ab5b5857'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:33.097049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8355b7da04450080c2cc59ab5b5857'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:33.111779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-64f1f968-4374-462a-b0ea-60f566392e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8355b7da04450080c2cc59ab5b5857'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:33.140193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:33.166662 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 888/1760] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:32 2022] POST /identity/v3/users => generated 292 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:50:33.167450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 873/1761] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:32 2022] DELETE /identity/v3/users/cd8355b7da04450080c2cc59ab5b5857 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:33.169133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:33.174759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:33.175193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:33.175781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:33.187819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:33.278325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0084de7-edb8-4ce0-94cf-abafab6f4655 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:33.280271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:33.288074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:33.488815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:33.563498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:33.564575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:33.564986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:33.565823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:33.566139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:33.568219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:33.598878 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 889/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:33.602359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:33.637821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92655dc3-e01b-4d75-94a1-2ac8e7214f2f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:33.666355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:33.668399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:33.669254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:33.670068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] PATH_INFO: `/v3/projects/975e94d2f3e247c2a55885eb581ecb41/users/7dde38cd626d444c9f3ae70f3c880d5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:33.681978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 874/1763] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:33.725355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] RBAC: Authorizing `identity:create_grant(project_id=975e94d2f3e247c2a55885eb581ecb41, user_id=7dde38cd626d444c9f3ae70f3c880d5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:33.735134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:33.806316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 890/1764] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:33 2022] PUT /identity/v3/projects/975e94d2f3e247c2a55885eb581ecb41/users/7dde38cd626d444c9f3ae70f3c880d5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:33.807007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:33.822421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2d801-4f94-4d9f-8ff4-0ecb6d87860b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:33.923654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:33.928768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:34.112894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:34.113773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:34.113886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:34.118932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:34.119705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:34.121431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:34.192497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08326d5a-3915-4ac9-b93e-61dff166295d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:34.199156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 875/1765] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:50:34.206804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:34.207871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:34.208723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:34.209125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:34.209589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:34.241755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb45ff-a85a-4d77-a8fd-451896f9cf41 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:34.250307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:34.262220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c8d35-b230-47b6-85fe-d5bcc983b6b2 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:34.276417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:34.276953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:34.277278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:34.277541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] PATH_INFO: `/v3/projects/975e94d2f3e247c2a55885eb581ecb41/users/7dde38cd626d444c9f3ae70f3c880d5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:34.299682 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 891/1766] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:34.301327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] RBAC: Authorizing `identity:create_grant(project_id=975e94d2f3e247c2a55885eb581ecb41, user_id=7dde38cd626d444c9f3ae70f3c880d5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:34.322295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18693d4b-4fc0-409f-b180-f5d54d0b41af admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:34.369732 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 876/1767] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:34 2022] PUT /identity/v3/projects/975e94d2f3e247c2a55885eb581ecb41/users/7dde38cd626d444c9f3ae70f3c880d5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:34.382447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8369d0-69cd-40d9-984d-d7be55ca89c2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:34.382711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8369d0-69cd-40d9-984d-d7be55ca89c2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:34.383057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8369d0-69cd-40d9-984d-d7be55ca89c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:34.482000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cf8369d0-69cd-40d9-984d-d7be55ca89c2 None None] MFA Rules not processed for user `7dde38cd626d444c9f3ae70f3c880d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:34.483635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cf8369d0-69cd-40d9-984d-d7be55ca89c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:34.791931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 892/1768] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:35.101858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:35.102603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:35.103189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:35.105227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 877/1769] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:35.118809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:35.128456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:35.128456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:35.214999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:35.217239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:35.355602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:35.483764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 893/1770] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:35.687042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:35.699218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:35.780723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736f4a-480f-4d39-8ed9-441708e93f20 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:35.802428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:35.803571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:35.804061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:35.804874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:35.827339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:35.829427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442f-ac91-424a-a184-5018d3d346f4 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:35.864872 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 878/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:36.079771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:36.105215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d0252-78a8-460b-a019-ef9c13c37c70 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:36.147003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:36.151218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:36.151650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:36.151818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:36.181322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:36.187016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:36.192470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:36.192747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:36.193023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:36.278965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 894/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:36.281593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:36.283111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:36.593612 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 879/1773] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Oct 28 09:50:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:36.697752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:36.759168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:36.761130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:36.818082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:36.989493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589d7a-8feb-494e-88d6-2b318209c536 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:37.030648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:37.031589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.031908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.032255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] PATH_INFO: `/v3/users/3c9cc34e6b9d4d5a9a449f146649881c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:37.034492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9cc34e6b9d4d5a9a449f146649881c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:37.036703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:37.129376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73730df4-4672-48a6-8c88-f5198322c8d6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:37.153287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:37.155015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.156488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.157287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] PATH_INFO: `/v3/projects/6953e96131d3458fadd730f1f83307a9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:37.161151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6953e96131d3458fadd730f1f83307a9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:37.177634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:37.244238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9cc34e6b9d4d5a9a449f146649881c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.246006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9cc34e6b9d4d5a9a449f146649881c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.272276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9cc34e6b9d4d5a9a449f146649881c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.295340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9cc34e6b9d4d5a9a449f146649881c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.296827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9cc34e6b9d4d5a9a449f146649881c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.357600 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 895/1774] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:36 2022] DELETE /identity/v3/users/3c9cc34e6b9d4d5a9a449f146649881c => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:37.367353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:37.371126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:37.433563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6953e96131d3458fadd730f1f83307a9', 'request_id': 'req-d878372f-33d0-401f-ac43-6bc727425877'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.464036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6953e96131d3458fadd730f1f83307a9', 'request_id': 'req-d878372f-33d0-401f-ac43-6bc727425877'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.492991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6953e96131d3458fadd730f1f83307a9', 'request_id': 'req-d878372f-33d0-401f-ac43-6bc727425877'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.537060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] The token cache is being invalidate because project 6953e96131d3458fadd730f1f83307a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:37.539677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.543753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d878372f-33d0-401f-ac43-6bc727425877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:37.550173 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 880/1775] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:36 2022] DELETE /identity/v3/projects/6953e96131d3458fadd730f1f83307a9 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:37.557979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.558240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.558619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:37.574538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:37.635542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:37.640305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:37.643209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6efbb-55d2-4550-9480-24196b2fad8b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:37.828036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:37.828567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.828847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.829150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:37.836377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:37.866414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 881/1776] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:37.879661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:37.881799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:37.883391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:37.887965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:37.918760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 896/1777] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:37.920450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:37.927040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:37.932947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afb7b7-1a08-47dc-8884-e429273cc66b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:37.951025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:37.951857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.952376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.952943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] PATH_INFO: `/v3/users/8ffa907aef9a44918a14845e1171c7d3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:37.955557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffa907aef9a44918a14845e1171c7d3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:37.957711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:37.969814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f8f4-3b07-4fb8-98d9-7f765240cd3d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:37.981427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:37.982069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:37.982445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:37.982677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:38.006929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:38.008346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:38.030274 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 897/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:38.203970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:38.239857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffa907aef9a44918a14845e1171c7d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:38.243940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffa907aef9a44918a14845e1171c7d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:38.247649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffa907aef9a44918a14845e1171c7d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:38.286592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffa907aef9a44918a14845e1171c7d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:38.305017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffa907aef9a44918a14845e1171c7d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:38.347813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 882/1779] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:37 2022] DELETE /identity/v3/users/8ffa907aef9a44918a14845e1171c7d3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:39.145640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:39.210301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc543-27da-4792-a085-d59d47c7e1ca service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:39.399685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:39.401154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:39.401729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:39.402963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] PATH_INFO: `/v3/projects/c78a88291147438bb1af6d84f4771343` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:39.405518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a88291147438bb1af6d84f4771343)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:39.411424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:39.503688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:39.505340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:39.524055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a456-b451-4a90-a092-35bfaf753ecc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:39.560888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:39.563163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:39.563163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:39.563163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] PATH_INFO: `/v3/projects/0707c089a50949f389081dd2783fd1c3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:39.572992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0707c089a50949f389081dd2783fd1c3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:39.575274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:39.636776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a88291147438bb1af6d84f4771343', 'request_id': 'req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.665837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a88291147438bb1af6d84f4771343', 'request_id': 'req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.683157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a88291147438bb1af6d84f4771343', 'request_id': 'req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.694121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0707c089a50949f389081dd2783fd1c3', 'request_id': 'req-8038afcc-3f91-4583-8417-11ff4fcafc6d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.727565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] The token cache is being invalidate because project c78a88291147438bb1af6d84f4771343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:39.728090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.730793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58e0a598-ba52-4dc2-9d9b-173b2f0e3489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.735445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0707c089a50949f389081dd2783fd1c3', 'request_id': 'req-8038afcc-3f91-4583-8417-11ff4fcafc6d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.741994 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 898/1780] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:39 2022] DELETE /identity/v3/projects/c78a88291147438bb1af6d84f4771343 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:39.759463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d4a1-3871-42fc-8d88-0a674f6fe7d0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:39.760081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d4a1-3871-42fc-8d88-0a674f6fe7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:39.760572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d4a1-3871-42fc-8d88-0a674f6fe7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:39.763025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0707c089a50949f389081dd2783fd1c3', 'request_id': 'req-8038afcc-3f91-4583-8417-11ff4fcafc6d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.790753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] The token cache is being invalidate because project 0707c089a50949f389081dd2783fd1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:39.791906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.793983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:39.799217 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 883/1781] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:39 2022] DELETE /identity/v3/projects/0707c089a50949f389081dd2783fd1c3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:39.805439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7f07d4a1-3871-42fc-8d88-0a674f6fe7d0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:39.806969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f07d4a1-3871-42fc-8d88-0a674f6fe7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:39.816453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:39.821471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:39.840267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:40.048892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038afcc-3f91-4583-8417-11ff4fcafc6d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:40.054316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 899/1782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:40.077680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:40.077970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:40.079957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:40.096379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:40.097183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:40.099015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:40.099485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] PATH_INFO: `/v3/users/7dde38cd626d444c9f3ae70f3c880d5c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:40.103183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dde38cd626d444c9f3ae70f3c880d5c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:40.110098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:40.206901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:40.208861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:40.215248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:40.226168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dde38cd626d444c9f3ae70f3c880d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:40.227869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dde38cd626d444c9f3ae70f3c880d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:40.228756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dde38cd626d444c9f3ae70f3c880d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:40.243420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 900/1783] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:40.244771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:40.248375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dde38cd626d444c9f3ae70f3c880d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:40.265186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dde38cd626d444c9f3ae70f3c880d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:40.284028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639800e7-f8a6-4c56-ba8a-7d21a5564321 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:40.293807 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 884/1784] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:39 2022] DELETE /identity/v3/users/7dde38cd626d444c9f3ae70f3c880d5c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:40.320006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:40.321040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:40.321529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:40.322006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:40.324995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:40.325540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:40.331644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:40.380210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 901/1785] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:40.386186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:40.576153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91be1b-6947-4f0c-a940-4339ae498d4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:40.620162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:40.621267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:40.621758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:40.622240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:40.623515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:40.628942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:40.758591 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 885/1786] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:40 2022] POST /identity/v3/projects => generated 375 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:50:40.765421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:40.784735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e5681-8262-4f45-a87f-fee9a612497f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:41.069978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:41.071037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.073441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.074163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.078035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:41.083008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:41.155103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:41.163994 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 902/1787] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:40 2022] POST /identity/v3/users => generated 288 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:41.189864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ead4a-5e88-40ae-92fa-533b1ad29895 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:41.222797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:41.223886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.226632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.227190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.229172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:41.233001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:41.249516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 886/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:50:41.255675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:41.277132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eeff9-c35d-4b7d-8ac0-428f2b3cac1b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:41.285984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:41.287144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.287638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.288102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.289571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:41.294948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:41.325584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 903/1789] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:41.329159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:41.349200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5763-6a8e-4032-96f6-d100e8713771 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:41.357634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:41.359446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.359926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.360492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] PATH_INFO: `/v3/projects/0bf5a0195de841889ae3961fff56998f/users/de6f06f1b5794a04bf586ad7977b9899/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.411053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5a0195de841889ae3961fff56998f, user_id=de6f06f1b5794a04bf586ad7977b9899, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:41.419251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a7163-90eb-40d7-aa68-9c7bc8ee5a79 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:41.451163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:41.454290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:41.480656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4c54-3478-40b2-a126-9e50ca11f16d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:41.486333 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 887/1790] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:41 2022] PUT /identity/v3/projects/0bf5a0195de841889ae3961fff56998f/users/de6f06f1b5794a04bf586ad7977b9899/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:41.489296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.489796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.490272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.571438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] MFA Rules not processed for user `de6f06f1b5794a04bf586ad7977b9899`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:41.574139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:41.643273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:41.645756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.646036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.646317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] PATH_INFO: `/v3/projects/975e94d2f3e247c2a55885eb581ecb41` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.647662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975e94d2f3e247c2a55885eb581ecb41)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:41.650175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:41.670562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:41.735119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975e94d2f3e247c2a55885eb581ecb41', 'request_id': 'req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:41.744491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975e94d2f3e247c2a55885eb581ecb41', 'request_id': 'req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:41.760941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975e94d2f3e247c2a55885eb581ecb41', 'request_id': 'req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:41.822754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] The token cache is being invalidate because project 975e94d2f3e247c2a55885eb581ecb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:41.824830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:41.829568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b0a7cbe-ab89-4acc-a33d-782d6049f5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:41.839971 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 904/1791] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:41 2022] DELETE /identity/v3/projects/975e94d2f3e247c2a55885eb581ecb41 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:41.847597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2273f-9cfa-4b85-adff-71741773e5e0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:41.848086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2273f-9cfa-4b85-adff-71741773e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:41.848581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2273f-9cfa-4b85-adff-71741773e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:41.869007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:41.890692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 888/1792] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:41.898232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:41.905521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:41.911465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02e2273f-9cfa-4b85-adff-71741773e5e0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:41.915369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02e2273f-9cfa-4b85-adff-71741773e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:41.960856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0e794-7edc-46e1-8ca0-861d3e263293 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.117246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.118718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.119185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.119473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.120147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.122261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.175259 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 905/1793] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:42.185235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.186066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.187572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.215996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 889/1794] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:41 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:42.225945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.260681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:42.262735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:42.395728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5e01-70eb-4975-affc-d7c6b836eb16 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.404677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.412115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.412837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.413488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.414818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.419410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.475817 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 890/1795] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:42 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:42.478224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.507529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa763aed-fb4c-4c01-91b1-da587cc32c8e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.523239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 906/1796] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:42.528429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.560845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.561750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.562167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.562863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.563833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.567545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1385a50-83f9-4d9b-a17d-93a6e907090f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.571058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.640561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 891/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:42.641550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.642549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.642996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.643451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.644192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.644826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:42.645520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.648503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.688398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 907/1798] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:50:42.694288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.699451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb80e-d21d-4d49-8dc1-5954be5d7f65 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.715403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.716237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.717267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.717740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] PATH_INFO: `/v3/projects/ff3893f7f3124cef8102ded5980d6db7/users/39c9efd6532043b7bb09fbe660d73d86/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.721748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb285-77de-4e1f-a8b7-74137ff13acc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.735859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.736502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.736778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.737092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.737995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.739765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.770321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3893f7f3124cef8102ded5980d6db7, user_id=39c9efd6532043b7bb09fbe660d73d86, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.777973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.806501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 908/1799] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:42 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:50:42.812852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.819031 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 892/1800] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:42 2022] PUT /identity/v3/projects/ff3893f7f3124cef8102ded5980d6db7/users/39c9efd6532043b7bb09fbe660d73d86/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:42.824818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.834086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.906204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.933450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898c56-7d44-45b9-b7e1-bab6303b4926 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.054589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97e83-47b9-4407-a837-2a407b17f9ed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.070140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.070944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.071367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.071783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.072597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.079028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.114735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.115374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.115652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.115920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.116580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.118275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.136126 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 909/1801] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:42 2022] POST /identity/v3/users => generated 286 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:43.137935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:43.139481 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 893/1802] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:43.145661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:43.158835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297867-2e58-463a-b544-29d31b8f7104 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.166624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf25e01-5885-43ae-9d8b-a753cd818859 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.173201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.174019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.174356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.174684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.175550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.177258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.178230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.180524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.181191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.181677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] PATH_INFO: `/v3/projects/ff3893f7f3124cef8102ded5980d6db7/users/39c9efd6532043b7bb09fbe660d73d86/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.191756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3893f7f3124cef8102ded5980d6db7, user_id=39c9efd6532043b7bb09fbe660d73d86, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.200273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa1b89-439e-452b-9251-d434e1be03a6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.207749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 910/1803] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:43.209310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:43.232054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4e1b6-6ff5-49b7-adc3-94be81362623 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.241017 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 894/1804] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:43 2022] PUT /identity/v3/projects/ff3893f7f3124cef8102ded5980d6db7/users/39c9efd6532043b7bb09fbe660d73d86/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:43.253650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657731be-c4ac-4500-9e19-42d118c21edd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.253952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657731be-c4ac-4500-9e19-42d118c21edd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.254512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657731be-c4ac-4500-9e19-42d118c21edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.299743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-657731be-c4ac-4500-9e19-42d118c21edd None None] MFA Rules not processed for user `39c9efd6532043b7bb09fbe660d73d86`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:43.301282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-657731be-c4ac-4500-9e19-42d118c21edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:43.383787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.384433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.384989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.385423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.386692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.388625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.412253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 911/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:43.417088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 895/1806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:43.421028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:43.437521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9d58-27eb-4e81-b4c4-96c0e48e485d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.448759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.450305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.450740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.451227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] PATH_INFO: `/v3/projects/ae1620b31c4348a6b4cd55e407f09472/users/366ba3f356d541f1aa52d466a9e57b5a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.477679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1620b31c4348a6b4cd55e407f09472, user_id=366ba3f356d541f1aa52d466a9e57b5a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.487132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.520364 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 912/1807] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:43 2022] PUT /identity/v3/projects/ae1620b31c4348a6b4cd55e407f09472/users/366ba3f356d541f1aa52d466a9e57b5a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:43.532001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.532325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.532603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.607819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] MFA Rules not processed for user `366ba3f356d541f1aa52d466a9e57b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:43.609296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:43.688237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:43.731981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 896/1808] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:43.737627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:43.900762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:43.918226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a9c5-6c7d-4aff-aebb-94dcfbfe3793 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:43.924514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:43.925304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:43.925618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:43.925895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:43.926660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:43.928600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:43.991159 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 913/1809] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:43.991379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.021393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accce92c-0479-4d2a-9fdf-bc48cc87673a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.073604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.075369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:44.191675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.192697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.193520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.193947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.194824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.198212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.243265 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 897/1810] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:43 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:44.250045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9584f1-711d-4bad-94a2-86608baf81a7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.252493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.257619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.258370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.258740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.259091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.299708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec12ba-2c1c-4cb1-99a8-db21c9e9c69e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.308112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.309289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.309865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.310911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.311798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.314472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.342313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 898/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:44.346814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.378374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.380138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.382281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9559-f94e-4334-a5f7-ab920c4559d5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.392973 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 914/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:44.401022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.402172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.404597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.405350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] PATH_INFO: `/v3/projects/fd00eaaff29942f0bc3446b66fd0385d/users/245a8c05d66c43319642fd96150db52e/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.465379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd00eaaff29942f0bc3446b66fd0385d, user_id=245a8c05d66c43319642fd96150db52e, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.470408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.484188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.501185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b1d4-9f03-49d3-bfbf-c84bdbc1e016 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.518371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.519995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.519995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.520378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.545074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 899/1813] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:44 2022] PUT /identity/v3/projects/fd00eaaff29942f0bc3446b66fd0385d/users/245a8c05d66c43319642fd96150db52e/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:44.549217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.731481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.737613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ba106-47cf-4076-9c7b-e0d24789c0f8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.739244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.755623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.756817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.757238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.758152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.759553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.763392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eafc6f-ab9c-402a-b161-bcbd5937fdc0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.780486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 915/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:44.803812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:44.815759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 900/1815] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:50:44.829168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00a5f-b134-4d53-bc0c-12483f5daedb service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:44.843905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:44.844767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.845192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.845575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] PATH_INFO: `/v3/projects/fd00eaaff29942f0bc3446b66fd0385d/users/245a8c05d66c43319642fd96150db52e/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.852303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd00eaaff29942f0bc3446b66fd0385d, user_id=245a8c05d66c43319642fd96150db52e, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:44.855634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:44.885345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:44.905538 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 916/1816] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:44 2022] PUT /identity/v3/projects/fd00eaaff29942f0bc3446b66fd0385d/users/245a8c05d66c43319642fd96150db52e/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:44.912250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:44.912983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:44.913460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:44.988996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] MFA Rules not processed for user `245a8c05d66c43319642fd96150db52e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:44.990630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:45.097823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:45.243056 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 901/1817] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:45.460649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:45.662638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca88201-d7da-4483-beae-7a311eaed12d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:45.663877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:45.679563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b012839-78af-4068-8478-3246550226b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:45.680380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012839-78af-4068-8478-3246550226b9 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:45.680524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012839-78af-4068-8478-3246550226b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:45.680756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b012839-78af-4068-8478-3246550226b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:45.708868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012839-78af-4068-8478-3246550226b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:45.719710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b012839-78af-4068-8478-3246550226b9 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:45.743839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 917/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:45.773309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b8172-3e0d-47fa-8150-d5b295811fad None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:45.790879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:45.791944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:45.791944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:45.792147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] PATH_INFO: `/v3/users/de6f06f1b5794a04bf586ad7977b9899` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:45.795972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6f06f1b5794a04bf586ad7977b9899)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:45.798211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:45.924224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6f06f1b5794a04bf586ad7977b9899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:45.925163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6f06f1b5794a04bf586ad7977b9899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:45.926150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6f06f1b5794a04bf586ad7977b9899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:45.960708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6f06f1b5794a04bf586ad7977b9899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:45.985875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6f06f1b5794a04bf586ad7977b9899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:46.014883 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 902/1819] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:45 2022] DELETE /identity/v3/users/de6f06f1b5794a04bf586ad7977b9899 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:46.028950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:46.029522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:46.030244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:46.066056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:46.070139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:46.204977 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 918/1820] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:46.215001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:46.218359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:46.319276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:46.358264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecf6c0-01ff-427e-b792-7ee02bb63896 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:46.363719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:46.364821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:46.365363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:46.366111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:46.379078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:46.381872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:46.403374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 903/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:47.011944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:47.015092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:47.033874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6778-5e95-456b-aa77-b879d75af3cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:47.041688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:47.042728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:47.043191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:47.044330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] PATH_INFO: `/v3/projects/0bf5a0195de841889ae3961fff56998f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:47.047490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf5a0195de841889ae3961fff56998f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:47.055550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:47.157613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf5a0195de841889ae3961fff56998f', 'request_id': 'req-9cc6534f-afc0-4a34-ab5a-bbee7d088965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.168312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf5a0195de841889ae3961fff56998f', 'request_id': 'req-9cc6534f-afc0-4a34-ab5a-bbee7d088965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.183814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf5a0195de841889ae3961fff56998f', 'request_id': 'req-9cc6534f-afc0-4a34-ab5a-bbee7d088965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.212667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] The token cache is being invalidate because project 0bf5a0195de841889ae3961fff56998f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:47.212991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.214706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.220640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 919/1822] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:47 2022] DELETE /identity/v3/projects/0bf5a0195de841889ae3961fff56998f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:47.223271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:47.236604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c90d3-998d-41b3-9525-5607a222f47f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:47.322681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:47.323561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:47.323848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:47.324125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] PATH_INFO: `/v3/users/39c9efd6532043b7bb09fbe660d73d86` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:47.326672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c9efd6532043b7bb09fbe660d73d86)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:47.330101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:47.400967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c9efd6532043b7bb09fbe660d73d86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.401778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c9efd6532043b7bb09fbe660d73d86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.402464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c9efd6532043b7bb09fbe660d73d86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.412423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c9efd6532043b7bb09fbe660d73d86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.423879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37910111-3980-4e72-9f23-7a3295e10984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c9efd6532043b7bb09fbe660d73d86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:47.449473 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 904/1823] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:47 2022] DELETE /identity/v3/users/39c9efd6532043b7bb09fbe660d73d86 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:47.879654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:47.881210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:47.935326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6534f-afc0-4a34-ab5a-bbee7d088965 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:47.940323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:48.027856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.028703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.029715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.030271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] PATH_INFO: `/v3/projects/ff3893f7f3124cef8102ded5980d6db7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.033081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3893f7f3124cef8102ded5980d6db7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.038319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.114851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3893f7f3124cef8102ded5980d6db7', 'request_id': 'req-abb2f34f-ce5b-4833-8874-68ed3e1bc932'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:48.128266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3893f7f3124cef8102ded5980d6db7', 'request_id': 'req-abb2f34f-ce5b-4833-8874-68ed3e1bc932'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:48.141921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3893f7f3124cef8102ded5980d6db7', 'request_id': 'req-abb2f34f-ce5b-4833-8874-68ed3e1bc932'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:48.161945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] The token cache is being invalidate because project ff3893f7f3124cef8102ded5980d6db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:48.162438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:48.165537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-abb2f34f-ce5b-4833-8874-68ed3e1bc932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:48.172245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 920/1824] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:47 2022] DELETE /identity/v3/projects/ff3893f7f3124cef8102ded5980d6db7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:48.176757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.177089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.177360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.204543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:48.207158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:48.312666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:48.336935 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 905/1825] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:48.338502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.338787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.339058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.387588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:48.390520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:48.418030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 921/1826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:48.422361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.437050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdd0c1-491f-4b01-8db0-f69cc71a438a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.444256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.445271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.445707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.446147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.447073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:48.447580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.450023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.475099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 906/1827] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:48.477078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.490066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adf542-1059-4af2-8f2d-74f396e25a4c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.498509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.499443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.499871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.500531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.501400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.504277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.566678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 922/1828] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:48 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:48.570971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.587230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdeafb-4e86-4748-a8d3-7e719be815ea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.733577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.734210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.734493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.734930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.735634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.738525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.783692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 907/1829] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:48 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:48.788292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.803920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79ace-ef3a-49bb-b759-69e8a1458895 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.821220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.822010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.822300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.822579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.823233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.824937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.856342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 923/1830] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:48.861952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.893211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098cbf-bf18-4e47-bf84-9965fc4703d5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.921594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.922409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.922766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.923041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:48.923753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:48.925522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65df359-8956-4101-9eba-37825053b6ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:48.946425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 908/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:48.948077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:48.963120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5c20b-7729-464e-bccc-b0ced7d1d95c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:48.974579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:48.975620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:48.976087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:48.976473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] PATH_INFO: `/v3/projects/2cfc2c9cb1fa49b7a92e7ba293cbfe90/users/0ca384f1279e422ebfbc61b14dc91291/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.030666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfc2c9cb1fa49b7a92e7ba293cbfe90, user_id=0ca384f1279e422ebfbc61b14dc91291, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:49.038993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faaf69-cf4c-4441-93c1-1e35f257d086 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:49.090696 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 924/1832] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:48 2022] PUT /identity/v3/projects/2cfc2c9cb1fa49b7a92e7ba293cbfe90/users/0ca384f1279e422ebfbc61b14dc91291/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:49.093289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.093731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.094109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.166252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] MFA Rules not processed for user `0ca384f1279e422ebfbc61b14dc91291`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:49.167732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:49.299867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.300210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.300752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.380701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] MFA Rules not processed for user `166235c454c143b3981b9ca4e44e5581`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:49.382533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:49.429872 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 909/1833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:49.434581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:49.454293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:49.576655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 925/1834] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:49.577229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:49.588701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:49.588701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:49.589028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94350a57-c0c3-4fd2-8b20-355841a79fc1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:49.599224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:49.605796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.606390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.606390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.609117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:49.611096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:49.688627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 910/1835] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:49 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:49.689708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:49.806754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1f51-e8d3-4472-b8e8-71500de4a49a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:49.840800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38e8a-1781-4310-a1b7-9b83e51d3c74 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:49.859778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:49.860423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.860707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.861004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.861658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:49.864349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c666-8e59-4f4f-ac2c-b663dcfc726b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:49.911918 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 911/1836] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:49 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:49.914621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdee30-55cb-4a77-b203-f9137c7b9ffa None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.915049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdee30-55cb-4a77-b203-f9137c7b9ffa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.915157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdee30-55cb-4a77-b203-f9137c7b9ffa None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.918251 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 912/1837] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:50:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:49.919235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdee30-55cb-4a77-b203-f9137c7b9ffa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:49.939679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdee30-55cb-4a77-b203-f9137c7b9ffa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:49.947985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:49.950223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.950223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.950223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.951165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:49.953404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:49.968479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 913/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:49.974570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:49.986897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:49.987828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:49.988106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:49.988372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:49.992516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe772ed-6eda-4075-9bb0-4ec45070251f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:49.993005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:50.004735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:50.006994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.007279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.007568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] PATH_INFO: `/v3/projects/fa7e244f51f14294b89f3f806b193266/users/bfa0b841b4e84b04a318be6cee5dfc48/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.057716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7e244f51f14294b89f3f806b193266, user_id=bfa0b841b4e84b04a318be6cee5dfc48, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:50.062475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9f53-3787-4741-8104-effa16608a3d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:50.093880 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 914/1839] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:49 2022] PUT /identity/v3/projects/fa7e244f51f14294b89f3f806b193266/users/bfa0b841b4e84b04a318be6cee5dfc48/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:50.098174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.099629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.100298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.114511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:50.123225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:50.125019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:50.160568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:50.161828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:50.171333 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 926/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:49 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:50.172031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:50.213015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb932-3fd0-45e7-a6a7-1fa5ae42d1e7 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:50.379938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:50.380695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.380839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.381136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 915/1841] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:50:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:50.381374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.381834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:50.382121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:50.383470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:50.418866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 927/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:50.420434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:50.434207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46614c-2708-4a38-8de3-bc7c85f4d62f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:50.446525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9c0d-2f69-4d90-b18f-9ec315ff9e8f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:50.458030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:50.462272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:50.462900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.463187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.463467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] PATH_INFO: `/v3/projects/fa7e244f51f14294b89f3f806b193266/users/bfa0b841b4e84b04a318be6cee5dfc48/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.467639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.468011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.468747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.470762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7e244f51f14294b89f3f806b193266, user_id=bfa0b841b4e84b04a318be6cee5dfc48, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:50.478260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c006a-4fd6-46f3-9998-af0dff6dc7b9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:50.505331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 928/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:50 2022] PUT /identity/v3/projects/fa7e244f51f14294b89f3f806b193266/users/bfa0b841b4e84b04a318be6cee5dfc48/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:50.518204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.518400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.518717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.552106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:50.612193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] MFA Rules not processed for user `bfa0b841b4e84b04a318be6cee5dfc48`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:50.616417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:50.635866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:50.641904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b1cea-de28-4ff1-b986-0587f83acaef service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:50.662811 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 916/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:50.781852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:50.783053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:50.783493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:50.816195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 929/1845] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:50.825305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:50.826961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:50.867422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] MFA Rules not processed for user `3fab2b378c624925ba5eaf18d8d7a4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:50.868527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:51.102037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:51.108735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88897-020d-4931-a3a1-f991aee86381 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:51.116541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde9511-980b-487c-9278-96a020165888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:51.117234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9511-980b-487c-9278-96a020165888 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:51.117681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9511-980b-487c-9278-96a020165888 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:51.118165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9511-980b-487c-9278-96a020165888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:51.127006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 917/1846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:51.128335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:51.134241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde9511-980b-487c-9278-96a020165888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:51.135965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde9511-980b-487c-9278-96a020165888 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:51.145816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadf4bb-e57b-4f2f-9075-bca9537150f2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:51.150580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 930/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:51.183801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:51.184615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:51.184923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:51.185285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:51.210407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:51.212330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:51.228667 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 918/1848] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:51.269759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde9511-980b-487c-9278-96a020165888 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:51.300768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde9511-980b-487c-9278-96a020165888 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:51.313585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:51.314406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:51.315951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:51.317115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:51.332750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:51.334590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439511d-f82c-4e32-b558-f2cd02f5fe60 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:51.349122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 931/1849] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:53.892095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:54.061836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360135-2b5b-4915-bd4a-4c2d10fb70cd service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:54.068401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:54.069370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:54.069748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:54.070746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] PATH_INFO: `/v3/users/0ca384f1279e422ebfbc61b14dc91291` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:54.073611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca384f1279e422ebfbc61b14dc91291)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:54.077014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:54.138788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:54.152213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca384f1279e422ebfbc61b14dc91291'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:54.159681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca384f1279e422ebfbc61b14dc91291'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:54.160320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca384f1279e422ebfbc61b14dc91291'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:54.172366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca384f1279e422ebfbc61b14dc91291'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:54.185225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca384f1279e422ebfbc61b14dc91291'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:54.213881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 919/1850] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:53 2022] DELETE /identity/v3/users/0ca384f1279e422ebfbc61b14dc91291 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:54.238418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8bfaa-7d68-4490-97ab-25ef30f318a5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:54.239354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8bfaa-7d68-4490-97ab-25ef30f318a5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:54.239908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8bfaa-7d68-4490-97ab-25ef30f318a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:54.270975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-88b8bfaa-7d68-4490-97ab-25ef30f318a5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:54.272828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88b8bfaa-7d68-4490-97ab-25ef30f318a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:54.356733 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 932/1851] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:54.369670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:54.371160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:54.464045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98501714-4697-45cd-be53-ae66becfaa46 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:54.468717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:54.469954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:54.470627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:54.471197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:54.485393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:54.487078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:54.499156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 920/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:55.160720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:55.161944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:55.162443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:55.195654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] MFA Rules not processed for user `a60610c78b5844f78f3ac3a7d421df53`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:55.197348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:55.306556 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 933/1853] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:55.312689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:55.314241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:55.500211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c628f-7813-4946-93c8-1e43979d95a9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:55.508542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:55.509368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:55.509692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:55.509957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:55.512653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:55.575027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:55.577039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:55.605047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b1e11-e33b-437f-b6a7-93cb410065a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:55.615486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:55.617004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:55.617523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:55.618454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] PATH_INFO: `/v3/projects/2cfc2c9cb1fa49b7a92e7ba293cbfe90` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:55.620997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfc2c9cb1fa49b7a92e7ba293cbfe90)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:55.623847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:55.631063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:55.649264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:55.651487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:55.665701 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 921/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:55.724500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfc2c9cb1fa49b7a92e7ba293cbfe90', 'request_id': 'req-ea24c0c4-5912-4567-b3fb-0978e0b486dc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:55.739107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfc2c9cb1fa49b7a92e7ba293cbfe90', 'request_id': 'req-ea24c0c4-5912-4567-b3fb-0978e0b486dc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:55.756806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfc2c9cb1fa49b7a92e7ba293cbfe90', 'request_id': 'req-ea24c0c4-5912-4567-b3fb-0978e0b486dc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:55.782812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] The token cache is being invalidate because project 2cfc2c9cb1fa49b7a92e7ba293cbfe90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:55.783261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:55.784382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea24c0c4-5912-4567-b3fb-0978e0b486dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:55.791186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 934/1855] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:55 2022] DELETE /identity/v3/projects/2cfc2c9cb1fa49b7a92e7ba293cbfe90 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:50:55.793385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:55.820652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057c7c6-63b8-44f7-96f9-7fb783730d2f service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:55.909182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:55.909899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:55.910173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:55.910472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] PATH_INFO: `/v3/users/bfa0b841b4e84b04a318be6cee5dfc48` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:55.911680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa0b841b4e84b04a318be6cee5dfc48)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:55.914218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:56.002645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa0b841b4e84b04a318be6cee5dfc48'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.003591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa0b841b4e84b04a318be6cee5dfc48'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.004373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa0b841b4e84b04a318be6cee5dfc48'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.016450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa0b841b4e84b04a318be6cee5dfc48'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.026808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa0b841b4e84b04a318be6cee5dfc48'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.048837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 922/1856] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:50:55 2022] DELETE /identity/v3/users/bfa0b841b4e84b04a318be6cee5dfc48 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:56.631853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:56.632401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:56.632643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:56.641663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:56.655330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:56.657774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:56.728731 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 935/1857] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:56.741085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:56.742574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:56.745460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:56.748245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:56.780393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ace2-6200-468a-85a7-e69e6bf610d2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:56.793202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:56.794144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:56.794476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:56.795555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:56.811776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:56.813293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92ee76-8d7c-45ff-ab93-d17315c7c3f0 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:56.824566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 936/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:56.869162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2b111-bd41-4b33-a42a-d35b9ee2db50 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:56.875027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:56.875841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:56.876240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:56.876599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] PATH_INFO: `/v3/projects/fa7e244f51f14294b89f3f806b193266` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:56.878054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7e244f51f14294b89f3f806b193266)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:56.880092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:56.899301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:56.954912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7e244f51f14294b89f3f806b193266', 'request_id': 'req-4515d178-c324-446c-888b-55f1fe75bdda'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.962785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7e244f51f14294b89f3f806b193266', 'request_id': 'req-4515d178-c324-446c-888b-55f1fe75bdda'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:56.976474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7e244f51f14294b89f3f806b193266', 'request_id': 'req-4515d178-c324-446c-888b-55f1fe75bdda'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:57.004670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] The token cache is being invalidate because project fa7e244f51f14294b89f3f806b193266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:50:57.004989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:57.006141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4515d178-c324-446c-888b-55f1fe75bdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:50:57.009273 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 923/1859] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:50:56 2022] DELETE /identity/v3/projects/fa7e244f51f14294b89f3f806b193266 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:57.012606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.012893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.013317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.056742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:57.058539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:57.166829 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 937/1860] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:57.175940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.176351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.176711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.200414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:57.202680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:57.212075 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 924/1861] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:57.216732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.229663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3b37-7ea7-413f-9520-d481d734fc88 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.237111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.237879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.238237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.238609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.239416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:50:57.239802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.241813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.260972 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 938/1862] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:50:57.264745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.280168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64724-3f34-4a7f-ac9a-15af2af83a6f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.286711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.287836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.288241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.288632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.289464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.291585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.331312 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 925/1863] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:50:57 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:57.335857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.348216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56373d67-c78e-456f-aa1d-1f5838f8fb86 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.462033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.462749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.463057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.463327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.463965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.467026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.499219 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 939/1864] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:50:57 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:50:57.500728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.545394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2131ad-365d-4ccc-a3dd-1ed0fd3aad1e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.557149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.557796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.558077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.558340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.559007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.561935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.593250 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 926/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:57.601259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.623427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024a5f2-f2c4-4b1e-9f04-acc1a38421a0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.628809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.629701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.629860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.630093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.630873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.633004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503bfbe-d187-45a0-a01e-2570d76efc97 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.651139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 940/1866] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:50:57.655557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.670066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172567cb-5e52-436a-97f2-d0a9ebfcb2e6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:57.678277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:57.679109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.679462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.679826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] PATH_INFO: `/v3/projects/6dec85a2d8bd441a97411aab99f13107/users/c51c5ce38b094206af7763c4a802a6b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.701368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dec85a2d8bd441a97411aab99f13107, user_id=c51c5ce38b094206af7763c4a802a6b5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:57.704738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:57.726543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 927/1867] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:50:57 2022] PUT /identity/v3/projects/6dec85a2d8bd441a97411aab99f13107/users/c51c5ce38b094206af7763c4a802a6b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:50:57.730111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad811e-109b-4226-b606-074b145e3bdb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:57.730562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad811e-109b-4226-b606-074b145e3bdb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:57.730909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad811e-109b-4226-b606-074b145e3bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:57.747299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:57.756738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-acad811e-109b-4226-b606-074b145e3bdb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:57.763361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acad811e-109b-4226-b606-074b145e3bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:57.856128 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 941/1868] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:50:57.877042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:57.881416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:58.041220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117670-2efe-4077-aa53-f42c56b8458e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:58.053501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:58.057024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:58.057448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:58.057724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:58.075099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:58.076826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e2566-fb1e-456d-8bd1-240ce23130e8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:58.093874 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 928/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:50:59.765175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad811e-109b-4226-b606-074b145e3bdb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:59.766891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acad811e-109b-4226-b606-074b145e3bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:59.914653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad811e-109b-4226-b606-074b145e3bdb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:59.924092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:59.926451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:59.927020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:59.927777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:59.931641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:00.067841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:00.070162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ce1ab-4972-4c07-b765-1f4c8017d1ed service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:00.097766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 942/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:01.035981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d290c-f17a-48bd-bc2f-3450653b6d7c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:01.036658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d290c-f17a-48bd-bc2f-3450653b6d7c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:01.036658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d290c-f17a-48bd-bc2f-3450653b6d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:01.094762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-143d290c-f17a-48bd-bc2f-3450653b6d7c None None] MFA Rules not processed for user `791f2111f74a452eaa525d16ce0b6448`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:01.096030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-143d290c-f17a-48bd-bc2f-3450653b6d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:01.184795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:01.225279 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 929/1871] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:01.783535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b44a-b897-4ce6-a4cb-377a7bed646a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:01.784391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b44a-b897-4ce6-a4cb-377a7bed646a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:01.784391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24b44a-b897-4ce6-a4cb-377a7bed646a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:01.789205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 943/1872] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:51:01.806728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0155-840b-44ec-acf3-e0f6a5aed821 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:01.807058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0155-840b-44ec-acf3-e0f6a5aed821 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:01.807288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0155-840b-44ec-acf3-e0f6a5aed821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:01.853087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f78c0155-840b-44ec-acf3-e0f6a5aed821 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:01.856722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f78c0155-840b-44ec-acf3-e0f6a5aed821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:01.864196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 930/1873] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:51:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:01.894230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24b44a-b897-4ce6-a4cb-377a7bed646a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:01.921821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24b44a-b897-4ce6-a4cb-377a7bed646a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:01.963279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:01.964114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:01.964562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:01.965145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:01.975365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:01.976487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175f58-1ec4-41b3-b3cd-e4633d097f66 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:01.995546 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 944/1874] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:02.416541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad812-d6aa-4e7e-b6d2-8e139d7cb639 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:02.417891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad812-d6aa-4e7e-b6d2-8e139d7cb639 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:02.418536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad812-d6aa-4e7e-b6d2-8e139d7cb639 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:02.420539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 931/1875] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:02.428213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:02.428989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:02.429265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:02.464971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:02.468262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:02.483833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 945/1876] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:51:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:02.507185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fad812-d6aa-4e7e-b6d2-8e139d7cb639 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:02.522951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fad812-d6aa-4e7e-b6d2-8e139d7cb639 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:02.531893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:02.532612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:02.533093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:02.533516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:02.552175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:02.553941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20396-5c66-4754-9c4b-08601837ab19 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:02.574736 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 932/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:02.826104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:02.828373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:02.936773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:03.098555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fb168-7cce-44a5-97cf-7625a84bae11 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:03.120335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:03.121988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:03.122279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:03.122586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:03.124592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:03.142559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:03.144209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945467eb-69b7-402a-bff2-0b97b08e9f82 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:03.163551 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 946/1878] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:03.566281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103323-6ea0-486a-adc2-e2abe44e4ed4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:03.566726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103323-6ea0-486a-adc2-e2abe44e4ed4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:03.566801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103323-6ea0-486a-adc2-e2abe44e4ed4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:03.569527 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 933/1879] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:03.593513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:03.594167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:03.594601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:03.663536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:03.669025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:03.704431 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 947/1880] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:51:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:03.762473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60103323-6ea0-486a-adc2-e2abe44e4ed4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:03.785305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60103323-6ea0-486a-adc2-e2abe44e4ed4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:03.792137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:03.794661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:03.795205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:03.795647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:03.811894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:03.814754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7b077-85f9-4cae-abee-8e1593c63421 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:03.854544 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 934/1881] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:10.618001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:10.620083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:10.642440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd82e8-4054-412a-b2cc-fd2d35dfb6dc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:10.649042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:10.650132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:10.650577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:10.651182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] PATH_INFO: `/v3/users/ea106b2a3de84ea28bbad06ca62f2bda` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:10.653507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea106b2a3de84ea28bbad06ca62f2bda)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:10.657540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:10.762674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea106b2a3de84ea28bbad06ca62f2bda'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:10.765359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea106b2a3de84ea28bbad06ca62f2bda'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:10.776894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea106b2a3de84ea28bbad06ca62f2bda'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:10.813161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea106b2a3de84ea28bbad06ca62f2bda'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:10.814297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea106b2a3de84ea28bbad06ca62f2bda'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:10.864079 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 948/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:10 2022] DELETE /identity/v3/users/ea106b2a3de84ea28bbad06ca62f2bda => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:10.869308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:10.869825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:10.870417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:10.929428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:10.931166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:10.957920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:10.970805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:11.151863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51199df-f7ee-4af6-a53b-91c38c3ba735 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:11.175363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:11.180011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:11.180537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:11.186610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] PATH_INFO: `/v3/users/366ba3f356d541f1aa52d466a9e57b5a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:11.193099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=366ba3f356d541f1aa52d466a9e57b5a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:11.195170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:11.223859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 935/1883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:11.261703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:11.262866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:11.266557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:11.371222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366ba3f356d541f1aa52d466a9e57b5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.377505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366ba3f356d541f1aa52d466a9e57b5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.404437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366ba3f356d541f1aa52d466a9e57b5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.431238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366ba3f356d541f1aa52d466a9e57b5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.436812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366ba3f356d541f1aa52d466a9e57b5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.515653 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 949/1884] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:10 2022] DELETE /identity/v3/users/366ba3f356d541f1aa52d466a9e57b5a => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:11.516539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:11.525491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:11.536554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad4df-e595-4070-9a97-fcbe137a2f5d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:11.646033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:11.647762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:11.648380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:11.648827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:11.658427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:11.719279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:11.734191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5aa7-721c-4090-b820-d6d28685f4df admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:11.755677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:11.756644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:11.757216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:11.757493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] PATH_INFO: `/v3/users/c5991ee8e3634d2f9b3a355ba48ffecc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:11.763840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5991ee8e3634d2f9b3a355ba48ffecc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:11.769246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:11.862095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:11.865062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ba58-d9ee-4058-a915-8709144b10d9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:11.876051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5991ee8e3634d2f9b3a355ba48ffecc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.877099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5991ee8e3634d2f9b3a355ba48ffecc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.893099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5991ee8e3634d2f9b3a355ba48ffecc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.896200 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 936/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:11.899793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:11.901767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:11.902202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:11.909199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5991ee8e3634d2f9b3a355ba48ffecc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.910867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4bae957-b47f-471d-be2c-d46b08d831cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5991ee8e3634d2f9b3a355ba48ffecc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:11.949663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:11.965088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 950/1886] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:11 2022] DELETE /identity/v3/users/c5991ee8e3634d2f9b3a355ba48ffecc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:11.965331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:11.970969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:11.971480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:11.971793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:12.023776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:12.028170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:12.054576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:12.130610 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 937/1887] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:12.159933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 951/1888] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:12.183613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:12.185793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:12.192452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:12.195385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:12.361215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e282-e3eb-4ba0-97c1-2b436ae5a664 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:12.365349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7520473-3096-403b-b96e-2b574f1b0fd6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:12.370177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:12.371709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:12.372547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:12.374089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:12.375102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:12.377157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:12.378023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:12.379442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:12.392680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:12.394177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1533b-deed-41a9-87cf-d167ecb47631 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:12.407697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 952/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:12.409106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:12.409396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:12.409668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:12.417695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:12.421775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:12.444719 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 938/1890] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:12.459928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] MFA Rules not processed for user `c51c5ce38b094206af7763c4a802a6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:12.462909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:12.573176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 953/1891] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:12.576059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:12.578534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:12.630969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d13a-8336-4608-8a7c-807bd244bfe1 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:12.642077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:12.645002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:12.645306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:12.646501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:12.648210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:12.652988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:12.724896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 939/1892] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:12 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:12.726131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:12.748463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1a0f3-f77f-4d0a-a88d-cd000ed326ea None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:12.971075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:13.011074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.024758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.030731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.032197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.032705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.035247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.104037 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 954/1893] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:12 2022] POST /identity/v3/users => generated 309 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:13.110006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.133627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56b5e-308e-452f-b75c-d45224a123da admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.142377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.143439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.143907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.144384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.145619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.149140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.178006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 940/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:13.183723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.201065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4c3e6-451a-4e36-a693-1c74df1235af admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.220954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.221843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.222181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.222625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] PATH_INFO: `/v3/projects/6dfe39f46673435e99b56ac055fd12ab/users/3da3b86433644508b3bd3aabb0576f93/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.261313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfe39f46673435e99b56ac055fd12ab, user_id=3da3b86433644508b3bd3aabb0576f93, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.265034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.270111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.272819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:13.306699 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 955/1895] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:13 2022] PUT /identity/v3/projects/6dfe39f46673435e99b56ac055fd12ab/users/3da3b86433644508b3bd3aabb0576f93/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:13.307305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c1a4b-ddd7-4e53-9dd6-2162fe5ada51 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.312159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.386374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:13.444973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053347a9-5386-4238-94d8-261a449829a4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.450627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.451500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.451776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.452044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.452692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.455588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.466753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.467561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.469023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.470607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] PATH_INFO: `/v3/projects/f75fc6889d564010966a8f1806d0d93d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.471422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 956/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:51:13.472753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75fc6889d564010966a8f1806d0d93d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.474722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.476643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.489803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6d9c9-0a3f-48bb-afe3-1ebe2764e53e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.496579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.497584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.497932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.498272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] PATH_INFO: `/v3/projects/6dfe39f46673435e99b56ac055fd12ab/users/3da3b86433644508b3bd3aabb0576f93/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.500383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfe39f46673435e99b56ac055fd12ab, user_id=3da3b86433644508b3bd3aabb0576f93, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.504653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea80a3-2efb-4d4c-988e-79b2a9983f5d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.530799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 957/1897] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:13 2022] PUT /identity/v3/projects/6dfe39f46673435e99b56ac055fd12ab/users/3da3b86433644508b3bd3aabb0576f93/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:13.582403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75fc6889d564010966a8f1806d0d93d', 'request_id': 'req-9468331e-021d-45fe-b3dc-9d2ec96921e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:13.600238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75fc6889d564010966a8f1806d0d93d', 'request_id': 'req-9468331e-021d-45fe-b3dc-9d2ec96921e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:13.611733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75fc6889d564010966a8f1806d0d93d', 'request_id': 'req-9468331e-021d-45fe-b3dc-9d2ec96921e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:13.612225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.612513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.612829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.615004 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 958/1898] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:13.639828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] The token cache is being invalidate because project f75fc6889d564010966a8f1806d0d93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:13.639828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:13.641033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9468331e-021d-45fe-b3dc-9d2ec96921e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:13.644518 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 941/1899] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:13 2022] DELETE /identity/v3/projects/f75fc6889d564010966a8f1806d0d93d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:13.648713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:13.656789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:13.722368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.722858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.723352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.773732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648a009-f15a-4502-bf18-1077d3a273de None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:13.790981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:13.795219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:13.796359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:13.796968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] PATH_INFO: `/v3/users/0558ebc9efa1407b8e7ec523317ec4c4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:13.816670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:13.819621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0558ebc9efa1407b8e7ec523317ec4c4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:13.823372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:13.830716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:13.978995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.006909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0558ebc9efa1407b8e7ec523317ec4c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.011039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0558ebc9efa1407b8e7ec523317ec4c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.029378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0558ebc9efa1407b8e7ec523317ec4c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.050327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0558ebc9efa1407b8e7ec523317ec4c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.054461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0558ebc9efa1407b8e7ec523317ec4c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.067221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 942/1900] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:51:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:14.068457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.070948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.104311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d143-e8cf-4e6e-95f7-c1dda5ce9864 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:14.118344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:14.119002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:14.119324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:14.119767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] PATH_INFO: `/v3/users/3fab2b378c624925ba5eaf18d8d7a4e5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:14.123094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fab2b378c624925ba5eaf18d8d7a4e5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:14.125157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:14.145123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 959/1901] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:13 2022] DELETE /identity/v3/users/0558ebc9efa1407b8e7ec523317ec4c4 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:14.148310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.158867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.266836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fab2b378c624925ba5eaf18d8d7a4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.268676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fab2b378c624925ba5eaf18d8d7a4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.269915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fab2b378c624925ba5eaf18d8d7a4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.284817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.301539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fab2b378c624925ba5eaf18d8d7a4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.324431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fab2b378c624925ba5eaf18d8d7a4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.345457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94c7a-ea77-4c8b-a04b-e99d4e78201c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:14.360871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:14.363530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:14.363844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:14.364106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:14.382093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.408612 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 943/1902] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:14 2022] DELETE /identity/v3/users/3fab2b378c624925ba5eaf18d8d7a4e5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:14.409916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.412651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.425973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:14.429578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:14.455398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 960/1903] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:14.516235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.516958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.601351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29be7-5bed-4849-a2af-8ccd5e89b45f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:14.632447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:14.633744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:14.634160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:14.634645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] PATH_INFO: `/v3/projects/e4bf7a1694754ab495d0630ae8580735` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:14.654253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bf7a1694754ab495d0630ae8580735)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:14.670433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:14.759597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76099e-0482-4ac7-888b-ad528e16b3bd service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:14.769531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:14.770721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:14.775423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:14.776490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] PATH_INFO: `/v3/projects/ae1620b31c4348a6b4cd55e407f09472` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:14.779822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1620b31c4348a6b4cd55e407f09472)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:14.798297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:14.832992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bf7a1694754ab495d0630ae8580735', 'request_id': 'req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.855689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bf7a1694754ab495d0630ae8580735', 'request_id': 'req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.868578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bf7a1694754ab495d0630ae8580735', 'request_id': 'req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.911630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] The token cache is being invalidate because project e4bf7a1694754ab495d0630ae8580735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:14.911864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.912718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.913491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.925144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1620b31c4348a6b4cd55e407f09472', 'request_id': 'req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.925463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 944/1904] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:14 2022] DELETE /identity/v3/projects/e4bf7a1694754ab495d0630ae8580735 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:14.927563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.930801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:14.939386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1620b31c4348a6b4cd55e407f09472', 'request_id': 'req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.955134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1620b31c4348a6b4cd55e407f09472', 'request_id': 'req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.975414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] The token cache is being invalidate because project ae1620b31c4348a6b4cd55e407f09472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:14.976936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.977085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:14.980948 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 961/1905] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:14 2022] DELETE /identity/v3/projects/ae1620b31c4348a6b4cd55e407f09472 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:14.984502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:14.996784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:15.102708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:15.119252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368da2c1-2e3e-4fa1-b1f0-3e6300b9b519 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:15.163168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae9c4-f868-43ba-a1f2-d4fada882bb3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:15.179990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:15.182147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:15.183944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:15.184403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] PATH_INFO: `/v3/users/245a8c05d66c43319642fd96150db52e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:15.188423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245a8c05d66c43319642fd96150db52e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:15.198217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:15.318736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:15.319869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:15.321155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:15.322091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] PATH_INFO: `/v3/users/654f1e57690f450c8269bf545ac8a214` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:15.325387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654f1e57690f450c8269bf545ac8a214)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:15.327238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245a8c05d66c43319642fd96150db52e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.329311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:15.330639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245a8c05d66c43319642fd96150db52e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.349787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245a8c05d66c43319642fd96150db52e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.405061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245a8c05d66c43319642fd96150db52e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.425925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245a8c05d66c43319642fd96150db52e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.494039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654f1e57690f450c8269bf545ac8a214'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.495548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654f1e57690f450c8269bf545ac8a214'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.496447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654f1e57690f450c8269bf545ac8a214'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.506742 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 962/1906] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:14 2022] DELETE /identity/v3/users/245a8c05d66c43319642fd96150db52e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:15.507345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654f1e57690f450c8269bf545ac8a214'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.516806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:15.520190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654f1e57690f450c8269bf545ac8a214'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.522160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:15.557712 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 945/1907] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:14 2022] DELETE /identity/v3/users/654f1e57690f450c8269bf545ac8a214 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:15.559631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:15.562209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:15.668327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:15.688261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2d45-1c1d-4ea8-b1ff-918b08ea2202 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:15.749179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bdf1-fa44-4a98-83b1-7d8ebf42a2d8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:15.760656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:15.761924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:15.762483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:15.762955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] PATH_INFO: `/v3/projects/52ff249ad8e3441885b7a01001a36628` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:15.765398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ff249ad8e3441885b7a01001a36628)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:15.767741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:15.828734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:15.874866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ff249ad8e3441885b7a01001a36628', 'request_id': 'req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.885009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ff249ad8e3441885b7a01001a36628', 'request_id': 'req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.888028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:15.889230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:15.889725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:15.890230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] PATH_INFO: `/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:15.895475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0796e3f43b1f4b2192c5dc4a92af949c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:15.899377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:15.901045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ff249ad8e3441885b7a01001a36628', 'request_id': 'req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.951246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] The token cache is being invalidate because project 52ff249ad8e3441885b7a01001a36628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:15.951956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.953027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b0103bd-4c63-4a0b-b980-a9c9b701d78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:15.959219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 946/1908] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:15 2022] DELETE /identity/v3/projects/52ff249ad8e3441885b7a01001a36628 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:15.965885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb2b2-0fca-4104-875e-6171fd453252 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:15.967872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb2b2-0fca-4104-875e-6171fd453252 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:15.968588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb2b2-0fca-4104-875e-6171fd453252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.034956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0796e3f43b1f4b2192c5dc4a92af949c', 'request_id': 'req-dd39efec-7057-42b2-9504-6257093a3a59'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.038744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-990cb2b2-0fca-4104-875e-6171fd453252 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:16.040850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-990cb2b2-0fca-4104-875e-6171fd453252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:16.053484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0796e3f43b1f4b2192c5dc4a92af949c', 'request_id': 'req-dd39efec-7057-42b2-9504-6257093a3a59'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.073383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0796e3f43b1f4b2192c5dc4a92af949c', 'request_id': 'req-dd39efec-7057-42b2-9504-6257093a3a59'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.096635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] The token cache is being invalidate because project 0796e3f43b1f4b2192c5dc4a92af949c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:16.097160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.098189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd39efec-7057-42b2-9504-6257093a3a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.106182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 963/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:15 2022] DELETE /identity/v3/projects/0796e3f43b1f4b2192c5dc4a92af949c => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:16.109163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41664-db5a-40ce-b47a-355b9349bbe7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.110139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41664-db5a-40ce-b47a-355b9349bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.110476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e41664-db5a-40ce-b47a-355b9349bbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.165393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-62e41664-db5a-40ce-b47a-355b9349bbe7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:16.167535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-62e41664-db5a-40ce-b47a-355b9349bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:16.187510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 947/1910] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:16.196692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.196891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.197234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.233266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:16.234507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:16.243519 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 948/1911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:16.249127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.259531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f82b75-0964-4e12-980e-26a55d1310c6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.265413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.267530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.267981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.268690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.269479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:16.269979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.272492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.290760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 949/1912] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:16.298924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.320202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260533-90df-41b4-b0af-4662c599c4d8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.332725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.338561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.338847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.339267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 964/1913] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:16.339999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.340716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.344629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.348931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.349523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.350043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.384652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:16.386060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:16.410179 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 965/1914] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:16.410179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.425518 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 950/1915] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:16.426867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.479951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf0d10-dba2-4b16-a8f3-a6789d7a039b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.516802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:16.592452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.593326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.593743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.594243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.594711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde946d-1660-4361-82d6-fd36053fb322 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.605127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.605244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.605427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.605693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.606421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.614118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.634882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:16.634882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.645750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.676099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 951/1916] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:16.678194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.684179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:16.696532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 966/1917] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:16.697897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.706909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:16.716997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62234c7-ee40-43a0-9c56-95d8f8648df7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.719883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16b4e9-3088-4974-83d4-803bde2b7e91 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.726764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.727571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.727898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.728382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.729213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.731256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.738879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.740782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.741814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.743464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] PATH_INFO: `/v3/projects/9b3878f8ee0f4a06abb8f252be0af556` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.745077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3878f8ee0f4a06abb8f252be0af556)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.750730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.781317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 967/1918] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:16.782278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.810856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba85114-a57a-4e2a-985b-f58eeb7823bc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:16.826372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:16.827555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:16.827555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:16.827555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:16.828217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:16.830213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:16.880156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3878f8ee0f4a06abb8f252be0af556', 'request_id': 'req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.893286 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 968/1919] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:16.894173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.903251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3878f8ee0f4a06abb8f252be0af556', 'request_id': 'req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.931252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3878f8ee0f4a06abb8f252be0af556', 'request_id': 'req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.956030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] The token cache is being invalidate because project 9b3878f8ee0f4a06abb8f252be0af556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:16.956564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.957568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:16.964782 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 952/1920] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:16 2022] DELETE /identity/v3/projects/9b3878f8ee0f4a06abb8f252be0af556 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:16.966170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:16.971713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.096428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8befe-c46d-4861-b8a7-87d157c66a5b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.133703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.134336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.134672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.134953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.135644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.137414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7350486-5dc1-4b86-986f-29134c18b72a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.156177 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 969/1921] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:17.163179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.163179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.163436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.177072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fef7f-1eaa-4e40-aecb-5d68be9dc0f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.187297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.188370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.190491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.191018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.196799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.199135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.207804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:17.209603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.227550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 970/1922] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:17.228598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.233835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.249707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782307a-afa8-4fcf-bc02-826c23d9e5cc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.257505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.258322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.258649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.258924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] PATH_INFO: `/v3/projects/fd00eaaff29942f0bc3446b66fd0385d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.260636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd00eaaff29942f0bc3446b66fd0385d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.262801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.265247 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 953/1923] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:16 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:17.266506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.268983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.314912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6b79d-0ee8-4179-83e0-e67610bffb2b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.332181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.336101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.340058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.340386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] PATH_INFO: `/v3/projects/8c6e6170a41f42a6ae8bf5d0a2191534/users/9d8f213a26a245d89343f0a99f281a21/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.365146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6e6170a41f42a6ae8bf5d0a2191534, user_id=9d8f213a26a245d89343f0a99f281a21, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.368218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21289fdf-93ba-4e3a-b520-9f504badb0df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.373156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd00eaaff29942f0bc3446b66fd0385d', 'request_id': 'req-c0592dfc-3ab3-4d27-a112-cd57501924d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:17.391225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd00eaaff29942f0bc3446b66fd0385d', 'request_id': 'req-c0592dfc-3ab3-4d27-a112-cd57501924d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:17.405240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd00eaaff29942f0bc3446b66fd0385d', 'request_id': 'req-c0592dfc-3ab3-4d27-a112-cd57501924d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:17.413244 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 954/1924] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:17 2022] PUT /identity/v3/projects/8c6e6170a41f42a6ae8bf5d0a2191534/users/9d8f213a26a245d89343f0a99f281a21/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:17.415145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4e4bb-b0d2-498e-b67b-ff0ea6bf2157 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.415471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4e4bb-b0d2-498e-b67b-ff0ea6bf2157 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.415893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4e4bb-b0d2-498e-b67b-ff0ea6bf2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.418725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:17.424307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] The token cache is being invalidate because project fd00eaaff29942f0bc3446b66fd0385d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:17.425206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:17.427136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:17.429453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 971/1925] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:17 2022] DELETE /identity/v3/projects/fd00eaaff29942f0bc3446b66fd0385d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:17.430620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.435366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.466405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2da4e4bb-b0d2-498e-b67b-ff0ea6bf2157 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:17.467646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2da4e4bb-b0d2-498e-b67b-ff0ea6bf2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.559867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:17.562306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592dfc-3ab3-4d27-a112-cd57501924d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.586967 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 955/1926] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:17.589161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.591917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.593272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.676988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] MFA Rules not processed for user `9d8f213a26a245d89343f0a99f281a21`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:17.681521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.703852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.704511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.704789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.705087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.705907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.712949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527357ce-b12b-4a8c-b880-3adebf0c0b67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.729857 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 972/1927] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:17.731576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.734198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.734666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.775765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:17.777178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.787297 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 973/1928] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:17.788828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.810407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e9e1-340f-49b0-9421-3169d9c47c95 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.828686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.829361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.829642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.830961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.832740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:17.833151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.834934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c18d6-bee9-4215-91d9-83def8967195 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.848951 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 956/1929] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:17.849894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.869166 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 974/1930] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:17.870585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.870901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.871855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.897169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6479a-657f-4ba7-8942-d1f69e12d542 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.899719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:17.901047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.904585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.905247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.905528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.905799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.906535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.908249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:17.911755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 975/1931] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:17.916111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.924889 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 957/1932] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:17.925861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:17.927519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:17.933856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b06e77-7bb1-4b4f-9a5b-71a02f8a8234 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:17.942290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:17.943418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:17.944203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:17.944698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:17.946724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:17.950851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.002918 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 976/1933] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:17 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:18.004288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.042007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952499-011e-48f7-8de3-64fde9961e60 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.098295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:18.113587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51210a-4e0c-456a-8014-570605e63793 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.120384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.120384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.121711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.121711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.123212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:18.123629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.125850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.149508 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 977/1934] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:18.149508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.161361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.163671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.164727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07aae9-0354-467c-be73-902d445f39b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.165132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.165903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.175425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:18.177101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.180768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.181145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.181848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] PATH_INFO: `/v3/projects/6e8fd623976e485bab45fc87ae7caec8/users/e6f77f6a17cf481592fd922e89e21f59/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.230787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8fd623976e485bab45fc87ae7caec8, user_id=e6f77f6a17cf481592fd922e89e21f59, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.236211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.262539 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 978/1935] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:18 2022] PUT /identity/v3/projects/6e8fd623976e485bab45fc87ae7caec8/users/e6f77f6a17cf481592fd922e89e21f59/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:18.263853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.302081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.304329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.319477 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 958/1936] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:18.321269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.340549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b4d7-d5a9-4f85-ab1b-d67a509d92ee service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.417152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc574-7392-4ba0-b56c-8df503db4d34 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.420404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.421385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.422666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.422986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.423670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.430337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3033-3962-4f9d-aa0a-6a63aee03691 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.491813 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 979/1937] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:18 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:18.493745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.494032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.494631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.554253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] MFA Rules not processed for user `e6f77f6a17cf481592fd922e89e21f59`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:18.559528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:18.567138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.571080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.571080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.571080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.571570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.574254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.689528 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 959/1938] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:18 2022] POST /identity/v3/projects => generated 383 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:18.690681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.693289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:18.711399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 980/1939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:18.715715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.735002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f9dd-9c25-4606-8963-054308a3e6b5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.798879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:18.811531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6069a3-a94a-4163-814d-ab833d4274fa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.817754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.818822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.819271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.819606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] PATH_INFO: `/v3/users/9d8f213a26a245d89343f0a99f281a21` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.821138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8f213a26a245d89343f0a99f281a21)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.823123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.823266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.823736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.824014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.824278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.825036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.827523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.845710 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 981/1940] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:18.858391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.873837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:18.895327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63d067-9e3d-4b41-b2af-7374a5b90c3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:18.899948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8f213a26a245d89343f0a99f281a21'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:18.902390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8f213a26a245d89343f0a99f281a21'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:18.904604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8f213a26a245d89343f0a99f281a21'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:18.912833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:18.914997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:18.915437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:18.915927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:18.916762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:18.925346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8f213a26a245d89343f0a99f281a21'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:18.926890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:18.959597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8f213a26a245d89343f0a99f281a21'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:18.987520 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 960/1941] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:18 2022] DELETE /identity/v3/users/9d8f213a26a245d89343f0a99f281a21 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:18.989093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:18.991788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.013994 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 982/1942] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:18 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:19.015119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.022059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.056196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f4f6-0eef-4dcb-8186-05a72c928091 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.168221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04488a-d93c-4a8b-bf8f-447c92278f4d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.177726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.178405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.178644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.179171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.183966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.230763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.232311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.232590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.232859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.233536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.236408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234d391-5ad7-4aee-9f2a-4b2c70b22449 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.264988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 983/1943] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:19.266297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.266576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.266850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.310553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:19.311961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.328437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 984/1944] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:19.332488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.334261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.345648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.347127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.362500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b15f0-d1a1-4a61-ac35-7daca9281d41 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.363894 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 961/1945] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:19.364840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.372148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.373749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.374029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.374297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.376975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.378205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793fc2-fcfb-4c1f-acaf-ed30f1116981 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.378606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.384524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.386006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.386006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.386006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] PATH_INFO: `/v3/projects/1d3de060186a47989b163426fd5dc396/users/60be8c6d70464fe494cfedfea9fd094a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.402943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 985/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:19.404827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.407009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.417759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3de060186a47989b163426fd5dc396, user_id=60be8c6d70464fe494cfedfea9fd094a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.421433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.432350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9ea5-2280-42d5-9fa1-4303c4d6a120 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.441217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.442251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.442529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.443275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.446796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 962/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:19 2022] PUT /identity/v3/projects/1d3de060186a47989b163426fd5dc396/users/60be8c6d70464fe494cfedfea9fd094a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:19.449254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.463547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.465246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cbcee-70bb-45b3-8fe7-f44687591200 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.482730 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 986/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:19.483535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.484212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.484612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.531283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:19.551077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] MFA Rules not processed for user `60be8c6d70464fe494cfedfea9fd094a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:19.556097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.585569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fa09-4741-42a2-b924-d0e08ac884a8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.601439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.602082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.602358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.603369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.604035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.605688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.624551 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 963/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:19.625216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.649650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83d282-d142-432e-84ef-10ba9bd11f8e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.656204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.656942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.657225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.657499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] PATH_INFO: `/v3/projects/a88a1ed3af5a4359b926b300607a4a10/users/c725a249ada14c04981a207abeddd8c8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.681421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88a1ed3af5a4359b926b300607a4a10, user_id=c725a249ada14c04981a207abeddd8c8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.685255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c4797-fe8b-43ab-a814-a90238ec2bb2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.714386 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 987/1950] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:19.726461 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 964/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:19 2022] PUT /identity/v3/projects/a88a1ed3af5a4359b926b300607a4a10/users/c725a249ada14c04981a207abeddd8c8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:19.728173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.729182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.729769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.730541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.746485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad724280-3a0f-4c7b-9740-feb53358e84a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.777989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:19.807042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] MFA Rules not processed for user `c725a249ada14c04981a207abeddd8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:19.812014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:19.911445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.912094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.912946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.913538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.913917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.916049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.945479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 965/1952] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:19.946916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:19.964228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac93855-0046-4e56-a6cc-d13372e19abf None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:19.973413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:19.974897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:19.975469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:19.978328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:19.979283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:19.982668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:19.983076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 988/1953] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:19.988489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.032804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 966/1954] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:20.034002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.227181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb520884-06d1-4194-9e92-9cbafd908841 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.242958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.243730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.244087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.245986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f4de-a5f5-4348-8f05-2ec485a50b2a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.246420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.248713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.256291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.272829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.274437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.275225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.275896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.278243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.290402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.295779 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 967/1955] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:20 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:20.297409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.311980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86feff8-187b-4000-8280-52d33969ca3e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.318747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.319787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.320957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.321464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.322340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.324340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.328442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:20.352305 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 968/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:20.353773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.367344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 989/1957] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:19 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:20.374978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.401982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337344d-a336-4765-8bcb-ca296a08a7aa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.421534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f60d-44f7-45ab-82b0-ad0c86b79798 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.437637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.442583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.443083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.443575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] PATH_INFO: `/v3/projects/1ce32bae8c62464491480408ddda6c2b/users/b5545c36abc4413491da96459ecb5e4a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.454850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.455928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.456275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.456644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.463420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.466047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.489510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 990/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:20.495474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.526609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34eaa-64d5-4c99-a0a5-f606f1d11a14 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.529840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce32bae8c62464491480408ddda6c2b, user_id=b5545c36abc4413491da96459ecb5e4a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.535772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.550460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.551300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.555262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.555957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] PATH_INFO: `/v3/projects/3833601c92d84f1cb52bfef58eb49e6f/users/123377cb40f540f693ad8c3c34164446/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.572107 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 969/1959] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:20 2022] PUT /identity/v3/projects/1ce32bae8c62464491480408ddda6c2b/users/b5545c36abc4413491da96459ecb5e4a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:20.578069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.608183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3833601c92d84f1cb52bfef58eb49e6f, user_id=123377cb40f540f693ad8c3c34164446, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.613629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.644785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 991/1960] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:20 2022] PUT /identity/v3/projects/3833601c92d84f1cb52bfef58eb49e6f/users/123377cb40f540f693ad8c3c34164446/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:20.649010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.735497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2867-30b9-48a4-a293-51788d559951 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.827602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:20.841594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb63f-7f79-4367-aa38-c6bf072315bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.843274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.844453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.844747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.845696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.848057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.851489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.852516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.853161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.855343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.855661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.858366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.860092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.877988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 970/1961] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:20.878906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.886772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:20.887342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 992/1962] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:51:20.889061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:20.916939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8acc-c5b7-449e-80b4-8d212cd9140b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.920321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593033f4-7d26-4c9f-a590-55a7465d615e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:20.933204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.933876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.934156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.934427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] PATH_INFO: `/v3/users/e6f77f6a17cf481592fd922e89e21f59` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.937782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:20.938706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:20.938976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:20.939341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] PATH_INFO: `/v3/projects/1ce32bae8c62464491480408ddda6c2b/users/b5545c36abc4413491da96459ecb5e4a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:20.941459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f77f6a17cf481592fd922e89e21f59)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.944333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.948883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce32bae8c62464491480408ddda6c2b, user_id=b5545c36abc4413491da96459ecb5e4a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:20.952611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:20.995463 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 993/1963] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:20 2022] PUT /identity/v3/projects/1ce32bae8c62464491480408ddda6c2b/users/b5545c36abc4413491da96459ecb5e4a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:20.996741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:21.076833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f77f6a17cf481592fd922e89e21f59'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.077694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f77f6a17cf481592fd922e89e21f59'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.079345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f77f6a17cf481592fd922e89e21f59'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.100219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f77f6a17cf481592fd922e89e21f59'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.110448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1e7087b-2d5e-4223-b923-c3bd047b56bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f77f6a17cf481592fd922e89e21f59'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.121701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:21.168876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf670-3309-4733-b1e7-ba569c0b3955 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:21.169356 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 971/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:20 2022] DELETE /identity/v3/users/e6f77f6a17cf481592fd922e89e21f59 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:21.174931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4e27-b816-4c4e-aab6-3696a323b503 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.175287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4e27-b816-4c4e-aab6-3696a323b503 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.175566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4e27-b816-4c4e-aab6-3696a323b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.233983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6ecc4e27-b816-4c4e-aab6-3696a323b503 None None] MFA Rules not processed for user `b5545c36abc4413491da96459ecb5e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:21.235301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6ecc4e27-b816-4c4e-aab6-3696a323b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:21.367197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 972/1965] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:21.374013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.375066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.375485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.390746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:21.391332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.391615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.391888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] PATH_INFO: `/v3/projects/3833601c92d84f1cb52bfef58eb49e6f/users/123377cb40f540f693ad8c3c34164446/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.398899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3833601c92d84f1cb52bfef58eb49e6f, user_id=123377cb40f540f693ad8c3c34164446, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:21.402758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:21.402972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:21.404305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:21.415444 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 973/1966] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:21.421474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:21.423624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:21.450301 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 994/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:20 2022] PUT /identity/v3/projects/3833601c92d84f1cb52bfef58eb49e6f/users/123377cb40f540f693ad8c3c34164446/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:21.450515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71321e69-d8fd-45ba-82a5-fa6dab79b63c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:21.451381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:21.459691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:21.593974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cad9b-cc6b-46d2-abce-5281bf05eaba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:21.600920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:21.605226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.605599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.605880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.663007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:21.663671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.663950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.665129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] PATH_INFO: `/v3/projects/8c6e6170a41f42a6ae8bf5d0a2191534` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.670422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6e6170a41f42a6ae8bf5d0a2191534)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:21.673703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:21.697528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:21.800774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:21.802613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806efb9-51e4-4a19-9097-da49e16039ce service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:21.825392 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 995/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:21.827895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0238-fd6e-49d9-9ae5-84657c9bbcd8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:21.827895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0238-fd6e-49d9-9ae5-84657c9bbcd8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:21.827895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0238-fd6e-49d9-9ae5-84657c9bbcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:21.828213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6e6170a41f42a6ae8bf5d0a2191534', 'request_id': 'req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.842983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6e6170a41f42a6ae8bf5d0a2191534', 'request_id': 'req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.860002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6e6170a41f42a6ae8bf5d0a2191534', 'request_id': 'req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.868688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9c6a0238-fd6e-49d9-9ae5-84657c9bbcd8 None None] MFA Rules not processed for user `123377cb40f540f693ad8c3c34164446`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:21.869496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:21.870046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9c6a0238-fd6e-49d9-9ae5-84657c9bbcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:21.878659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] The token cache is being invalidate because project 8c6e6170a41f42a6ae8bf5d0a2191534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:21.879501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.880945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:21.883659 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 974/1969] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:21 2022] DELETE /identity/v3/projects/8c6e6170a41f42a6ae8bf5d0a2191534 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:21.884884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:21.887136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:22.035080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0453ec-ad69-4578-9dfa-522a8d17fe2d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.042145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 996/1970] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:22.042145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.042145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.042145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.055383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.057080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.057403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.057677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.061973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:22.110321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:22.111567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:22.216946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.223032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e2e68-fbfa-4a78-bfd8-19b06fd04273 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.241879 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 975/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:22.303871 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 997/1972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:22.312277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.312959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.313415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.365035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:22.372182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:22.397692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 976/1973] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:22.399007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.410225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e053-819b-4c27-9e30-c49a10820333 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.417897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.418526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.418907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.419845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.420664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:22.421098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.423831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.447974 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 998/1974] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:22.449737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.461418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc404b6-1703-4474-bf41-f0c632d45691 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.467528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.468229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.468612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.469086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.470231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.472804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.514177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 977/1975] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:22 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:22.516501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.539276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575cef9-ce33-469f-a281-9e537f740800 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.655105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:22.714519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.718707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.721190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.721725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.722597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.728193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.759959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.762360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:22.853311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 999/1976] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:22 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:22.854355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.900053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb325a4-eff2-4dec-b2eb-960a4f78ecb0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.923659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.924266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.924619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.924917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.926341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.928031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.956293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1000/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:22.966518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.967490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:23.001488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d98ea-f595-4195-93ee-9659aedd10aa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:23.011320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995153a5-37df-47d3-8971-8422e188f76b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:23.022080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:23.023128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.023621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.024098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.025601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:23.034060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:23.039733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:23.041442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.042944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.043807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.048799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:23.062202 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1001/1978] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:23.064867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:23.081399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ab4e-8e58-4a47-8fcf-0eb9bc2348fe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:23.090370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:23.091755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.092040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.092629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] PATH_INFO: `/v3/projects/a18960a3c1df41409cc970a22feb2e8e/users/be3412e3af074bf48da86902072697f5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.143586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18960a3c1df41409cc970a22feb2e8e, user_id=be3412e3af074bf48da86902072697f5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:23.151390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcccd7c-75a2-4a3f-ac20-ac59ec2b1afc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:23.174900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:23.177938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:23.185259 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1002/1979] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:23 2022] PUT /identity/v3/projects/a18960a3c1df41409cc970a22feb2e8e/users/be3412e3af074bf48da86902072697f5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:23.203458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.213775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.214779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.217372 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 978/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:51:23.226999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:23.229065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:23.267607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ece633-58a7-4c0c-84bc-ddeba3abbf06 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:23.279957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] MFA Rules not processed for user `be3412e3af074bf48da86902072697f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:23.281460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:23.462627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1003/1981] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:23.478882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:23.513022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:23.514151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.514591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.518953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] PATH_INFO: `/v3/users/60be8c6d70464fe494cfedfea9fd094a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.522485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=60be8c6d70464fe494cfedfea9fd094a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:23.525673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:23.687074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60be8c6d70464fe494cfedfea9fd094a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:23.688236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60be8c6d70464fe494cfedfea9fd094a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:23.689893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60be8c6d70464fe494cfedfea9fd094a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:23.724774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60be8c6d70464fe494cfedfea9fd094a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:23.754290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60be8c6d70464fe494cfedfea9fd094a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:23.782117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dca2ab-d3d9-4955-83a7-0f2cc109c388 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:23.798941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:23.799514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.799791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.800111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.803426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:23.842032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:23.845714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 979/1982] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:23 2022] DELETE /identity/v3/users/60be8c6d70464fe494cfedfea9fd094a => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:23.846355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4cb45-85b4-40f9-9e4b-4f0b0ddf27ad service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:23.847974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:23.850860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:23.865360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:23.878296 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1004/1983] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:23.879931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:23.880403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:23.880855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:23.913192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:23.919626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:23.929358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.037907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934aee6-2381-4377-bcd3-98fcf78008ee admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:24.051817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:24.052532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.052764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.053066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] PATH_INFO: `/v3/projects/6e8fd623976e485bab45fc87ae7caec8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.054404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8fd623976e485bab45fc87ae7caec8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:24.056366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:24.085641 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1005/1984] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:24.087174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:24.090109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.136398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712a2c2-e1b7-45c6-a814-6bc227353b90 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:24.177749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8fd623976e485bab45fc87ae7caec8', 'request_id': 'req-d97984a1-19d0-45ec-a042-579d31569bd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.194411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8fd623976e485bab45fc87ae7caec8', 'request_id': 'req-d97984a1-19d0-45ec-a042-579d31569bd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.217659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8fd623976e485bab45fc87ae7caec8', 'request_id': 'req-d97984a1-19d0-45ec-a042-579d31569bd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.264410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] The token cache is being invalidate because project 6e8fd623976e485bab45fc87ae7caec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:24.265331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.265991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.273815 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 980/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:23 2022] DELETE /identity/v3/projects/6e8fd623976e485bab45fc87ae7caec8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:24.273815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:24.284413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.323224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:24.323895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.324308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.325964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] PATH_INFO: `/v3/users/be3412e3af074bf48da86902072697f5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.329107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3412e3af074bf48da86902072697f5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:24.331095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:24.374333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97984a1-19d0-45ec-a042-579d31569bd4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:24.377738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:24.378402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.378771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.379055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.381282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.397376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:24.398556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:24.412007 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 981/1986] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:24.413128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:24.415034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.447835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3412e3af074bf48da86902072697f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.448705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88863-e409-42c3-8883-a57cf19d29ad service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:24.449403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3412e3af074bf48da86902072697f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.474782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3412e3af074bf48da86902072697f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.479012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:24.479761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.480039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.480311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] PATH_INFO: `/v3/users/c725a249ada14c04981a207abeddd8c8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.488295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c725a249ada14c04981a207abeddd8c8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:24.497802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:24.514876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3412e3af074bf48da86902072697f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.518476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-42bc35af-0727-4b44-9ad0-0f7ada830e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3412e3af074bf48da86902072697f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.613623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1006/1987] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:24 2022] DELETE /identity/v3/users/be3412e3af074bf48da86902072697f5 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:24.617410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f518-ad46-446e-8eb6-3d5f1f9f3b8a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.621165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f518-ad46-446e-8eb6-3d5f1f9f3b8a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.623130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f518-ad46-446e-8eb6-3d5f1f9f3b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.631704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:24.636944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c725a249ada14c04981a207abeddd8c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.641203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c725a249ada14c04981a207abeddd8c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.645267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c725a249ada14c04981a207abeddd8c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.661661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c725a249ada14c04981a207abeddd8c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.684197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7ea8b7ad-fe4c-40bf-998b-f633579fcea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c725a249ada14c04981a207abeddd8c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:24.690336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b2b1f518-ad46-446e-8eb6-3d5f1f9f3b8a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:24.691814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b2b1f518-ad46-446e-8eb6-3d5f1f9f3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.729471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:24.753149 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 982/1988] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:24 2022] DELETE /identity/v3/users/c725a249ada14c04981a207abeddd8c8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:24.758362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74fd1-201e-4738-8f5e-41115bdb6610 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.759466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74fd1-201e-4738-8f5e-41115bdb6610 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.760407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74fd1-201e-4738-8f5e-41115bdb6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.802177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d5d74fd1-201e-4738-8f5e-41115bdb6610 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:24.806485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d5d74fd1-201e-4738-8f5e-41115bdb6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.870258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1007/1989] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:24.884493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:24.885204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:24.885703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:24.942072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:24.946174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:24.982989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 983/1990] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:25.001856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.002514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.006376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.054760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:25.062092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:25.092068 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 984/1991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:25.094302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.100303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:25.149047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1008/1992] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:25.153093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.204893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03723-423d-4d39-af35-891b2ada8806 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.227896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.229670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.230180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.230661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.232116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:25.233419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.237016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.271425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1009/1993] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:25.272880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.277879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:25.310323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3e3d-d891-4ad8-bddb-f9ccb94e4b16 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.321860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.322985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.326114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.326780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.351409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.353806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.380231 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 985/1994] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:25.383707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.408090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bc62-d315-4038-8c4c-87857f172760 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.419611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.421700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.423166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd014-d0dd-40e4-9e3c-dcc736e68d33 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.423982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.424480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.425423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.430648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.434528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.438104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.439622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.440649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.468462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.470895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.500793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1010/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:25.505768 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 986/1996] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:25 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:25.511730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.535100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ca93-4bfb-411c-a2ac-0a75c9ecffac service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.658880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:25.692642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.695228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.696855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.698411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.699559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.703303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.757955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1011/1997] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:25 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:25.759345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.780795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3eec-c8f8-4bc4-8c08-ae43b8bb6702 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.811410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.812113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.812412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.812965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.813864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.817131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.839557 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 987/1998] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:25.841281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.861536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa387f7-368b-4720-aa1d-91cd56e79778 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.879211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.880279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.880668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.881079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.881898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:25.884033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:25.916499 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1012/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:25.921954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.935509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1d3b8-5f70-4501-b6c3-cf7b94a3427c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:25.958372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:25.960460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:25.960460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:25.960460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] PATH_INFO: `/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef/users/8a87353853eb4e17aa11b5dc25633b6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:25.994688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:25.996841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.000083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd91623aae3942a6bcca7f7c0cd83cef, user_id=8a87353853eb4e17aa11b5dc25633b6f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.003952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c397a-d537-40b8-b0e8-8d2bdf7a8383 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.022881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfef58-f062-4523-ac69-7530152f48a4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:26.034498 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 988/2000] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:25 2022] PUT /identity/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef/users/8a87353853eb4e17aa11b5dc25633b6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:26.049942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dda0d-7777-4ee6-9152-7619792a9b13 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.051785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dda0d-7777-4ee6-9152-7619792a9b13 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.052220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dda0d-7777-4ee6-9152-7619792a9b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.080483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:26.138660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-418dda0d-7777-4ee6-9152-7619792a9b13 None None] MFA Rules not processed for user `8a87353853eb4e17aa11b5dc25633b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:26.139953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-418dda0d-7777-4ee6-9152-7619792a9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.168662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:26.169556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.169845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.170120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] PATH_INFO: `/v3/projects/1d3de060186a47989b163426fd5dc396` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.171495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3de060186a47989b163426fd5dc396)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.173611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.305843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3de060186a47989b163426fd5dc396', 'request_id': 'req-1bd61ac8-21e6-49df-8f93-93d7d388187b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.321396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3de060186a47989b163426fd5dc396', 'request_id': 'req-1bd61ac8-21e6-49df-8f93-93d7d388187b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.335329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3de060186a47989b163426fd5dc396', 'request_id': 'req-1bd61ac8-21e6-49df-8f93-93d7d388187b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.337369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 989/2001] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:26.339314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.339733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.340106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.380865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] The token cache is being invalidate because project 1d3de060186a47989b163426fd5dc396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:26.380865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.384652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.389020 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1013/2002] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:25 2022] DELETE /identity/v3/projects/1d3de060186a47989b163426fd5dc396 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:26.389020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:26.392356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.405424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] MFA Rules not processed for user `3da3b86433644508b3bd3aabb0576f93`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:26.407118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.502937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd61ac8-21e6-49df-8f93-93d7d388187b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:26.510574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:26.513343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.513343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.513343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.513343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.514736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.520023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:26.548506 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 990/2003] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:26 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:26.549684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:26.563637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.598841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1014/2004] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:26 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:26.599801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:26.601604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.603239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3e7d4-dd82-4b42-9c23-4de9570fbaf5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:26.689961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c38d-3c8a-4c3d-a4f9-177548f27ef9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:26.702246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:26.703560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.705069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.705407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] PATH_INFO: `/v3/users/123377cb40f540f693ad8c3c34164446` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.718079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123377cb40f540f693ad8c3c34164446)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.720275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.727296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:26.728155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.728502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.728851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] PATH_INFO: `/v3/projects/a18960a3c1df41409cc970a22feb2e8e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.730200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18960a3c1df41409cc970a22feb2e8e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.732933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.760878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:26.802014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123377cb40f540f693ad8c3c34164446'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.802867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123377cb40f540f693ad8c3c34164446'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.812542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18960a3c1df41409cc970a22feb2e8e', 'request_id': 'req-3749e3ed-8840-443f-8f05-1b95038d529e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.814022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123377cb40f540f693ad8c3c34164446'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.825077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123377cb40f540f693ad8c3c34164446'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.826212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123377cb40f540f693ad8c3c34164446'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.827278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18960a3c1df41409cc970a22feb2e8e', 'request_id': 'req-3749e3ed-8840-443f-8f05-1b95038d529e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.839166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18960a3c1df41409cc970a22feb2e8e', 'request_id': 'req-3749e3ed-8840-443f-8f05-1b95038d529e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.848680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1015/2005] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:26 2022] DELETE /identity/v3/users/123377cb40f540f693ad8c3c34164446 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:26.849966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:26.854518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.868769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] The token cache is being invalidate because project a18960a3c1df41409cc970a22feb2e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:26.869250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.870039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:26.872136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 991/2006] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:26 2022] DELETE /identity/v3/projects/a18960a3c1df41409cc970a22feb2e8e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:26.872964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:26.876092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:26.955792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc75e50-cbfc-4635-b89d-61865c3b90e7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:26.962198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:26.962509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:26.962804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:26.963059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] PATH_INFO: `/v3/projects/a88a1ed3af5a4359b926b300607a4a10` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:26.964247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88a1ed3af5a4359b926b300607a4a10)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:26.967299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:26.975915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:27.036582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749e3ed-8840-443f-8f05-1b95038d529e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.052123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88a1ed3af5a4359b926b300607a4a10', 'request_id': 'req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.064818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88a1ed3af5a4359b926b300607a4a10', 'request_id': 'req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.081662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88a1ed3af5a4359b926b300607a4a10', 'request_id': 'req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.103865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] The token cache is being invalidate because project a88a1ed3af5a4359b926b300607a4a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:27.103865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.103865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5497aa5-4c1d-4b6b-8c06-c8118d81ac30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.105797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1016/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:26 2022] DELETE /identity/v3/projects/a88a1ed3af5a4359b926b300607a4a10 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:27.107630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.107936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.108851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.140479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:27.141741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:27.191840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.193811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.194408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.195181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.195993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.198482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.231459 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 992/2008] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:26 2022] POST /identity/v3/users => generated 296 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:27.232792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.235533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:27.268001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c3785-4ef6-4b81-a1f1-eb13c0b9c2ab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.280040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1017/2009] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:27.281595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.282517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.283444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:27.284121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.284411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.284690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] PATH_INFO: `/v3/users/b5545c36abc4413491da96459ecb5e4a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.289794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5545c36abc4413491da96459ecb5e4a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.292640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.300386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbccfa-e82d-4f83-90ae-6a0bc1f4eadc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.308293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.310524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.311117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.311635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.313067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.316665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2544010-fbc8-4ad9-94ef-a197653b84e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.340285 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1018/2010] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:27.342790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.347249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.347766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.386434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:27.397095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:27.400342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:27.400531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5545c36abc4413491da96459ecb5e4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.402213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5545c36abc4413491da96459ecb5e4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.404014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5545c36abc4413491da96459ecb5e4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.415360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1019/2011] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:27.416659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.419620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:27.424172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5545c36abc4413491da96459ecb5e4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.442984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5545c36abc4413491da96459ecb5e4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:27.472199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29245a48-ac58-4a65-99f3-b13dc8a35cd6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.486161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.486947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.487293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.487789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] PATH_INFO: `/v3/projects/d737c297c0874fba84e52482c255abbd/users/4f8efe0aa77644b9b6fdbf2a84d29fa3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.492069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 993/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:27 2022] DELETE /identity/v3/users/b5545c36abc4413491da96459ecb5e4a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:27.492990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.529681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d737c297c0874fba84e52482c255abbd, user_id=4f8efe0aa77644b9b6fdbf2a84d29fa3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.532664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.561272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1020/2013] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:27 2022] PUT /identity/v3/projects/d737c297c0874fba84e52482c255abbd/users/4f8efe0aa77644b9b6fdbf2a84d29fa3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:27.566678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.598010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f3eb2-e108-41c0-876f-ef61b47e4e52 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.688032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:27.712595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bf6b3-dab0-4137-a325-a5d36e1a02bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.728419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.729322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.729628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.729883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.730544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.733552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.746101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.746969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.747511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.748027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.749479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:27.750272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.761522 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1021/2014] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:27.761882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.765156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.795248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35335bd-b7eb-4b2f-ac33-003c5f8dea6e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.814258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.814990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 994/2015] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:27.815627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.816167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.816838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] PATH_INFO: `/v3/projects/d737c297c0874fba84e52482c255abbd/users/4f8efe0aa77644b9b6fdbf2a84d29fa3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.821637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d737c297c0874fba84e52482c255abbd, user_id=4f8efe0aa77644b9b6fdbf2a84d29fa3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.822662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.827194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561928c7-8800-46b4-8eeb-3cdd9f930527 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.839680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b246-a886-4d69-94ab-346d490dfc7e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:27.853133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:27.853681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.853955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.854223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.854861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:27.856616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1022/2016] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:27 2022] PUT /identity/v3/projects/d737c297c0874fba84e52482c255abbd/users/4f8efe0aa77644b9b6fdbf2a84d29fa3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:27.866170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:27.868812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:27.869524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:27.870004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:27.924886 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 995/2017] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:27 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:51:27.932389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:27.970917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] MFA Rules not processed for user `4f8efe0aa77644b9b6fdbf2a84d29fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:27.975638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.011050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:28.051659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68bfd7-ad32-4318-9cd7-0f94c088a7ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.059493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.060578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.061389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.061814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.063013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.069490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.106046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 996/2018] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:27 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:28.106046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.115787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.139931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0169c20-27a5-4bb3-9bb9-35f94f40d7cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.148428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.149186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.150808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.151262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] PATH_INFO: `/v3/projects/1ce32bae8c62464491480408ddda6c2b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.153462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce32bae8c62464491480408ddda6c2b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.156606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.167893 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1023/2019] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:28.169159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.190109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b1492-f636-4cff-b428-23b246cc2442 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.197721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.199168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.199467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.199800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.201170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.204689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.224549 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1024/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:28.224549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.226173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.238178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce32bae8c62464491480408ddda6c2b', 'request_id': 'req-a097b806-5cb9-41f8-b02f-8d3dde750be7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.264732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce32bae8c62464491480408ddda6c2b', 'request_id': 'req-a097b806-5cb9-41f8-b02f-8d3dde750be7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.278995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e2cd-234f-44f4-9818-8517468060d6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.298544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce32bae8c62464491480408ddda6c2b', 'request_id': 'req-a097b806-5cb9-41f8-b02f-8d3dde750be7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.322494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] The token cache is being invalidate because project 1ce32bae8c62464491480408ddda6c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:28.323207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.325384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.328368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 997/2021] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:28 2022] DELETE /identity/v3/projects/1ce32bae8c62464491480408ddda6c2b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:28.329531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.331165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.459983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b806-5cb9-41f8-b02f-8d3dde750be7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.470117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.470117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.470117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.470867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.470957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] PATH_INFO: `/v3/projects/3833601c92d84f1cb52bfef58eb49e6f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.471045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.471045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.471045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.471610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.473506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.474467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3833601c92d84f1cb52bfef58eb49e6f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.476652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.492785 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 998/2022] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:28.492785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.495938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.570067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3833601c92d84f1cb52bfef58eb49e6f', 'request_id': 'req-c8b466cf-52dc-4eea-9f1a-c7af48528e85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.573708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:28.586876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3833601c92d84f1cb52bfef58eb49e6f', 'request_id': 'req-c8b466cf-52dc-4eea-9f1a-c7af48528e85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.602255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:28.604888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3833601c92d84f1cb52bfef58eb49e6f', 'request_id': 'req-c8b466cf-52dc-4eea-9f1a-c7af48528e85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.633112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] The token cache is being invalidate because project 3833601c92d84f1cb52bfef58eb49e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:28.633667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.638635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8b466cf-52dc-4eea-9f1a-c7af48528e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:28.641307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1025/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:28 2022] DELETE /identity/v3/projects/3833601c92d84f1cb52bfef58eb49e6f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:28.645309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.645580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.647755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.673308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:28.674619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.682023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f349726-7ddc-4156-b626-bf164dc7e730 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.751017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1026/2024] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:28.751833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:28.754631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.772739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.774220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.774741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.775260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.776154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c6b6-6b68-4594-bfdb-d227216a4e35 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:28.777770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.783640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:28.784353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.784634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.784978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] PATH_INFO: `/v3/projects/28e5a1214de9496d87b690d38ba80ea4/users/a7e06c8681bd48ce9422147f306cd27c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.810775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e5a1214de9496d87b690d38ba80ea4, user_id=a7e06c8681bd48ce9422147f306cd27c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.815236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4040a-fac6-4f98-9683-9ff224a3ec26 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.843700 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1027/2025] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:28 2022] PUT /identity/v3/projects/28e5a1214de9496d87b690d38ba80ea4/users/a7e06c8681bd48ce9422147f306cd27c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:28.845493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef58f-6228-4155-8098-451c804e6b8b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.846000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef58f-6228-4155-8098-451c804e6b8b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.846497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef58f-6228-4155-8098-451c804e6b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.883789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-250ef58f-6228-4155-8098-451c804e6b8b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:28.887048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-250ef58f-6228-4155-8098-451c804e6b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:28.899123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:28.901421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20ce91-ce02-4040-a068-c01a697c112d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:28.924827 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 999/2026] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:28.927293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:28.927581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:28.927856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:28.969700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:28.971218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.045325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1028/2027] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.046752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90b64-d151-433c-8270-677d01df18c4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.048328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90b64-d151-433c-8270-677d01df18c4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.048610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90b64-d151-433c-8270-677d01df18c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.088279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ac90b64-d151-433c-8270-677d01df18c4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:29.089750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ac90b64-d151-433c-8270-677d01df18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.102736 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1029/2028] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.102736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b3b-7478-4d15-81e4-3f0a826aefd7 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.102736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b3b-7478-4d15-81e4-3f0a826aefd7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.102736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599b3b-7478-4d15-81e4-3f0a826aefd7 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.108988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1030/2029] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:29.110936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.111225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.111635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.121403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1000/2030] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.143901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:29.151390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.168411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:29.169735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.193283 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1031/2031] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.193978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.197756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.208205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:29.303321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:29.305324 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 28 09:51:29.306092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.334860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262873c1-c661-42d2-93d3-a3df53090bd5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.345408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.348815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.348815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.348815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.373826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.375180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.387258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1032/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:29.388783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.400723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10468-7f9b-45f1-8ffb-e8e24fe999f6 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.406638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.407561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.407894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.408456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.409814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:29.410194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.412009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.415649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64d7ef-d020-46b9-8ffb-c74ea1fba848 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.423166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f8efe0aa77644b9b6fdbf2a84d29fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd737c297c0874fba84e52482c255abbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.425377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.425672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.425926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] PATH_INFO: `/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.432168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: Authorizing `identity:get_project(project_id=cd91623aae3942a6bcca7f7c0cd83cef)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.436335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1033/2033] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:29.438415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.439388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.452756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1001/2034] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef => generated 377 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:29.455226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.484946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb49-ab46-4f05-9957-290a9e919155 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.500937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e766-b893-4dc4-9c36-151c88a25326 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.506229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.506699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.507102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.507391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.508050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:29.508378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.510537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.518731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.519341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.519613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.519874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.520785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.525589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.542864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1034/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:29.547531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.573182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b13a-7592-46c4-9654-6e96509a150e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.590527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.591183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.591462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.591722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.596309 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1002/2036] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/projects => generated 397 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:29.596309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.600377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.710311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8596-dd61-4c9d-a818-77024bf23d75 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.733064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.734704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.735299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.735675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.736645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.738868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.796678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.796678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.805670 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1035/2037] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:29.807423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.822043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e7b8-acdd-451e-a465-5bb14c59535c service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.828222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.829145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.829718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.830415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.831274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.833524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.836108 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1003/2038] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:29.841596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.892844 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1036/2039] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:29.900291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.910625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:29.933467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5625-c814-481d-b7cf-47dbee516b4f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.029460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae093e-0f12-45cf-8090-4e81a08c5261 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.035255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.035898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.036185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.036454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.037301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.039635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b47d8-4076-4eea-bc05-7be0c811a65d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.076813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1004/2040] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:30.081072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72caca-a6f0-4386-8fb2-39afc9dd1770 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.081072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72caca-a6f0-4386-8fb2-39afc9dd1770 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.081072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72caca-a6f0-4386-8fb2-39afc9dd1770 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.085182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1005/2041] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:30.087227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72caca-a6f0-4386-8fb2-39afc9dd1770 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.119752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.120574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72caca-a6f0-4386-8fb2-39afc9dd1770 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.121169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.121578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.121969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.124544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.127746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.137221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.137900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.138181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.138481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.139440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.141384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.152362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1037/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:30.155396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:30.176785 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1006/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:30.178345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.210517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be60b3-688e-4383-831d-940841ac9075 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.219606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.220243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.220527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.220803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.221797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.223480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.263765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1007/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:30.264351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.286578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11efc-c764-468d-9817-25f0c4933813 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.289923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:30.304063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.304707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.305999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.306346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.309285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.311062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.332397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1008/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:30.333303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.376373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e2f9-9339-4a17-86a8-53c9b7b95224 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.383427 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 28 09:51:30.383839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.396228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.398342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.398781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.399276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] PATH_INFO: `/v3/projects/720fdb249ed1424197c88e597e153de5/users/236491013a7b459e83eb3dd3280c145b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.454415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720fdb249ed1424197c88e597e153de5, user_id=236491013a7b459e83eb3dd3280c145b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.464689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.532958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1009/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:30 2022] PUT /identity/v3/projects/720fdb249ed1424197c88e597e153de5/users/236491013a7b459e83eb3dd3280c145b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:30.535472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.623252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5789c-0c66-480b-a659-186f117c1dc3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.717943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3df4-c705-421b-8104-8d531a205e53 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.739071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.739905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.740265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.740611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] PATH_INFO: `/v3/projects/97b24791622547108064fc4f476b3b1c/users/041777290be44c55ba2a866abdede40e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.779759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b24791622547108064fc4f476b3b1c, user_id=041777290be44c55ba2a866abdede40e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.782699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51977c-8692-4230-bb58-875b4980764f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.805352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f8efe0aa77644b9b6fdbf2a84d29fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd737c297c0874fba84e52482c255abbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.806733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.807429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.807917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] PATH_INFO: `/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.810776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: Authorizing `identity:get_project(project_id=cd91623aae3942a6bcca7f7c0cd83cef)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.814316 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1010/2047] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:30 2022] PUT /identity/v3/projects/97b24791622547108064fc4f476b3b1c/users/041777290be44c55ba2a866abdede40e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:30.815768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.816127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.818114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.833125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f50406-709e-404a-9e4b-1cb4a1cf9721 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.837409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1038/2048] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef => generated 377 bytes in 684 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:30.839397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.840047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.840614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.887271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] MFA Rules not processed for user `236491013a7b459e83eb3dd3280c145b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:30.889148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:30.925091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] MFA Rules not processed for user `041777290be44c55ba2a866abdede40e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:30.928517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:30.936418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:31.148512 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1039/2049] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:31.151261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.175182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1011/2050] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:31.176037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:31.178230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.369464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946f934-24bb-4a94-ad82-49f9286ecba9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:31.383671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:31.384700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:31.385293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:31.385717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:31.386573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:31.389406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:31.451254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ae2d-bc70-4902-821e-6398895b05bf None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:31.452100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1040/2051] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:31.453436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.628268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0f529-ef4e-4915-abe0-6757b31833d8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:31.660811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:31.662553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:31.662849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:31.663387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:31.664942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:31.680032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:31.695074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:31.696266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:31.696748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:31.697183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:31.698341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:31.715801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:31.783343 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1041/2052] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:31 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:31.785278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.816216 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1012/2053] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:31 2022] POST /identity/v3/projects => generated 399 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:51:31.825845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.833832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a31c-15eb-46c6-9ebb-dc17261ef8f4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.009003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:32.051948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.053143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.053518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.054026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.055109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d4a5b-933b-4b6d-a9c0-0ed44d024363 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.055290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.058800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.080002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.082214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.084326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.085047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.085902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.092475 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1042/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:32.092874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.097708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.117141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be28f7b-3932-4003-beb7-c815f1705ff6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.129550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.130344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.130511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.130757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] PATH_INFO: `/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6/users/e13f1294912e487e86465539b1af308d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.150307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1013/2055] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:31 2022] POST /identity/v3/users => generated 306 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:32.156397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.179762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d1d0eb886f44a5a17ad6b9f2da65e6, user_id=e13f1294912e487e86465539b1af308d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.182778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.186672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12e63-7a11-4b84-8833-784d67cc5a99 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.202189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:32.212343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.215120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.219818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1043/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:32 2022] PUT /identity/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6/users/e13f1294912e487e86465539b1af308d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:32.220063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.220063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.221155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.221764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.226490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.280845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1014/2057] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:51:32.285610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.370557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab4c7-9bf1-4731-b1ec-7a55be59b86f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.401196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8349-2dad-4239-bf90-be2ecd050123 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.422070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.423562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.424731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.424985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.425425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.426730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.427792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.435637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.436698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] PATH_INFO: `/v3/projects/a250c58117674f73a7b2f1e348d56ea7/users/9d8811dc18b5479495104e14c3e11c86/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.436867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.483692 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1044/2058] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:51:32.488646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.495034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a250c58117674f73a7b2f1e348d56ea7, user_id=9d8811dc18b5479495104e14c3e11c86, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.502864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.526602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f06c25-8e47-43ed-a2e2-3107c3bfd00b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:32.599588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1015/2059] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:32 2022] PUT /identity/v3/projects/a250c58117674f73a7b2f1e348d56ea7/users/9d8811dc18b5479495104e14c3e11c86/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:32.611453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:32.884162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:32.885616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.886117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.886568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] PATH_INFO: `/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6/users/e13f1294912e487e86465539b1af308d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:32.889651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d1d0eb886f44a5a17ad6b9f2da65e6, user_id=e13f1294912e487e86465539b1af308d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:32.893688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455f4da-f602-4ee3-8a4d-a31b948504b9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:32.930457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1045/2060] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:32 2022] PUT /identity/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6/users/e13f1294912e487e86465539b1af308d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:32.957265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:32.958773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:32.959822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.046084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b441f-7d36-4036-82da-dedb65b7d641 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:33.059399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] MFA Rules not processed for user `e13f1294912e487e86465539b1af308d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:33.069215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:33.357700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:33.362692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.364799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.365475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.373401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:33.384935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:33.389073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1046/2061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:33.404266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:33.463173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:33.465104 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1016/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 855 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:33.467484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:33.471029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:33.529213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16525e9-c742-4355-a5e1-88da8d9d2eaa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:33.554965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:33.555646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.555931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.556205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] PATH_INFO: `/v3/users/8a87353853eb4e17aa11b5dc25633b6f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.568611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a87353853eb4e17aa11b5dc25633b6f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:33.570038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:33.681041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a598-991a-42b7-ab3c-89a71a4dc5a1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:33.696461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:33.699315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.699670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.699879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.713882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:33.719206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a87353853eb4e17aa11b5dc25633b6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:33.721482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a87353853eb4e17aa11b5dc25633b6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:33.723429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a87353853eb4e17aa11b5dc25633b6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:33.729288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:33.733345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:33.745358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a87353853eb4e17aa11b5dc25633b6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:33.765038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8312d151-2950-4259-bd25-e6eeeaf05da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a87353853eb4e17aa11b5dc25633b6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:33.767756 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1047/2063] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:51:33.771286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:33.814126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c4aca-9a19-4bac-a60d-89a9c710c6d5 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:33.836005 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1017/2064] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:33 2022] DELETE /identity/v3/users/8a87353853eb4e17aa11b5dc25633b6f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:33.837165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:33.837861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.838299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.838577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] PATH_INFO: `/v3/projects/a250c58117674f73a7b2f1e348d56ea7/users/9d8811dc18b5479495104e14c3e11c86/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.842940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.844612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.845077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.845762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a250c58117674f73a7b2f1e348d56ea7, user_id=9d8811dc18b5479495104e14c3e11c86, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:33.848482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc49ab-b58b-446f-933c-3cab7bf98116 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:33.882822 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1048/2065] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:33 2022] PUT /identity/v3/projects/a250c58117674f73a7b2f1e348d56ea7/users/9d8811dc18b5479495104e14c3e11c86/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:33.902172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:33.903142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:33.903142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:33.916789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:33.918058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:33.985226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] MFA Rules not processed for user `9d8811dc18b5479495104e14c3e11c86`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:33.986515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.131412 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1018/2066] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:34.132490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:34.135494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.164444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb092dd-9be2-4dcd-88d9-0e064254209e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:34.170585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:34.171277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:34.171581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:34.178679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] PATH_INFO: `/v3/users/041777290be44c55ba2a866abdede40e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:34.188411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=041777290be44c55ba2a866abdede40e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:34.190869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:34.244203 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1049/2067] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:34.260285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:34.263520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.361263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041777290be44c55ba2a866abdede40e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:34.364820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041777290be44c55ba2a866abdede40e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:34.365834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041777290be44c55ba2a866abdede40e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:34.402457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041777290be44c55ba2a866abdede40e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:34.428421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041777290be44c55ba2a866abdede40e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:34.519803 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1019/2068] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:34 2022] DELETE /identity/v3/users/041777290be44c55ba2a866abdede40e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:34.531283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:34.539224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.658051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48dad-aee5-4143-afef-6709244216e7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:34.670183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:34.682097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:34.729147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1f8-e0e4-43ae-a891-9f8ba9475f2e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:34.740332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:34.741024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:34.741311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:34.741588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:34.746737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.893504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:34.894519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:34.894519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:34.895013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:34.897305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:34.933983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:34.938662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1127c4-fcfc-4634-be06-a7c4a7cf4838 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:34.962669 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1020/2069] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:34.965298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:34.966941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:34.967560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:35.004887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:35.007950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:35.036536 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1021/2070] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:35.038752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:35.040852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:35.054699 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1050/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:51:35.076686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:35.080044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:35.094509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b062f-1464-455d-9cea-81250b01cbf4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:35.107742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:35.110182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:35.110608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:35.111248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:35.148155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:35.151893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:35.166095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1022/2072] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:51:35.679719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:35.685263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:35.729286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96a42-3659-40fa-917e-f5708f479246 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:35.751202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:35.751956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:35.752248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:35.752682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:35.759972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:35.891356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:35.893355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1f9f-c119-4747-912b-452c31b3f0eb service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:35.927186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1051/2073] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:36.320782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:36.322860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:36.346766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95b81-602e-452a-9ab0-b5b2cb6e8157 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:36.352979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:36.353842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:36.354516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:36.355086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] PATH_INFO: `/v3/users/236491013a7b459e83eb3dd3280c145b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:36.357368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=236491013a7b459e83eb3dd3280c145b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:36.359901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:36.519540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236491013a7b459e83eb3dd3280c145b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:36.524487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236491013a7b459e83eb3dd3280c145b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:36.527235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236491013a7b459e83eb3dd3280c145b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:36.548820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236491013a7b459e83eb3dd3280c145b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:36.573899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236491013a7b459e83eb3dd3280c145b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:36.634736 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1023/2074] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:36 2022] DELETE /identity/v3/users/236491013a7b459e83eb3dd3280c145b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:36.635789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:36.636260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:36.636390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:36.715134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:36.717578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:36.820801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:36.940972 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1052/2075] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:36.980077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:36.982357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:37.008680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e745-64e5-453e-81f9-3f05239ea56a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:37.014328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:37.016454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:37.023122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:37.023813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:37.024152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:37.024444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] PATH_INFO: `/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:37.027089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd91623aae3942a6bcca7f7c0cd83cef)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:37.033881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:37.128265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:37.144705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142376de-4f1e-4d7d-9c2c-0dde83d714db None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:37.161564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd91623aae3942a6bcca7f7c0cd83cef', 'request_id': 'req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.180064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd91623aae3942a6bcca7f7c0cd83cef', 'request_id': 'req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.193699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd91623aae3942a6bcca7f7c0cd83cef', 'request_id': 'req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.243470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] The token cache is being invalidate because project cd91623aae3942a6bcca7f7c0cd83cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:37.244167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:37.246380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.247476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:37.247897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:37.248477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:37.249130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.250900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:37.257645 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1024/2076] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:36 2022] DELETE /identity/v3/projects/cd91623aae3942a6bcca7f7c0cd83cef => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:51:37.263688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:37.266361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:37.415808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:37.417675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:37.466526 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1053/2077] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:37.478335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ae8f3-b955-4c48-bb3c-4d833c5e5287 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:37.489651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:37.491371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:37.492091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:37.493324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] PATH_INFO: `/v3/users/4f8efe0aa77644b9b6fdbf2a84d29fa3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:37.498014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8efe0aa77644b9b6fdbf2a84d29fa3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:37.499995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:37.584716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:37.586558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:37.627616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1379b-daf2-45d6-9be9-1735dd621bc8 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:37.637555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:37.638512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:37.638674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:37.638827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] PATH_INFO: `/v3/projects/97b24791622547108064fc4f476b3b1c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:37.641493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b24791622547108064fc4f476b3b1c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:37.643482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8efe0aa77644b9b6fdbf2a84d29fa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.643708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:37.646487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8efe0aa77644b9b6fdbf2a84d29fa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.649497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8efe0aa77644b9b6fdbf2a84d29fa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.695140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8efe0aa77644b9b6fdbf2a84d29fa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.722715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8efe0aa77644b9b6fdbf2a84d29fa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.813384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1025/2078] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:37 2022] DELETE /identity/v3/users/4f8efe0aa77644b9b6fdbf2a84d29fa3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:37.835820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:37.865683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b24791622547108064fc4f476b3b1c', 'request_id': 'req-0b19902d-2c37-472e-93e0-10a183d49f6a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.891746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b24791622547108064fc4f476b3b1c', 'request_id': 'req-0b19902d-2c37-472e-93e0-10a183d49f6a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.914147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b24791622547108064fc4f476b3b1c', 'request_id': 'req-0b19902d-2c37-472e-93e0-10a183d49f6a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.948072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] The token cache is being invalidate because project 97b24791622547108064fc4f476b3b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:37.948660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.952868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:37.960073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1054/2079] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:37 2022] DELETE /identity/v3/projects/97b24791622547108064fc4f476b3b1c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:37.960898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:37.962542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:38.086957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:38.128744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5125ac-cfe9-42d9-ac90-c6733ac79dc6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:38.337070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:38.337533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:38.337817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:38.340000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:38.340286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] PATH_INFO: `/v3/users/e13f1294912e487e86465539b1af308d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:38.342280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:38.344864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f1294912e487e86465539b1af308d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:38.347904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:38.398073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19902d-2c37-472e-93e0-10a183d49f6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:38.413942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:38.419488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:38.421529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:38.422229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] PATH_INFO: `/v3/users/791f2111f74a452eaa525d16ce0b6448` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:38.427338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=791f2111f74a452eaa525d16ce0b6448)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:38.433814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:38.470561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f1294912e487e86465539b1af308d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.471611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f1294912e487e86465539b1af308d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.473950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f1294912e487e86465539b1af308d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.487773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f1294912e487e86465539b1af308d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.503013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a37b8907-a65f-444e-8664-cecadf1209c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f1294912e487e86465539b1af308d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.567789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1026/2080] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:37 2022] DELETE /identity/v3/users/e13f1294912e487e86465539b1af308d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:38.584869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791f2111f74a452eaa525d16ce0b6448'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.586695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791f2111f74a452eaa525d16ce0b6448'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.633212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791f2111f74a452eaa525d16ce0b6448'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.663746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791f2111f74a452eaa525d16ce0b6448'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.680540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791f2111f74a452eaa525d16ce0b6448'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:38.822694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1055/2081] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:38 2022] DELETE /identity/v3/users/791f2111f74a452eaa525d16ce0b6448 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:38.828019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:38.828480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:38.829954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:38.884595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:38.886921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.032996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1027/2082] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:39.069629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:39.072996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.180830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72041-75c6-42eb-b20c-3b52743edacd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:39.186934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:39.187910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.188373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.188821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.214099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:39.215552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:39.227860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1056/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:39.268669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:39.270483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.284642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:39.286469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.311662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33725-c3e3-4b01-8eb3-b860caa34b6a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:39.316269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150768ff-0299-4e5a-9bf7-c7e77933c7df service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:39.328305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:39.331150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:39.331815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.332286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.333020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] PATH_INFO: `/v3/projects/d737c297c0874fba84e52482c255abbd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.333979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.334468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.334743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] PATH_INFO: `/v3/projects/720fdb249ed1424197c88e597e153de5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.336009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d737c297c0874fba84e52482c255abbd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:39.337986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:39.340521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] RBAC: Authorizing `identity:delete_project(project_id=720fdb249ed1424197c88e597e153de5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:39.343258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:39.344817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:39.429202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:39.459056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720fdb249ed1424197c88e597e153de5', 'request_id': 'req-41412aef-d35c-49c6-9ef7-6ff395bd483c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.479000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd737c297c0874fba84e52482c255abbd', 'request_id': 'req-bd829546-309a-40e6-bdd1-11fd448249e8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.483484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720fdb249ed1424197c88e597e153de5', 'request_id': 'req-41412aef-d35c-49c6-9ef7-6ff395bd483c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.496348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd737c297c0874fba84e52482c255abbd', 'request_id': 'req-bd829546-309a-40e6-bdd1-11fd448249e8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.502481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720fdb249ed1424197c88e597e153de5', 'request_id': 'req-41412aef-d35c-49c6-9ef7-6ff395bd483c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.523863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd737c297c0874fba84e52482c255abbd', 'request_id': 'req-bd829546-309a-40e6-bdd1-11fd448249e8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.542158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] The token cache is being invalidate because project 720fdb249ed1424197c88e597e153de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:39.542424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.543614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.553992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1057/2084] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:39 2022] DELETE /identity/v3/projects/720fdb249ed1424197c88e597e153de5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:39.553992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:39.556204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] The token cache is being invalidate because project d737c297c0874fba84e52482c255abbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:39.558405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.559115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.561087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.567600 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1028/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:39 2022] DELETE /identity/v3/projects/d737c297c0874fba84e52482c255abbd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:39.572059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:39.578076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:39.727618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd829546-309a-40e6-bdd1-11fd448249e8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:39.759456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41412aef-d35c-49c6-9ef7-6ff395bd483c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:39.772003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:39.772959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.773253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.773691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] PATH_INFO: `/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.774915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d1d0eb886f44a5a17ad6b9f2da65e6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:39.777490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:39.856768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d1d0eb886f44a5a17ad6b9f2da65e6', 'request_id': 'req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.866273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d1d0eb886f44a5a17ad6b9f2da65e6', 'request_id': 'req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.878635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:39.882393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d1d0eb886f44a5a17ad6b9f2da65e6', 'request_id': 'req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.883119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.883531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.883924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] PATH_INFO: `/v3/users/9d8811dc18b5479495104e14c3e11c86` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.885293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8811dc18b5479495104e14c3e11c86)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:39.892283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:39.914320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] The token cache is being invalidate because project 58d1d0eb886f44a5a17ad6b9f2da65e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:39.914906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.916593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82ab3375-d86d-4678-a3a2-4ff1483cb2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:39.931623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1058/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:39 2022] DELETE /identity/v3/projects/58d1d0eb886f44a5a17ad6b9f2da65e6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:39.931623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abc6bb-e024-4e41-b70e-e9132cdc4c10 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:39.931623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abc6bb-e024-4e41-b70e-e9132cdc4c10 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:39.931623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abc6bb-e024-4e41-b70e-e9132cdc4c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:39.993568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:40.001753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-37abc6bb-e024-4e41-b70e-e9132cdc4c10 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:40.003829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37abc6bb-e024-4e41-b70e-e9132cdc4c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.014534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8811dc18b5479495104e14c3e11c86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.015696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8811dc18b5479495104e14c3e11c86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.019240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8811dc18b5479495104e14c3e11c86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.032383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8811dc18b5479495104e14c3e11c86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.045352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8811dc18b5479495104e14c3e11c86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.081576 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1029/2087] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:39 2022] DELETE /identity/v3/users/9d8811dc18b5479495104e14c3e11c86 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:40.082735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.084599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.099191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:40.131073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1059/2088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:40.133815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768787ff-b31b-4f4f-8ae2-5707f72978c4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.134449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768787ff-b31b-4f4f-8ae2-5707f72978c4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.134939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768787ff-b31b-4f4f-8ae2-5707f72978c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.170824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-768787ff-b31b-4f4f-8ae2-5707f72978c4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:40.172477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-768787ff-b31b-4f4f-8ae2-5707f72978c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.258123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1060/2089] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:40.260844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417b2-7991-446c-af1b-537d7f3c2f6c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.261422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417b2-7991-446c-af1b-537d7f3c2f6c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.261964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417b2-7991-446c-af1b-537d7f3c2f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.292002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-400417b2-7991-446c-af1b-537d7f3c2f6c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:40.293091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba700-6f5a-4d0a-a97e-8675c0d9051c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:40.295166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-400417b2-7991-446c-af1b-537d7f3c2f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.307325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1061/2090] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:40.309113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.309724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.310282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.313485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:40.314250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.314684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.315123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] PATH_INFO: `/v3/projects/340ea03cddd04e83aaabb5e6810892d2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.316372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=340ea03cddd04e83aaabb5e6810892d2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:40.318334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:40.336010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:40.337902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.362109 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1062/2091] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:40.363393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.384882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8284-00f7-4e75-aff7-ce31f5de9616 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:40.416149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:40.421813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.422405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.423432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.426747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:40.429890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:40.436785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:40.453300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340ea03cddd04e83aaabb5e6810892d2', 'request_id': 'req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.463417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340ea03cddd04e83aaabb5e6810892d2', 'request_id': 'req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.477096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340ea03cddd04e83aaabb5e6810892d2', 'request_id': 'req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.492610 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1063/2092] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:40.498690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.516559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a56a9-27f1-4327-9310-b3bc196b9f81 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:40.540159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] The token cache is being invalidate because project 340ea03cddd04e83aaabb5e6810892d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:40.545146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.555783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.565484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1030/2093] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:40 2022] DELETE /identity/v3/projects/340ea03cddd04e83aaabb5e6810892d2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:40.568623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.572366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.614535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:40.615276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.615530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.615844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.617063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:40.617442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:40.619896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:40.644563 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1064/2094] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:40.646429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.649179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.675635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6a17-0158-4c84-b3b1-2613c50145c2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:40.687313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:40.688158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.688594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.690042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] PATH_INFO: `/v3/users/07d5a94be0ce409597bd6acee18779bb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.692044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d5a94be0ce409597bd6acee18779bb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:40.697190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:40.722472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:40.777207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4eb90-2789-4365-a4e5-7e163ad3ed4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:40.800091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:40.801114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:40.801793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:40.802144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:40.803014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:40.805392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:40.829653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d5a94be0ce409597bd6acee18779bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.830690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d5a94be0ce409597bd6acee18779bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.850850 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1031/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:40 2022] POST /identity/v3/projects => generated 391 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:40.854877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:40.865293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:40.903627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d5a94be0ce409597bd6acee18779bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.943636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:40.955060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d5a94be0ce409597bd6acee18779bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:40.956790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d5a94be0ce409597bd6acee18779bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.013936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1065/2096] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:40 2022] DELETE /identity/v3/users/07d5a94be0ce409597bd6acee18779bb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:41.015999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:41.027653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:41.130783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295af7a0-5148-4842-a4b9-3d3924ecf813 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:41.308989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b123ea5-25b5-4b5d-bc97-8294617d7838 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:41.319347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:41.319986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.320636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.320636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.321201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:41.323751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:41.392019 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1066/2097] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:41 2022] POST /identity/v3/users => generated 296 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:41.396738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:41.399115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:41.420507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab6fc1-a457-41e4-b76b-0d1707b1e7b3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:41.444154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:41.447873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.448743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.449706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.452434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:41.453184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.453450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.453720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] PATH_INFO: `/v3/projects/a250c58117674f73a7b2f1e348d56ea7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.455541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:41.461667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:41.464061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a250c58117674f73a7b2f1e348d56ea7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:41.466989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:41.574788 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1032/2098] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:40 2022] POST /identity/v3/projects => generated 407 bytes in 725 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:41.576592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:41.695132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a250c58117674f73a7b2f1e348d56ea7', 'request_id': 'req-54d6435b-8d9c-44f1-9a41-29008eedac15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.712602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a250c58117674f73a7b2f1e348d56ea7', 'request_id': 'req-54d6435b-8d9c-44f1-9a41-29008eedac15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.729017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a250c58117674f73a7b2f1e348d56ea7', 'request_id': 'req-54d6435b-8d9c-44f1-9a41-29008eedac15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.739993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314277f2-8a4c-43dd-9ecf-fd0789628d53 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:41.760312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] The token cache is being invalidate because project a250c58117674f73a7b2f1e348d56ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:41.760612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.761389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:41.763585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:41.768030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1067/2099] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:41 2022] DELETE /identity/v3/projects/a250c58117674f73a7b2f1e348d56ea7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:41.773996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:41.776993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:41.885203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:41.908706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:41.909622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.910418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.910993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.911965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:41.923114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4976df-13db-4888-897e-45ee122b670a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:41.928808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6435b-8d9c-44f1-9a41-29008eedac15 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:41.940592 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1033/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:41.940592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.940592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.941240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.948179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:41.949177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:41.949659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:41.950193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:41.951116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:41.985926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:41.988079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:41.991427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.020962 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1034/2101] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:42.020962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.020962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.041252 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1068/2102] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:41 2022] POST /identity/v3/users => generated 304 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:42.043997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.050530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883ed4-e543-4a43-ad75-dcd1f95c3f38 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.051433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.066977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.067761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.068043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.068316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] PATH_INFO: `/v3/projects/f46254807cd041168a380adb71aaf2ee` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.070358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46254807cd041168a380adb71aaf2ee)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.073800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.085291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931fdc8-6fee-4ead-b071-72cdc628b367 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.101407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.102044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.102336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.102586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.103231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.109054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872315-b114-40bf-93fd-2a33ae2e2e7a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.144623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1069/2103] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:42.144623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.144623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.144623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.206566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:42.211770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.226176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46254807cd041168a380adb71aaf2ee', 'request_id': 'req-67056eb9-b1df-466d-8d4d-1bad278455b9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:42.238310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46254807cd041168a380adb71aaf2ee', 'request_id': 'req-67056eb9-b1df-466d-8d4d-1bad278455b9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:42.256821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46254807cd041168a380adb71aaf2ee', 'request_id': 'req-67056eb9-b1df-466d-8d4d-1bad278455b9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:42.275809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] The token cache is being invalidate because project f46254807cd041168a380adb71aaf2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:42.276228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:42.277326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:42.281601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1035/2104] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:42 2022] DELETE /identity/v3/projects/f46254807cd041168a380adb71aaf2ee => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:42.282923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.285770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.366548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1070/2105] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:42.366548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.367489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.387185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adc4b-083b-4961-b6f4-5bba259899b1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.394624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056eb9-b1df-466d-8d4d-1bad278455b9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.395193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.396272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.396723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.397229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6/users/b6fdf4cd494c44b18e831ebd3a53df7f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.405185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.406611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.407010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.407387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.409205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.412037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a889d-9a52-4994-b5ad-3427bbcf65ee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.416139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2556286fc5e54589bf8c8b0c2536a6a6, user_id=b6fdf4cd494c44b18e831ebd3a53df7f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.420935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.433626 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1036/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:42.439132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.440320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.441976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.449089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1071/2107] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:42 2022] PUT /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6/users/b6fdf4cd494c44b18e831ebd3a53df7f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:42.450554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.468826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:42.470348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.488459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:42.561636 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1037/2108] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:42.562885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.594153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789a0a6-6b33-46d7-b77a-2637d627d9e8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.617669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.618856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.619578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.620136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.621277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.623528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a69f1-f01b-4819-b517-102fdac404dc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.634183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df88-6326-4e8f-b934-684f1991bdac admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.640149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.641118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.641470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.641822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.642602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:42.642971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.644947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5dc2-e102-49f5-9122-01bf554d85a8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.648332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1038/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:42.651092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.651838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.652328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.674550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1072/2110] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:42.675844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.676132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.676469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.692240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] MFA Rules not processed for user `b6fdf4cd494c44b18e831ebd3a53df7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:42.693765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.724190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:42.725559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:42.737337 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1073/2111] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:42.738852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.757337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8d642-163f-4642-86b7-6861024b2c45 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.767831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.769850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.770486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.771247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] PATH_INFO: `/v3/projects/85488fa9eb84479b8a3f3f31f498471d/users/9ee0658218264881bdc0e2a872c5011b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.788990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1039/2112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:42.788990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.800802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85488fa9eb84479b8a3f3f31f498471d, user_id=9ee0658218264881bdc0e2a872c5011b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.804393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6021-9e29-4447-b69f-3f951859e63f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.806724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.809798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.810517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.810869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.811627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.812116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.814471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:42.833208 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1074/2113] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:42 2022] PUT /identity/v3/projects/85488fa9eb84479b8a3f3f31f498471d/users/9ee0658218264881bdc0e2a872c5011b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:42.834944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.849952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:42.869014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1040/2114] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:42.869014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:42.935493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452120-6797-46ba-b960-a752a02027d6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.960333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612793b4-4d2f-48ca-a02b-54cf05f48d71 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:42.966348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:42.966993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:42.967265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:42.967531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:42.968182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:42.970224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047a86-1879-4178-9547-5e5c2463f074 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.009616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1041/2115] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:42 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.009616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.009616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.009616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.018372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:43.034510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.035676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.035964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.036248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.036897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:43.037238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.038868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.047211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] MFA Rules not processed for user `9ee0658218264881bdc0e2a872c5011b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:43.048561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:43.056418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1075/2116] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:43.056418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.067412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44ea3-072f-4161-a782-7aa649a270be admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.141518 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1042/2117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:43.144367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.172245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.173468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.173468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.173468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.174262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.176243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.209749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1076/2118] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/users => generated 305 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.210793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.222608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e063a-68b8-43d4-9bd4-56d030cb9813 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.229259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.230057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.230934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.230934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.231557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.234144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.275769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7120-c8a7-4522-9201-af4f294882c3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.283240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.283870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.284213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.284442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.286087 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1077/2119] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.287262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.289329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.291350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.332936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:43.349458 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1043/2120] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.350702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.370202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46760-96eb-4cb9-a4e4-b309fc028b66 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.407322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f366b-15b3-4d58-aa23-b6d3ceef72f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.422127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.426328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.426738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.427466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.427883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.432590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.463279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.464026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.464624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.464992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.465762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.467751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.487396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1044/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:43.488371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.504415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9693e7-403e-4853-ad92-5cc5d5f79661 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.509738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.510369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.510647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.510976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.511620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.514414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.515745 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1078/2122] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/projects => generated 409 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.517291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.539069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:43.552637 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1045/2123] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.557151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.581183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6349-6544-4445-aec7-72d17d8d02c0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.688827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb683-e79b-4826-8d07-d5a390cc7835 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.703013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.703815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.704200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.704569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.705494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.707334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.730326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1079/2124] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:43.735039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.738963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.739690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.739970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.740242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.740933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.742618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.757774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1046/2125] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:43.759095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.776215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01286-af43-4992-90d1-34025a86fd72 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.785510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61d71-e361-41f8-889e-9d5947ed56a2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.789137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.790251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.790765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.791488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.792625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.797096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.797851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.799523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.800521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.801051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.801877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.804144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.816840 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1047/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:43.817733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.830499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5137-52dd-4969-b64d-1f8380b7efba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.837371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.837979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.838256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.838525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] PATH_INFO: `/v3/projects/0290b58495f5461bb76b62694e8a5806/users/f18ec10891064e63b13a15b4375e4e1a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.843386 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1080/2127] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:43 2022] POST /identity/v3/users => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:43.845681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.864800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0290b58495f5461bb76b62694e8a5806, user_id=f18ec10891064e63b13a15b4375e4e1a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.867560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.870104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aa91c-b4ad-4745-99a3-6408db8ad843 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:43.882085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:43.884578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:43.884578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:43.885006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] PATH_INFO: `/v3/projects/518f128bf91f4e43b906128b568d6b0e/users/b864666d062b4fcb88102e20b18c8d3c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:43.906248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1048/2128] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:43 2022] PUT /identity/v3/projects/0290b58495f5461bb76b62694e8a5806/users/f18ec10891064e63b13a15b4375e4e1a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:43.906248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:43.924960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=518f128bf91f4e43b906128b568d6b0e, user_id=b864666d062b4fcb88102e20b18c8d3c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:43.931341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:43.975733 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1081/2129] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:43 2022] PUT /identity/v3/projects/518f128bf91f4e43b906128b568d6b0e/users/b864666d062b4fcb88102e20b18c8d3c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:43.975733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.052363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61187a52-7ed7-414a-b547-aa05748a8b99 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.123312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:44.149046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.149480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7165b-6536-4872-9e9c-131b77df3a8d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.150064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.152506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.152879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.154522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.157456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.165745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.167115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.168824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.169835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.171502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.174985 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1049/2130] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:44.174985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.175599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf7d7-119d-447b-8bce-ff182c6f983a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.181697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:44.197297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e36f9-bb7c-41ce-b3e5-a3097ff37a2c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.205859 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1082/2131] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:44.207724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.208093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.208466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.210239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.211214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.211895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.212538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.214330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.218864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.247501 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1050/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:44.250695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] MFA Rules not processed for user `b864666d062b4fcb88102e20b18c8d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:44.250896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.252603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:44.275555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c709e-e1c7-4fad-809b-324d014e53da admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.287044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.289502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.290025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.290769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] PATH_INFO: `/v3/projects/0c26790736944a24b352356ebdcedd68/users/5bd1a142444f4e8e871a6e9ec8f6816c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.357805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c26790736944a24b352356ebdcedd68, user_id=5bd1a142444f4e8e871a6e9ec8f6816c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.364625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.392850 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1051/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:44 2022] PUT /identity/v3/projects/0c26790736944a24b352356ebdcedd68/users/5bd1a142444f4e8e871a6e9ec8f6816c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:44.393907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.409106 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1083/2134] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:44.409106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.422129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c40fdd-2d8f-4f8e-9e5a-92e48dfc9fb3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.477559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf481d-8125-4ebc-9106-574a032d9a30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.484959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.485692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.486144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.486803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] PATH_INFO: `/v3/projects/138876cdd0c44931add20b11b11f8667/users/f51e685e7c324cb49467816015c10a81/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.507289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138876cdd0c44931add20b11b11f8667, user_id=f51e685e7c324cb49467816015c10a81, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.510149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.511277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7586f-75f4-4b4f-a746-1c4cc8aeaa89 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.511898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.512259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.513191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] PATH_INFO: `/v3/projects/0290b58495f5461bb76b62694e8a5806/users/f18ec10891064e63b13a15b4375e4e1a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.515925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0290b58495f5461bb76b62694e8a5806, user_id=f18ec10891064e63b13a15b4375e4e1a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.520423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.535223 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1052/2135] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:44 2022] PUT /identity/v3/projects/138876cdd0c44931add20b11b11f8667/users/f51e685e7c324cb49467816015c10a81/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:44.536667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.546573 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1084/2136] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:44 2022] PUT /identity/v3/projects/0290b58495f5461bb76b62694e8a5806/users/f18ec10891064e63b13a15b4375e4e1a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:44.546771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.546871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.546961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.580449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] MFA Rules not processed for user `5bd1a142444f4e8e871a6e9ec8f6816c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:44.581990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:44.674119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1053/2137] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:44.675360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.681597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4ebe6-cdf4-411b-b1e9-bbfd8aed33dd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.690297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d005b-0120-4088-b949-5a0b6fa712a7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.693956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.694775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.695057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.695328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.696129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.698088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.703162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.704125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.704874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.705358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.706147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.708166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689d65-18f2-4aab-bf3a-1118653ff568 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.735402 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1054/2138] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:44.736371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1085/2139] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/projects => generated 411 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:44.736729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.737040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.737602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.741051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.746654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:44.782717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] MFA Rules not processed for user `f18ec10891064e63b13a15b4375e4e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:44.784605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:44.815147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:44.826873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8fa2-92be-4b76-97d6-c2864d7f0edd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.839245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.839868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.840145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.840412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.841116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.843720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.880000 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1086/2140] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:44.880918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.900129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1055/2141] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:44.901337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.914042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f6929-d18b-4503-987b-c1585aef6d4b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.967576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a7a5-13c2-48b6-90ca-f854a156dcf9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:44.972777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.973610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.973892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.974165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] PATH_INFO: `/v3/projects/138876cdd0c44931add20b11b11f8667/users/f51e685e7c324cb49467816015c10a81/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.976770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138876cdd0c44931add20b11b11f8667, user_id=f51e685e7c324cb49467816015c10a81, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:44.980045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:44.993070 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1087/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:44 2022] PUT /identity/v3/projects/138876cdd0c44931add20b11b11f8667/users/f51e685e7c324cb49467816015c10a81/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:44.994609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:44.995100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:44.995928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:44.996316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:44.996769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:44.998574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.000968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.046555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1056/2143] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/users => generated 312 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:45.047520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.061566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8a7d-1faa-4f9f-90cc-292c2b21f970 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.092113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42462d-7394-4b04-b7ad-827fb65cb4d2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.099673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.101310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.101692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.102080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.103057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.105732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67678c-3ff8-4f94-a9d1-4e6ddd849c52 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.137011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1088/2144] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:44 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:45.138872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.139351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.139707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.142033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.142663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.142948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.144257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.145046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.147655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.190566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:45.203905 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1057/2145] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:45 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:45.203905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.213559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] MFA Rules not processed for user `f51e685e7c324cb49467816015c10a81`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:45.221316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.258184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:45.310342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3a1e-2fdb-4505-8a16-f350eee9fb19 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.315700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.316606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.316955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.317312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.318058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.319860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.351362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1058/2146] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:45.352756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.357676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1089/2147] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:45 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:45.358802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.373892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ae79-b9c7-4acb-9377-01886595b7a0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.381736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.382555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.382987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.383298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090eb98-ad9e-4fa6-8dbc-e83c993450d3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.383601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.384546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.386861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.394210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.396685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.397615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.398835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.400148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.402490 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1059/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:45.403598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.404892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.423286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e684d3-672d-4e62-8add-0947633baf8b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.437942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.439872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.441420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.441845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] PATH_INFO: `/v3/projects/5be064b42d144d9cac4cb5932e6961ae/users/c613bf289b5f421f84e4dd485d926ef7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.444132 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1090/2149] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:45 2022] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:45.448639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.475176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24c48-5abb-4c6a-ad42-7575973a744e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.483791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be064b42d144d9cac4cb5932e6961ae, user_id=c613bf289b5f421f84e4dd485d926ef7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.490265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.492054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.494372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.494778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.498516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] PATH_INFO: `/v3/users/9ee0658218264881bdc0e2a872c5011b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.500427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee0658218264881bdc0e2a872c5011b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.503351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.519525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1060/2150] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:45 2022] PUT /identity/v3/projects/5be064b42d144d9cac4cb5932e6961ae/users/c613bf289b5f421f84e4dd485d926ef7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:45.525078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.633022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee0658218264881bdc0e2a872c5011b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:45.641760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee0658218264881bdc0e2a872c5011b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:45.654140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee0658218264881bdc0e2a872c5011b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:45.665791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee0658218264881bdc0e2a872c5011b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:45.666689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee0658218264881bdc0e2a872c5011b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:45.668617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892ffa4-ebf2-471d-b9cc-c065cae068cf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.676819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.677566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.677848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.678438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] PATH_INFO: `/v3/projects/97acb6301e8341418b33acbd496b43a0/users/3bc4488453bd4b339f18c36ed08cfd77/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.696189 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1091/2151] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:45 2022] DELETE /identity/v3/users/9ee0658218264881bdc0e2a872c5011b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:45.697386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.699190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.705680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97acb6301e8341418b33acbd496b43a0, user_id=3bc4488453bd4b339f18c36ed08cfd77, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.708412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.726199 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1061/2152] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:45 2022] PUT /identity/v3/projects/97acb6301e8341418b33acbd496b43a0/users/3bc4488453bd4b339f18c36ed08cfd77/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:45.729260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.729627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.760878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:45.778872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14890f-81ee-4004-876f-c34b47bc7566 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.815137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564ef1-4c3c-4c94-ab02-d5f519959fd0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.821270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.822150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.822801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.823545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.823846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.826153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384abb6f-a454-4310-b3bf-24e0662dc979 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.837413 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1062/2153] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:45.842572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.843062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.843405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.850236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.851022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.851347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.851753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.852402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.854067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.863873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:45.865446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.869146 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1092/2154] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:45.869146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.874495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.879705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1063/2155] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:45.880756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.897769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:45.898522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503bde2-014c-4745-9930-3cb63c68dad9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.907126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.908137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.908418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.909003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.909682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.911325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.916051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848406a1-cba6-4beb-b904-eb154d29cfed None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:45.922638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:45.922866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:45.923212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:45.923582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] PATH_INFO: `/v3/projects/5be064b42d144d9cac4cb5932e6961ae/users/c613bf289b5f421f84e4dd485d926ef7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:45.925651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be064b42d144d9cac4cb5932e6961ae, user_id=c613bf289b5f421f84e4dd485d926ef7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:45.928486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:45.936006 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1093/2156] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:45.936006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.943868 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1064/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:45 2022] PUT /identity/v3/projects/5be064b42d144d9cac4cb5932e6961ae/users/c613bf289b5f421f84e4dd485d926ef7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:45.949865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:45.953090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:45.962771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f043-10fe-4632-8aa4-2f3507ee5b2b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:46.054093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511839-61e1-4e61-8406-f1ad64ab5658 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:46.062696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:46.064350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.064838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.065419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.066569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:46.068443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:46.069095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.069372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.069479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:46.069672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.082922 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1094/2158] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:46.084557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:46.089500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:46.092089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8bfbb-6481-4f50-b408-8442d8868df4 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:46.116439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb22-a6cc-4690-82d4-b9656e9d079b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:46.117949 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1065/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:46.133031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8685d0-6408-49d3-93ae-9c53562f5c66 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.133593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8685d0-6408-49d3-93ae-9c53562f5c66 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.133970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8685d0-6408-49d3-93ae-9c53562f5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.155198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:46.156515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.157596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.158915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] PATH_INFO: `/v3/projects/97acb6301e8341418b33acbd496b43a0/users/3bc4488453bd4b339f18c36ed08cfd77/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.169333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97acb6301e8341418b33acbd496b43a0, user_id=3bc4488453bd4b339f18c36ed08cfd77, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:46.179330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:46.188520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0d8685d0-6408-49d3-93ae-9c53562f5c66 None None] MFA Rules not processed for user `c613bf289b5f421f84e4dd485d926ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:46.190373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0d8685d0-6408-49d3-93ae-9c53562f5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:46.225000 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1095/2160] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:46 2022] PUT /identity/v3/projects/97acb6301e8341418b33acbd496b43a0/users/3bc4488453bd4b339f18c36ed08cfd77/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:46.225000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:46.353130 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1066/2161] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:46.356982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.366157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.366696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.373954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716a88-3f7b-499d-84fc-50ccc97d14fd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:46.389498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:46.390274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.390552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.390915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] PATH_INFO: `/v3/projects/8147473bf7ed4b89bbdc689dbea7f248/users/5e6dacfa15ed4a15895725c6827e01f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.411820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] MFA Rules not processed for user `a7e06c8681bd48ce9422147f306cd27c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:46.413342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:46.456184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:46.464984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147473bf7ed4b89bbdc689dbea7f248, user_id=5e6dacfa15ed4a15895725c6827e01f6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:46.473226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5c52-b273-4df2-b8b4-eda6bfe57486 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:46.513051 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1096/2162] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:46 2022] PUT /identity/v3/projects/8147473bf7ed4b89bbdc689dbea7f248/users/5e6dacfa15ed4a15895725c6827e01f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:46.514478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4693-0248-4342-ab00-b42afa6ff4df None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.514759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4693-0248-4342-ab00-b42afa6ff4df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.515027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4693-0248-4342-ab00-b42afa6ff4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.577296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-325e4693-0248-4342-ab00-b42afa6ff4df None None] MFA Rules not processed for user `3bc4488453bd4b339f18c36ed08cfd77`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:46.578895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-325e4693-0248-4342-ab00-b42afa6ff4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:46.611446 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1067/2163] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:46.612243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:46.613896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:46.638006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:46.764445 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1097/2164] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:46.767366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d2a6-6848-4409-89c4-d5ca053feba6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:46.770212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.770607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.771457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.816796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] MFA Rules not processed for user `5e6dacfa15ed4a15895725c6827e01f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:46.817930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:46.856992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:46.858458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:46.859050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:46.859465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:46.947405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:46.949837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:46.983064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1068/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:46.985007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:46.988206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:47.011005 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1098/2166] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:47.012030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:47.018078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:47.022602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaf7e4-0353-4d00-8ae4-8299df2ff5db service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:47.031362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:47.031987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:47.032266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:47.032540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:47.126542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:47.172402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf20a1-87bc-467c-8617-b3029a86f608 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:47.177918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:47.179029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:47.179029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:47.179427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] PATH_INFO: `/v3/projects/85488fa9eb84479b8a3f3f31f498471d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:47.180832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85488fa9eb84479b8a3f3f31f498471d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:47.182922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:47.186240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:47.188448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:47.192660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:47.219783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1069/2167] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:47.269704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85488fa9eb84479b8a3f3f31f498471d', 'request_id': 'req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.304578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85488fa9eb84479b8a3f3f31f498471d', 'request_id': 'req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.323656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85488fa9eb84479b8a3f3f31f498471d', 'request_id': 'req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.355053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] The token cache is being invalidate because project 85488fa9eb84479b8a3f3f31f498471d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:47.355559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.357407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.363841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1099/2168] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:47 2022] DELETE /identity/v3/projects/85488fa9eb84479b8a3f3f31f498471d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:47.366610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:47.401638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6edd-53d4-4b76-9ad2-1be3dc3db884 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:47.589741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:47.604514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:47.650227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:47.650992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:47.651189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:47.651459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] PATH_INFO: `/v3/users/f51e685e7c324cb49467816015c10a81` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:47.652682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51e685e7c324cb49467816015c10a81)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:47.655521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:47.724655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51e685e7c324cb49467816015c10a81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.725412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51e685e7c324cb49467816015c10a81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.727511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51e685e7c324cb49467816015c10a81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.741868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51e685e7c324cb49467816015c10a81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.754725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51e685e7c324cb49467816015c10a81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:47.785577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1070/2169] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:47 2022] DELETE /identity/v3/users/f51e685e7c324cb49467816015c10a81 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:47.786707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:47.789304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:47.834448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6dc87-2276-4bad-8cf6-f5bf3aaead26 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:47.962980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:48.000800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.001401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.001684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.001945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] PATH_INFO: `/v3/users/5bd1a142444f4e8e871a6e9ec8f6816c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.007846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd1a142444f4e8e871a6e9ec8f6816c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.010513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.011303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fb6b-22db-4bda-886a-d2461c5f4c76 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.021271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.021694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.022103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.022382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.028634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.118230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:48.120853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd1a142444f4e8e871a6e9ec8f6816c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.121556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd1a142444f4e8e871a6e9ec8f6816c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.132107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd1a142444f4e8e871a6e9ec8f6816c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.151258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd1a142444f4e8e871a6e9ec8f6816c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.152000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd1a142444f4e8e871a6e9ec8f6816c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.164837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.165917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0ded-f9c0-416d-be21-cdb5c005cf57 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.184134 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1100/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:47 2022] DELETE /identity/v3/users/5bd1a142444f4e8e871a6e9ec8f6816c => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:48.185878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:48.189016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.195383 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1071/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:48.196747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.197046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.197321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.248834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:48.250171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.357614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ddc5a-603f-4719-bc81-8a79a760c41e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.366119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.366971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.368106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.368562 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1072/2172] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:48.372970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.376649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.388279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:48.390797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.548514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.553170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.567579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886441e8-6d01-48a9-8e8f-fbd09ab23883 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.576585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.579517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.580221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.580981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.585533 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1101/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:48.587974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:48.589741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.604503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.609562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.610798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0789c8e-bb5d-453a-80be-9d5f6b062f4a service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.616627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.617958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.618480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.620286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] PATH_INFO: `/v3/projects/138876cdd0c44931add20b11b11f8667` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.635975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=138876cdd0c44931add20b11b11f8667)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.640583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.655108 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1073/2174] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:48.656136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:48.659285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.676056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097badd-c7c3-4185-a296-fe85dae65ff2 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.681536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.682232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.682620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.682891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] PATH_INFO: `/v3/users/c51c5ce38b094206af7763c4a802a6b5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.684023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51c5ce38b094206af7763c4a802a6b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.687112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.726390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:48.727927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138876cdd0c44931add20b11b11f8667', 'request_id': 'req-601260b0-3900-4d6e-b308-7085824067ca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.739543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138876cdd0c44931add20b11b11f8667', 'request_id': 'req-601260b0-3900-4d6e-b308-7085824067ca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.740883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:48.758375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138876cdd0c44931add20b11b11f8667', 'request_id': 'req-601260b0-3900-4d6e-b308-7085824067ca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.779492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] The token cache is being invalidate because project 138876cdd0c44931add20b11b11f8667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:48.779728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51c5ce38b094206af7763c4a802a6b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.779826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.780498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-601260b0-3900-4d6e-b308-7085824067ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.780612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51c5ce38b094206af7763c4a802a6b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.781367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51c5ce38b094206af7763c4a802a6b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.786353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1102/2175] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:48 2022] DELETE /identity/v3/projects/138876cdd0c44931add20b11b11f8667 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:48.791883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f7e5-0e06-4e21-a8c2-469ec02e6441 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.792376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f7e5-0e06-4e21-a8c2-469ec02e6441 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.792659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f7e5-0e06-4e21-a8c2-469ec02e6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.797936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51c5ce38b094206af7763c4a802a6b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.808746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51c5ce38b094206af7763c4a802a6b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:48.827409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5274f7e5-0e06-4e21-a8c2-469ec02e6441 None None] MFA Rules not processed for user `a7e06c8681bd48ce9422147f306cd27c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:48.828822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5274f7e5-0e06-4e21-a8c2-469ec02e6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.830948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1074/2176] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:48 2022] DELETE /identity/v3/users/c51c5ce38b094206af7763c4a802a6b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:48.831807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:48.833343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:48.947705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1103/2177] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:48.951073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a39ef-ebdb-47be-acc6-86c9ad644475 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.951550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a39ef-ebdb-47be-acc6-86c9ad644475 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.951959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a39ef-ebdb-47be-acc6-86c9ad644475 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.954127 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1104/2178] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:48.955726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.956286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.956811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.960744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b053e-c5a0-4676-ad0f-effcb32a303f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:48.967937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:48.969132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:48.969132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:48.969546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] PATH_INFO: `/v3/users/b864666d062b4fcb88102e20b18c8d3c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:48.971237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b864666d062b4fcb88102e20b18c8d3c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:48.975433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:48.988635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:48.991482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.002466 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1105/2179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:49.004177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:49.005642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.052777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b864666d062b4fcb88102e20b18c8d3c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.054132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b864666d062b4fcb88102e20b18c8d3c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.054765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b864666d062b4fcb88102e20b18c8d3c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.066637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b864666d062b4fcb88102e20b18c8d3c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.113398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5cce11c-e1fb-4716-9644-cab15717798e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b864666d062b4fcb88102e20b18c8d3c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.160647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.162702 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1075/2180] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:48 2022] DELETE /identity/v3/users/b864666d062b4fcb88102e20b18c8d3c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:49.163758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.164478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6334-4000-499c-9d9a-c2c628da8e90 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.164842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6334-4000-499c-9d9a-c2c628da8e90 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.165146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6334-4000-499c-9d9a-c2c628da8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.194342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f09b6334-4000-499c-9d9a-c2c628da8e90 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:49.195810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f09b6334-4000-499c-9d9a-c2c628da8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.245168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:49.311491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8132-2f8b-4935-aa28-71ef2597ea56 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:49.317548 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1076/2181] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:49.322909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.323177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.323450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.340985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:49.353567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:49.355991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.368989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1077/2182] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:49.370330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.382458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6e0d-d761-45d0-9e2e-419abbbf340c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:49.388946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:49.390373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.392185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.392621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.393705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:49.394208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:49.396238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:49.444375 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1078/2183] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:49.445445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.460507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.468650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:49.469612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.469988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.471111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.474414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:49.478325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:49.484707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d19d-6712-4f4e-a04f-30a4875d0b30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:49.486398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1106/2184] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:49 2022] GET /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 391 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:49.487565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.492220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.499868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:49.500828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.501888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.502299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] PATH_INFO: `/v3/projects/6dec85a2d8bd441a97411aab99f13107` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.519629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dec85a2d8bd441a97411aab99f13107)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:49.528853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:49.661067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dec85a2d8bd441a97411aab99f13107', 'request_id': 'req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.670170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dec85a2d8bd441a97411aab99f13107', 'request_id': 'req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.682757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dec85a2d8bd441a97411aab99f13107', 'request_id': 'req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.694101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4f9f-d778-421f-8f34-0d9fafb4299b tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:49.700661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] The token cache is being invalidate because project 6dec85a2d8bd441a97411aab99f13107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:49.701913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.702927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:49.705465 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1079/2185] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:49 2022] DELETE /identity/v3/projects/6dec85a2d8bd441a97411aab99f13107 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:49.708339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.710460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.806217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:49.807235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.807726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.808229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.815110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.854378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203be02-9a7f-4e4b-a219-0d9a6e93ec86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:49.865437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:49.866207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:49.866590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:49.866953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:49.870078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:49.874605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:49.943443 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1080/2186] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:49 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:49.946877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.948830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:49.957450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:49.959127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:49.987286 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1107/2187] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:49.991269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:49.996805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.016709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:50.029295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b014c-df8f-493c-bedf-35b096119961 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:50.068867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:50.147408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabc67-fe10-456c-b637-60cb4b298492 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:50.161981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:50.162866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.163517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.163893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] PATH_INFO: `/v3/projects/0c26790736944a24b352356ebdcedd68` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.165650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:50.165926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c26790736944a24b352356ebdcedd68)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:50.167330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.168002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.169933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:50.170691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] PATH_INFO: `/v3/users/3da3b86433644508b3bd3aabb0576f93` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.172406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da3b86433644508b3bd3aabb0576f93)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:50.175252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:50.337325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c26790736944a24b352356ebdcedd68', 'request_id': 'req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.342405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da3b86433644508b3bd3aabb0576f93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.346003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da3b86433644508b3bd3aabb0576f93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.362387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da3b86433644508b3bd3aabb0576f93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.363593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c26790736944a24b352356ebdcedd68', 'request_id': 'req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.380975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c26790736944a24b352356ebdcedd68', 'request_id': 'req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.395312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da3b86433644508b3bd3aabb0576f93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.397079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3ab61c54-80d6-4c58-86da-facf156c5c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da3b86433644508b3bd3aabb0576f93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.407762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] The token cache is being invalidate because project 0c26790736944a24b352356ebdcedd68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:50.408181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.410648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.413573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1081/2188] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:49 2022] DELETE /identity/v3/projects/0c26790736944a24b352356ebdcedd68 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:50.414877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:50.424233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.457748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1108/2189] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:49 2022] DELETE /identity/v3/users/3da3b86433644508b3bd3aabb0576f93 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:50.457748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e34e3-dcd1-4e9c-8a91-852093082417 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.457748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e34e3-dcd1-4e9c-8a91-852093082417 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.457748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e34e3-dcd1-4e9c-8a91-852093082417 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.459194 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1109/2190] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:50.461466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.462047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.462415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.520115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] MFA Rules not processed for user `9dc12014773b4f9fb34ff214c07d7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:50.521691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.567618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff2e3-69ba-4319-a8f5-ed85fb025f02 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:50.638033 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1110/2191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:50.639105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:50.641177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.703885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:50.719528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:50.726838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.727076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.727541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:50.727907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.731988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:50.734835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:50.776484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1082/2192] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:50 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:50.777720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:50.781033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.794832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ecb6e-b704-42df-8058-63e7d8e2d80f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:50.811334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:50.812529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:50.812955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:50.813333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] PATH_INFO: `/v3/users/3bc4488453bd4b339f18c36ed08cfd77` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:50.817143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc4488453bd4b339f18c36ed08cfd77)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:50.819905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:50.898443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc4488453bd4b339f18c36ed08cfd77'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.899761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc4488453bd4b339f18c36ed08cfd77'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.911185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc4488453bd4b339f18c36ed08cfd77'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.920971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc4488453bd4b339f18c36ed08cfd77'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.921995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc4488453bd4b339f18c36ed08cfd77'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:50.925940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:50.929487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:50.953076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1111/2193] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:50 2022] DELETE /identity/v3/users/3bc4488453bd4b339f18c36ed08cfd77 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:50.953978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:50.955820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.031661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93ddf-04b3-4797-9e6a-c079d715de8e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.060874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca4b9-c8ec-4ab9-b1fd-0479ebc022b1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.074698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.075486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.075616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.075868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] PATH_INFO: `/v3/projects/518f128bf91f4e43b906128b568d6b0e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.082261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=518f128bf91f4e43b906128b568d6b0e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.084739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.128349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.129189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.129564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.130096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.141719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.146632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.151525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1083/2194] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:50 2022] GET /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 391 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:51.152290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.158945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.173860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518f128bf91f4e43b906128b568d6b0e', 'request_id': 'req-b89e06b6-5d41-4072-950d-70dc54b1e99d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.174974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a3329-ca11-4507-8c7d-a95ca9a481f4 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.184384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518f128bf91f4e43b906128b568d6b0e', 'request_id': 'req-b89e06b6-5d41-4072-950d-70dc54b1e99d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.196782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518f128bf91f4e43b906128b568d6b0e', 'request_id': 'req-b89e06b6-5d41-4072-950d-70dc54b1e99d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.216883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:51.229569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] The token cache is being invalidate because project 518f128bf91f4e43b906128b568d6b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:51.230003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.230675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.237645 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1112/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:50 2022] DELETE /identity/v3/projects/518f128bf91f4e43b906128b568d6b0e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:51.237645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.239283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.249395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:51.338214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.339683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.340509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.340883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] PATH_INFO: `/v3/projects/6dfe39f46673435e99b56ac055fd12ab` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.343611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfe39f46673435e99b56ac055fd12ab)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.347891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.361723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e06b6-5d41-4072-950d-70dc54b1e99d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.368200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.369355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.370161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.371264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.373091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.375626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8ab7b-7067-4379-87aa-869182011a53 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.389221 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1113/2196] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:51.391311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805420b-a429-4df7-83cc-68d3330fb12c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.391807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805420b-a429-4df7-83cc-68d3330fb12c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.392550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805420b-a429-4df7-83cc-68d3330fb12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.420797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8805420b-a429-4df7-83cc-68d3330fb12c None None] MFA Rules not processed for user `a60610c78b5844f78f3ac3a7d421df53`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:51.422073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8805420b-a429-4df7-83cc-68d3330fb12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.432580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfe39f46673435e99b56ac055fd12ab', 'request_id': 'req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.458354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfe39f46673435e99b56ac055fd12ab', 'request_id': 'req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.473236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfe39f46673435e99b56ac055fd12ab', 'request_id': 'req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.499006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] The token cache is being invalidate because project 6dfe39f46673435e99b56ac055fd12ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:51.499304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.502960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.506855 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1084/2197] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:51 2022] DELETE /identity/v3/projects/6dfe39f46673435e99b56ac055fd12ab => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:51.510431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.512148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.544988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1114/2198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:51.551382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.551827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.554338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.556314 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1115/2199] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:51.557596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.564353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.675251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02b5a0-fc99-4e01-aa0a-1dad7fe389a4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.683074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.684594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.686303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.686790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] PATH_INFO: `/v3/users/c613bf289b5f421f84e4dd485d926ef7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.688106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c613bf289b5f421f84e4dd485d926ef7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.691213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.699496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298eab7-8e7d-4ee1-b321-b8cb57f80000 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.707668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.708375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.708740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.709162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.709877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.711559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3710b4-0893-4dd6-89e1-046fd1044d16 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.730813 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1116/2200] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:51.734781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.735548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.736052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.759557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c613bf289b5f421f84e4dd485d926ef7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.760478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c613bf289b5f421f84e4dd485d926ef7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.761006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c613bf289b5f421f84e4dd485d926ef7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.772515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c613bf289b5f421f84e4dd485d926ef7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.779433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:51.780942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.791990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:51.795323 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1117/2201] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:51.796952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c613bf289b5f421f84e4dd485d926ef7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:51.804103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.806678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.823365 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1085/2202] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:51 2022] DELETE /identity/v3/users/c613bf289b5f421f84e4dd485d926ef7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:51.823365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:51.823365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:51.835988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fb0cb-3c9c-4176-8047-e48fa12dfa8c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:51.893001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:51.948385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:51.951162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:51.951454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:51.951726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] PATH_INFO: `/v3/projects/97acb6301e8341418b33acbd496b43a0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:51.953389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97acb6301e8341418b33acbd496b43a0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:51.957253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:51.995700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:51.997275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.080284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97acb6301e8341418b33acbd496b43a0', 'request_id': 'req-9d9eea37-49b0-4770-8519-0e4a0478b410'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:52.088871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97acb6301e8341418b33acbd496b43a0', 'request_id': 'req-9d9eea37-49b0-4770-8519-0e4a0478b410'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:52.101520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97acb6301e8341418b33acbd496b43a0', 'request_id': 'req-9d9eea37-49b0-4770-8519-0e4a0478b410'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:52.111290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66aa28-3940-4765-9cb7-28a9ee112d1b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.133248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] The token cache is being invalidate because project 97acb6301e8341418b33acbd496b43a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:52.133442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:52.134735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:52.136297 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1118/2203] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:51 2022] DELETE /identity/v3/projects/97acb6301e8341418b33acbd496b43a0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:52.138295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:52.142154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.269242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.270011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.270359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.270584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.272271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.277236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eea37-49b0-4770-8519-0e4a0478b410 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.278317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1677d-30c3-4a35-904a-76f761bb933f tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.280092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1086/2204] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:51 2022] GET /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 391 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:52.283824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90fcc-83b7-460e-aede-90c9f4d4cd0e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.284135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90fcc-83b7-460e-aede-90c9f4d4cd0e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.284575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90fcc-83b7-460e-aede-90c9f4d4cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.289975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.292110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.292647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.294268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] PATH_INFO: `/v3/projects/3ce2480a829d442c8b55476ffa5d3ba3/users/863b399a02b24f68acfbf4575cc3d257/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.318891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce2480a829d442c8b55476ffa5d3ba3, user_id=863b399a02b24f68acfbf4575cc3d257, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.321981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.327336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5bd90fcc-83b7-460e-aede-90c9f4d4cd0e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:52.328824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5bd90fcc-83b7-460e-aede-90c9f4d4cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.340222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1087/2205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:52.341993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.342520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.342890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.364957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1119/2206] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:52 2022] PUT /identity/v3/projects/3ce2480a829d442c8b55476ffa5d3ba3/users/863b399a02b24f68acfbf4575cc3d257/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:52.364957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:52.380792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:52.384075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.400697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:52.433917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:52.471355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dde754-71a1-468e-93f7-362f40d73d76 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.478918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.479523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.479809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.480075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.480737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:52.481100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.483046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f14b29-8d99-4d12-a263-fc08de7dfb98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.506021 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1120/2207] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:52.506021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.506021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.506021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.568530 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1088/2208] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:52.568530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:52.598427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:52.601741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.602743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131faa7-bd40-4fc3-8e13-dd1e2067e957 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.610799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.611537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.611872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.612205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.612931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.615028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35e10-e63e-4b46-ac55-dffb973cf6e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.664956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1089/2209] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:52.667559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.669326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.687599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.746801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:52.749031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:52.779410 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1121/2210] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:52.783847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:52.813788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3fb4-8912-42d9-89d4-fc5253d623cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.909624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1090/2211] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:52.910530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:52.940216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e7b71-b5da-4870-b087-cd205714c869 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:52.956204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.957250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:52.957415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.957865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:52.958143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.958267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:52.958452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.958722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:52.959038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.961011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.961220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:52.966661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:52.998345 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1122/2212] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:52.998345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.000947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.019791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea4329-77cc-4c15-aeea-83262233c1e2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.027231 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1091/2213] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:53.027758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.029380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.029997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.030602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] PATH_INFO: `/v3/projects/5be064b42d144d9cac4cb5932e6961ae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.031017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.032278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be064b42d144d9cac4cb5932e6961ae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.034945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.126368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e909a7-327a-4c6b-a21f-2335276bb0f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.130029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be064b42d144d9cac4cb5932e6961ae', 'request_id': 'req-c9e619a5-dc81-452b-9d98-83f0492ae21a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:53.131566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:53.140754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be064b42d144d9cac4cb5932e6961ae', 'request_id': 'req-c9e619a5-dc81-452b-9d98-83f0492ae21a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:53.154016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:53.155620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be064b42d144d9cac4cb5932e6961ae', 'request_id': 'req-c9e619a5-dc81-452b-9d98-83f0492ae21a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:53.174510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] The token cache is being invalidate because project 5be064b42d144d9cac4cb5932e6961ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:53.175560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:53.175844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:53.179349 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1123/2214] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:52 2022] DELETE /identity/v3/projects/5be064b42d144d9cac4cb5932e6961ae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:53.179349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.182692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.214889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.216230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.216567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.216836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.218278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:53.218599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.222093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.243347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1092/2215] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:53.243347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.246481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.263583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f75d5-c44b-46b9-a774-a575d8e44a3b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.271220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.272341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.272993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.273568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.275019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.279583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000612ed-d361-494f-a52c-000bd42cd31a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.283668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e619a5-dc81-452b-9d98-83f0492ae21a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.289103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.289850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.290126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.290542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.291393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.293437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.313063 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1124/2216] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:53.313063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.316064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.340143 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1093/2217] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:53 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:53.340143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.340143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.340143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.398135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:53.404722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.428206 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1094/2218] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:53.429797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.432541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.458413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531102-d33d-4491-a584-31f12b91fbdc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.465312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.466503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.466780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.467047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.467692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.469686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.515257 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1095/2219] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:53 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:53.517813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.523570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdc38-5a62-4a8a-a330-339efae7eebb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.638683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.643274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.643452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.643762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.646560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.660562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:53.667590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9267701-621b-4bde-972d-600681f09a55 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.693791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.695468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.695468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.695750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.697070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.698953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.717913 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1096/2220] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:53.719680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.733668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a42e0-1926-45da-9ab3-ff42fafd8779 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.738801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.739581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.739745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.740021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.741654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.743475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75165d38-f9b1-487a-8101-ba800f56997b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.744216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.746431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.756669 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1097/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:53.759666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.759951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.760220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.770175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1125/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:53.771614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.805322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6d59-879f-4b83-ab56-de81f22c2f5c service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.816330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:53.818108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.819898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:53.820021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.820319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.821030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.821687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.829342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.864781 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1098/2223] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:53.866467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.884025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d70e3-1b5f-40e1-ad8e-28c28af7691b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.887164 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1126/2224] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:53 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:53.888943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.899109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.899738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.900009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.900325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] PATH_INFO: `/v3/projects/38bd1e9a411e49c0b6c13914f4b53caf/users/d76e0eb51a9b418bb28e81b5ac1520f9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.913597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1c79-cffc-4651-995f-86f040143b72 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:53.926887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:53.927566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:53.930983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:53.930983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] PATH_INFO: `/v3/projects/482e40829f6e48d198f53d0033dd3bfa/users/55168691c9ff4d8c92294a3eaf1f3160/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:53.939581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bd1e9a411e49c0b6c13914f4b53caf, user_id=d76e0eb51a9b418bb28e81b5ac1520f9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.942669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:53.969198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482e40829f6e48d198f53d0033dd3bfa, user_id=55168691c9ff4d8c92294a3eaf1f3160, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:53.978641 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1099/2225] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:53 2022] PUT /identity/v3/projects/38bd1e9a411e49c0b6c13914f4b53caf/users/d76e0eb51a9b418bb28e81b5ac1520f9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:53.979323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:53.988320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.008700 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1127/2226] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:53 2022] PUT /identity/v3/projects/482e40829f6e48d198f53d0033dd3bfa/users/55168691c9ff4d8c92294a3eaf1f3160/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:54.008700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.041547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:54.095647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af307c-6fd2-4416-aaf3-980baca25f12 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.105422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.105422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.105422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.105422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.105859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.107364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2c952-feb8-4b2f-940c-9c1fca5048c6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.126398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1128/2227] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:54.126398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.126398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.126398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.145981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7db-84dd-4c09-bd7f-41c44a2870ad admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.151156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:54.153009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:54.158937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.161441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.161722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.161999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.166975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:54.167273 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1129/2228] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:54.167360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.167478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.170591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.180435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4790ee-f5d6-4fc6-85f6-d69ab0f7ac15 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.189283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.190330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.190872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.191573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.192773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.194727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.210625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1100/2229] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:54.214260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1130/2230] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:54.214420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.214504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.215159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:54.234647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde7772-0a5e-4885-8ed5-d9ae701e05d7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.246616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.247818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.248095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.248359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.249036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.250637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.274892 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1101/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:54.276138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.301047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2856d0-7ce6-4886-ba43-7cc6d01d0f60 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.344147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:54.354001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.365004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.365004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.365318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.368087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.368261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6825af-df0c-41d2-b27a-537a43942b88 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.373121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.378731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.380028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.381271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.382443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.409293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.411304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.439196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1102/2232] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:54 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:54.441064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.452606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1131/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:54.465410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.484637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25b04-3863-466c-986e-32faa16d94c5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.582678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bdfe-d754-489c-ac40-abb156ae371e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.591290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.592078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.592368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.592640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] PATH_INFO: `/v3/projects/482e40829f6e48d198f53d0033dd3bfa/users/55168691c9ff4d8c92294a3eaf1f3160/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.596354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482e40829f6e48d198f53d0033dd3bfa, user_id=55168691c9ff4d8c92294a3eaf1f3160, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.600492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e4c2-0fc8-4c08-80cc-0929f0603509 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.619853 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1103/2234] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:54 2022] PUT /identity/v3/projects/482e40829f6e48d198f53d0033dd3bfa/users/55168691c9ff4d8c92294a3eaf1f3160/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:54.622435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3348c-0ee1-4575-9c0f-e1e8a90f2460 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.622728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3348c-0ee1-4575-9c0f-e1e8a90f2460 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.623158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3348c-0ee1-4575-9c0f-e1e8a90f2460 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.634396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1104/2235] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:54.635423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3348c-0ee1-4575-9c0f-e1e8a90f2460 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.649338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:54.651032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:54.651553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:54.652041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] PATH_INFO: `/v3/projects/f437c603a24348a0a9816a917502b7c4/users/6428f9389f3c4018950d752d582eef46/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:54.685298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f437c603a24348a0a9816a917502b7c4, user_id=6428f9389f3c4018950d752d582eef46, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:54.696509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:54.739352 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1132/2236] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:54 2022] PUT /identity/v3/projects/f437c603a24348a0a9816a917502b7c4/users/6428f9389f3c4018950d752d582eef46/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:54.740870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:54.909633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3348c-0ee1-4575-9c0f-e1e8a90f2460 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:54.913211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:54.919481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:54.945526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:55.031222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:55.032127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.032510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.032879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.035434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:55.040393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ae26-29f0-45de-bc37-0f9aafb7c810 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:55.104725 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1105/2237] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:54 2022] POST /identity/v3/users => generated 287 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:55.110996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.111380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.111733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.178149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220da2-edbb-47e2-a297-47504e271f6b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:55.211232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:55.215812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.216390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.216686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.220048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] MFA Rules not processed for user `55168691c9ff4d8c92294a3eaf1f3160`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:55.220652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:55.223252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282861bb-e493-47c2-bdd3-4bf8b49d1fda tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:55.223443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:55.237784 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1133/2238] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:54 2022] GET /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 391 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:55.239846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbb9eb-6ac8-4770-a714-b0d587d81d27 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.240678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbb9eb-6ac8-4770-a714-b0d587d81d27 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.243714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbb9eb-6ac8-4770-a714-b0d587d81d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.321370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:55.374033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c5cbb9eb-6ac8-4770-a714-b0d587d81d27 None None] MFA Rules not processed for user `6428f9389f3c4018950d752d582eef46`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:55.376439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c5cbb9eb-6ac8-4770-a714-b0d587d81d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:55.527034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1106/2239] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:55.536940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:55.565417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea8d0-068c-4cea-9cab-6e0c6f3c9a06 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:55.578372 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1134/2240] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:55.579190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.579961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.585568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.585785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:55.586339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.586619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.586894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.587560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:55.591321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:55.623069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1107/2241] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:55.623069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:55.637151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:55.638620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:55.639409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb24ce-c344-4bec-98fc-948d5255149d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:55.648701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:55.649737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.650028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.651400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.654032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:55.662603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:55.734615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1108/2242] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:55 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:55.744685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:55.789792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1135/2243] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:55.789792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:55.813397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff27ce-8b42-4eb4-b9ef-36a56354ecf3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:55.973631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d3f6-b8df-4d8b-bbb5-2e0153050952 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:55.994079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:55.995394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:55.995845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:55.996122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:55.996998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:55.999028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba2ac6-3bcc-4c06-b9e9-36ac8ea951f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:56.039675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1109/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:56.041468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea480-8ce5-4f86-b017-5031e09a82e0 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:56.041864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea480-8ce5-4f86-b017-5031e09a82e0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:56.043056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea480-8ce5-4f86-b017-5031e09a82e0 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:56.047559 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1110/2245] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:51:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:56.048639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea480-8ce5-4f86-b017-5031e09a82e0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:56.085455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:56.105140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea480-8ce5-4f86-b017-5031e09a82e0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:56.115972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:56.117780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:56.118328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:56.119139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:56.120460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:56.122211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:56.123110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:56.123578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:56.123858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63/users/46e1419ed74945a1931ee434a1fc9d97/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:56.130209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:56.197078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591c284c04044d2e91aa94035ab6eb63, user_id=46e1419ed74945a1931ee434a1fc9d97, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:56.202954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:56.246683 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1136/2247] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:55 2022] POST /identity/v3/users => generated 302 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:56.248610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:51:56.249830 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1111/2247] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:56 2022] PUT /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63/users/46e1419ed74945a1931ee434a1fc9d97/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:56.254615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:56.256052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:56.369140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:56.551692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38b9a-186f-4073-a353-09f4ff264d04 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:56.576684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:56.577679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:56.578529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:56.585129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:56.585129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:56.585129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:56.585129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79067d-7492-4f7d-99dd-930760da5a4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:56.631133 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1112/2248] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:56.632829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:56.641393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:56.641858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:56.723402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] MFA Rules not processed for user `46e1419ed74945a1931ee434a1fc9d97`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:56.725070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:56.786915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602444d9-0abe-4eb0-96d5-0f70276e4ad6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.019046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1113/2249] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:57.026578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.036623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.039003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.039539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.042256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.048444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.059802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.069139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1137/2250] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:51:56 2022] GET /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 391 bytes in 821 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:57.071693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.078946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038817-34e8-4a53-b4c0-81f1b088c71a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.120877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.125572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.127926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.128450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] PATH_INFO: `/v3/projects/27f356471ca5432db93be461bf8e5672/users/5f24d9362d8f4802a07ff4d51fd2a551/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.151390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6aef-5c6a-4e54-b75a-46858c142981 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.169607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.170640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.175239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.176545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.178877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.187658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.202973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f356471ca5432db93be461bf8e5672, user_id=5f24d9362d8f4802a07ff4d51fd2a551, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.214152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.270644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1114/2251] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:57 2022] PUT /identity/v3/projects/27f356471ca5432db93be461bf8e5672/users/5f24d9362d8f4802a07ff4d51fd2a551/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:57.272537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.317640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1138/2252] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:57 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:57.317640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.432542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:57.506018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0809e-1e10-4002-83c4-6950fdde1e15 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.583027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:57.598751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f780-0d13-4ff6-9e3b-7657d98bc82d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.610447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.611597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.612088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.612567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.614980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.620339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.657147 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1139/2253] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:57.657913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.658847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.664630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.665451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.666075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.678399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:57.688542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b74d8-ad86-4328-be80-36af77b8bc3c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.699548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.701442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.701987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.702452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.703620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.708020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.805896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1140/2254] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:57 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:57.807253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.861868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c49fdc-94c7-488d-a258-75d39d1f1e16 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:57.873116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:57.874266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.874714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.875160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] PATH_INFO: `/v3/projects/27f356471ca5432db93be461bf8e5672/users/5f24d9362d8f4802a07ff4d51fd2a551/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:57.879519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f356471ca5432db93be461bf8e5672, user_id=5f24d9362d8f4802a07ff4d51fd2a551, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.886171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.933840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:57.936251 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1141/2255] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:57 2022] PUT /identity/v3/projects/27f356471ca5432db93be461bf8e5672/users/5f24d9362d8f4802a07ff4d51fd2a551/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:57.941384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b87a-f329-433e-9795-486e8bb0faf1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:57.961434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:57.989214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1115/2256] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:57.992086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:57.992963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:57.996339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.071927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] MFA Rules not processed for user `5f24d9362d8f4802a07ff4d51fd2a551`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:58.087917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:58.227545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276cb3-0951-489c-9a07-18ddd7ca6c03 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:58.242424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:58.243062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:58.243335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:58.243612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.244266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:58.245966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:58.274240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1142/2257] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:58.279743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:58.310402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6a35d-545f-4bbe-b750-db9d0d0399f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:58.354406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:58.355533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:58.356043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:58.357082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] PATH_INFO: `/v3/projects/721c3030a373477dbd5847ba063705ed/users/f6ed2b5096a340bab7b481029b1e07c8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.392538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:58.411988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1116/2258] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:58.430241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721c3030a373477dbd5847ba063705ed, user_id=f6ed2b5096a340bab7b481029b1e07c8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:58.439699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:58.485929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1143/2259] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:58 2022] PUT /identity/v3/projects/721c3030a373477dbd5847ba063705ed/users/f6ed2b5096a340bab7b481029b1e07c8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:58.489229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:58.506049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef9aa-858a-45b0-a202-f7291e98deb1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:58.664234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:58.665336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:58.665823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:58.666308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.667539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:58.671378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ba74-86e2-41eb-acce-80e5fa8153fa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:58.716968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1117/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:58.719418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:58.753711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c904-3354-43c0-aa6b-4db1ecbede56 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:58.766745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:58.767635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:58.767967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:58.768324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] PATH_INFO: `/v3/projects/721c3030a373477dbd5847ba063705ed/users/f6ed2b5096a340bab7b481029b1e07c8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.771098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721c3030a373477dbd5847ba063705ed, user_id=f6ed2b5096a340bab7b481029b1e07c8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:58.773998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:58.818792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1144/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:58 2022] PUT /identity/v3/projects/721c3030a373477dbd5847ba063705ed/users/f6ed2b5096a340bab7b481029b1e07c8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:58.821012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:58.821466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:58.822034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:58.845326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:58.975837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] MFA Rules not processed for user `f6ed2b5096a340bab7b481029b1e07c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:58.977551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:59.102372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a073d0a-7c66-41f8-928f-bd74718c4974 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:59.122052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:59.128508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:59.129297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:59.131380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:59.195155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:59.222287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1118/2262] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:59.231939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:59.305911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d8b2-6172-4a9b-804b-09cbe02769d1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:59.352818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:59.353414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:59.353691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:59.353961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:59.354651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:59.354956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:59.356667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:59.392490 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1119/2263] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:59.393538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:59.400353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:59.412294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:59.415818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770276-e16d-4a5d-b8bd-4a9cdf3058c2 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:59.425702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:59.426343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:59.426621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:59.426894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:59.427557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:59.433902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:59.475828 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1145/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:51:59.529202 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1120/2265] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:59 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:59.534901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:59.608966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e22e4-f19c-4732-9aa0-eb38d6364796 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:59.860553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:59.861143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:59.861426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:59.861702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:59.862379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:59.862912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:59.864529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383669c-fd45-44df-b8ec-53bf181af700 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:59.932939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1146/2266] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:01.087296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:01.171969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:01.232123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb388f-681a-42ca-b3e9-ecd0dbe2cf96 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:01.245900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:01.246535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:01.247567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:01.248012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:01.255239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:01.256119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:01.256270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:01.258865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1147/2267] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:01.265857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:01.269830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:01.271875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac82f3-a99f-4bd0-84c5-cde39e65efa4 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:01.335334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:01.380877 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1121/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:52:01.431339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:01.432324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:01.433016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:01.438128 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1122/2269] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:01.465872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:01.583405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:01.642585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f84ab-b8cb-4b14-9f48-e940e5a67a7c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:01.686858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7878449-a3eb-4447-9dca-22cfa12b9692 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:01.688643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f18ec10891064e63b13a15b4375e4e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0290b58495f5461bb76b62694e8a5806', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:01.691771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:01.692278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:01.692741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] PATH_INFO: `/v3/projects/8147473bf7ed4b89bbdc689dbea7f248` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:01.706779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:01.707797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:01.708249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:01.708587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/5e603ff1e3b94b8eba4e350a974326e2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:01.710129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorizing `identity:get_project(project_id=8147473bf7ed4b89bbdc689dbea7f248)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:01.711135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=5e603ff1e3b94b8eba4e350a974326e2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:01.716339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:01.723649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374287e-2002-4692-9fed-7ee2936cef9c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:01.724627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1123/2270] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:01 2022] GET /identity/v3/projects/5e603ff1e3b94b8eba4e350a974326e2 => generated 371 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:01.739523 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1148/2271] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:01 2022] GET /identity/v3/projects/8147473bf7ed4b89bbdc689dbea7f248 => generated 393 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:01.858637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:02.018858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaf50-188f-4590-9cac-72534823f58c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:02.019348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaf50-188f-4590-9cac-72534823f58c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:02.019856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaf50-188f-4590-9cac-72534823f58c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:02.022454 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1149/2272] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:02.029456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaf50-188f-4590-9cac-72534823f58c None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:02.078090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d487b-2cbc-4ed1-9af8-9ef9415496a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:02.090941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaf50-188f-4590-9cac-72534823f58c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:02.098352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:02.103614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:02.107751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:02.108585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] PATH_INFO: `/v3/users/6428f9389f3c4018950d752d582eef46` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:02.124620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6428f9389f3c4018950d752d582eef46)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:02.129028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:02.172713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaf50-188f-4590-9cac-72534823f58c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:02.213056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:02.214708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:02.216124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:02.216748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/5e603ff1e3b94b8eba4e350a974326e2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:02.220459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=5e603ff1e3b94b8eba4e350a974326e2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:02.227389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abee60-276d-431a-9bed-5eea17afc617 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:02.230667 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1150/2273] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:02 2022] GET /identity/v3/projects/5e603ff1e3b94b8eba4e350a974326e2 => generated 371 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:02.297785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6428f9389f3c4018950d752d582eef46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:02.298872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6428f9389f3c4018950d752d582eef46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:02.299963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6428f9389f3c4018950d752d582eef46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:02.323443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6428f9389f3c4018950d752d582eef46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:02.352303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6428f9389f3c4018950d752d582eef46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:02.430450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1124/2274] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:01 2022] DELETE /identity/v3/users/6428f9389f3c4018950d752d582eef46 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:02.435717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:02.436300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:02.436893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:02.527408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:02.531466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:02.652690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:02.703269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1151/2275] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:02.797973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:02.804066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:02.941700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:02.993890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b857-18f9-4d2a-ae2f-c6b4ee7abbd0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:03.003117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:03.004564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.005559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.007270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.049105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:03.055113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e68b-75bc-45ee-8a01-dea1567c2266 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:03.082561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1125/2276] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:03.135702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:03.137316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:03.161015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2573b-2e7a-45b8-9c92-1afecbe1eda6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:03.167173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:03.168247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.169343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.169783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] PATH_INFO: `/v3/users/b6fdf4cd494c44b18e831ebd3a53df7f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.171359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fdf4cd494c44b18e831ebd3a53df7f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:03.173606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:03.261188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fdf4cd494c44b18e831ebd3a53df7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:03.262029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fdf4cd494c44b18e831ebd3a53df7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:03.275732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fdf4cd494c44b18e831ebd3a53df7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:03.289907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fdf4cd494c44b18e831ebd3a53df7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:03.303793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-175108c9-5f36-41b1-86df-2b848f7d8707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fdf4cd494c44b18e831ebd3a53df7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:03.383391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1152/2277] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:03 2022] DELETE /identity/v3/users/b6fdf4cd494c44b18e831ebd3a53df7f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:03.393068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.393669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.393879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.395987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1126/2278] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:03.397817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.398170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.400355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.411739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:03.413818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:03.476346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:03.485242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:03.681925 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1153/2279] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:03.707050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:03.707342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:03.721345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:03.733217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:03.839951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:03.849530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918522fe-6b1c-4297-b096-17f36121a8b9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:03.862091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:03.864213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.864473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.864755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.916157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:03.924781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:03.944343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02d1b-6b8d-451a-9322-3ef2c0da2e14 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:03.949515 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1154/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:03.954091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:03.955056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:03.955500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:03.955781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/5e603ff1e3b94b8eba4e350a974326e2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:03.957146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=5e603ff1e3b94b8eba4e350a974326e2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:03.959659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff689f11-84ea-452e-bc02-499f4b897b27 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:03.970548 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1127/2281] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:03 2022] GET /identity/v3/projects/5e603ff1e3b94b8eba4e350a974326e2 => generated 371 bytes in 558 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:03.993460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:04.013527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffbf6-f591-4029-9e9a-0539d4e180d7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:04.028949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:04.030386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:04.032525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:04.033052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/5e603ff1e3b94b8eba4e350a974326e2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:04.040049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e603ff1e3b94b8eba4e350a974326e2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:04.043277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:04.230967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e603ff1e3b94b8eba4e350a974326e2', 'request_id': 'req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:04.232339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e603ff1e3b94b8eba4e350a974326e2', 'request_id': 'req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:04.245520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e603ff1e3b94b8eba4e350a974326e2', 'request_id': 'req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:04.279508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] The token cache is being invalidate because project 5e603ff1e3b94b8eba4e350a974326e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:04.281717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:04.285465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:04.288785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1155/2282] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:03 2022] DELETE /identity/v3/projects/5e603ff1e3b94b8eba4e350a974326e2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:04.822744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9811b-ff68-4466-ab34-699af0d0d192 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:04.823596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9811b-ff68-4466-ab34-699af0d0d192 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:04.823596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9811b-ff68-4466-ab34-699af0d0d192 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:04.824566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1128/2283] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:04.835041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:04.839658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:05.033071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:05.034406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:05.133163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ad61-ff1c-4124-8bbc-73a7386bc3f4 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:05.139329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:05.140001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.140303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.140631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.142068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=591c284c04044d2e91aa94035ab6eb63)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:05.144219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:05.148338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1156/2284] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:04 2022] GET /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63 => generated 373 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:05.179455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9811b-ff68-4466-ab34-699af0d0d192 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:05.208227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9811b-ff68-4466-ab34-699af0d0d192 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:05.214572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:05.215433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.215776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.216039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.217086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:05.217403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:05.220384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:05.244050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:05.251387 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1129/2285] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:05.258025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b111bc6-7a32-457d-bf4d-d9df77902ce0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:05.264123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:05.264943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.265394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.265779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.266564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:05.268710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f112-b3a5-4c50-87ae-942abaf51d11 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:05.284580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:05.324341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:05.336225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1157/2286] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:05 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:05.338797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93b69-4ae1-41c5-b1a7-1401311f0879 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:05.440354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:05.441852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.442623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.443156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.444347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:05.444952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:05.447994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:05.491586 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1130/2287] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:05.513332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.514537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.515313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.518719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1158/2288] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:05.529097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:05.532440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:05.548875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:05.800746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:05.827535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1e1d5-f186-478b-bbe4-516610e44e4a tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:05.839786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:05.842201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:05.842852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:05.843791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:05.847944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9d62f2c0fbd4773994c94cfbcac0674)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:05.852454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:05.857407 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1131/2289] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:05 2022] GET /identity/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674 => generated 371 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:06.003378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:06.006545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:06.111002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:06.114510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:06.431644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391cf8a-8be4-4a5e-bc07-d7c70a7ee863 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:06.445879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:06.446433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:06.446781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:06.447122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] PATH_INFO: `/v3/projects/f437c603a24348a0a9816a917502b7c4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:06.448461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f437c603a24348a0a9816a917502b7c4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:06.451231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:06.471730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fda3-34e3-47e9-badd-5fbcdf9fab56 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:06.482484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:06.483580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:06.484051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:06.484520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] PATH_INFO: `/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:06.487077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2556286fc5e54589bf8c8b0c2536a6a6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:06.490985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:06.619271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f437c603a24348a0a9816a917502b7c4', 'request_id': 'req-865196a4-cbc0-49e9-9d93-b6e3ff9494de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.647672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f437c603a24348a0a9816a917502b7c4', 'request_id': 'req-865196a4-cbc0-49e9-9d93-b6e3ff9494de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.664003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f437c603a24348a0a9816a917502b7c4', 'request_id': 'req-865196a4-cbc0-49e9-9d93-b6e3ff9494de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.665663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2556286fc5e54589bf8c8b0c2536a6a6', 'request_id': 'req-be918e90-4646-47fa-96b9-5113814d9ff2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.694927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] The token cache is being invalidate because project f437c603a24348a0a9816a917502b7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:06.696409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.698205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.702615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2556286fc5e54589bf8c8b0c2536a6a6', 'request_id': 'req-be918e90-4646-47fa-96b9-5113814d9ff2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.710145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1159/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:06 2022] DELETE /identity/v3/projects/f437c603a24348a0a9816a917502b7c4 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:06.713853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:06.716200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:06.742734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2556286fc5e54589bf8c8b0c2536a6a6', 'request_id': 'req-be918e90-4646-47fa-96b9-5113814d9ff2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.798562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] The token cache is being invalidate because project 2556286fc5e54589bf8c8b0c2536a6a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:06.799301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.801387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:06.811460 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1132/2291] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:06 2022] DELETE /identity/v3/projects/2556286fc5e54589bf8c8b0c2536a6a6 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:06.813223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:06.816484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:06.886609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:06.913736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865196a4-cbc0-49e9-9d93-b6e3ff9494de admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:07.018917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:07.108648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918e90-4646-47fa-96b9-5113814d9ff2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:07.128678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:07.130127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:07.130791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:07.132115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] PATH_INFO: `/v3/users/f18ec10891064e63b13a15b4375e4e1a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:07.134915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18ec10891064e63b13a15b4375e4e1a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:07.139573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:07.169678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:07.171847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:07.172338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:07.172804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] PATH_INFO: `/v3/users/5f24d9362d8f4802a07ff4d51fd2a551` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:07.177022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f24d9362d8f4802a07ff4d51fd2a551)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:07.182464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:07.326860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18ec10891064e63b13a15b4375e4e1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.327401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f24d9362d8f4802a07ff4d51fd2a551'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.327812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18ec10891064e63b13a15b4375e4e1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.328253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f24d9362d8f4802a07ff4d51fd2a551'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.328646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18ec10891064e63b13a15b4375e4e1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.349274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f24d9362d8f4802a07ff4d51fd2a551'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.357205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18ec10891064e63b13a15b4375e4e1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.366317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f24d9362d8f4802a07ff4d51fd2a551'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.367380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d4504cfb-3e76-4c7b-aa9c-4813175d8a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f24d9362d8f4802a07ff4d51fd2a551'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.386445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18ec10891064e63b13a15b4375e4e1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:07.410390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1160/2292] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:06 2022] DELETE /identity/v3/users/5f24d9362d8f4802a07ff4d51fd2a551 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:07.411664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:07.412036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:07.412378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:07.414009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1161/2293] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:07.426718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:07.431006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:07.468435 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1133/2294] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:06 2022] DELETE /identity/v3/users/f18ec10891064e63b13a15b4375e4e1a => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:07.574275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:07.589047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:07.667430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:07.755707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b031-321a-493d-aa30-98c848b0115c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:07.894190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:07.895509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:07.896039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:07.897058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:07.900159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9d62f2c0fbd4773994c94cfbcac0674)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:07.911469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:07.916303 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1162/2295] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:07 2022] GET /identity/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674 => generated 371 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:08.097385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:08.099772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:08.149459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307b79-3149-4d59-8532-37838ff69182 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:08.185353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:08.185353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:08.185353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:08.185850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:08.185850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:08.185850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:08.187663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:08.231583 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1134/2296] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:08.238927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:08.269795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab7b8-f43b-403c-8f73-0b7c6f5bbe15 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:08.280980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:08.282653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:08.283763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:08.284573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:08.288181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:08.294895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4d61c-4bf5-46c9-af68-d65ab4e00e47 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:08.378016 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1163/2297] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:08 2022] POST /identity/v3/users => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:08.383425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:08.443983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9983e-26d5-4d81-91f9-95563a1253c8 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:08.450562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:08.452055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:08.452345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:08.452629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:08.453407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:08.453775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:08.455763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:08.477018 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1135/2298] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:08.805638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42eedf-c2eb-4242-8683-4938fd643769 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:08.806038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42eedf-c2eb-4242-8683-4938fd643769 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:08.806414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42eedf-c2eb-4242-8683-4938fd643769 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:08.808521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1164/2299] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:08.819912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:08.991106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:09.009570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eed3e-768f-40d4-b3c0-9cb61cf87132 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:09.019393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:09.020960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:09.020960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:09.021331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:09.024636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9d62f2c0fbd4773994c94cfbcac0674)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:09.028849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:09.032477 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1136/2300] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:08 2022] GET /identity/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674 => generated 371 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:09.866383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:09.867767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:09.868525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:09.871832 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1165/2301] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:09.881277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:09.904126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.920063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:09.938601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:09.943063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:09.960237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee68b-0c70-40df-9a95-3be63b34566e tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:09.986381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:09.987158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:09.987598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:09.987996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:09.993870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9d62f2c0fbd4773994c94cfbcac0674)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:09.996368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:09.998609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1137/2302] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:09 2022] GET /identity/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674 => generated 371 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:10.109483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:10.112271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:10.240322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7439c82-0d47-4015-9bd0-98cc74992243 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:10.249927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:10.251251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:10.251841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:10.252513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] PATH_INFO: `/v3/projects/27f356471ca5432db93be461bf8e5672` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:10.255029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f356471ca5432db93be461bf8e5672)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:10.260428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:10.276445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb67e-a4bf-43a6-ae65-c81ab8e78ab6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:10.284220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:10.285527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:10.286081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:10.286599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] PATH_INFO: `/v3/projects/0290b58495f5461bb76b62694e8a5806` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:10.288588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0290b58495f5461bb76b62694e8a5806)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:10.291342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:10.367613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0290b58495f5461bb76b62694e8a5806', 'request_id': 'req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.376678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0290b58495f5461bb76b62694e8a5806', 'request_id': 'req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.398709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0290b58495f5461bb76b62694e8a5806', 'request_id': 'req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.407897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f356471ca5432db93be461bf8e5672', 'request_id': 'req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.415263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] The token cache is being invalidate because project 0290b58495f5461bb76b62694e8a5806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:10.415717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.416559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.419500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f356471ca5432db93be461bf8e5672', 'request_id': 'req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.419824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1138/2303] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:10 2022] DELETE /identity/v3/projects/0290b58495f5461bb76b62694e8a5806 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:10.420868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:10.422590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:10.439982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f356471ca5432db93be461bf8e5672', 'request_id': 'req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.459903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] The token cache is being invalidate because project 27f356471ca5432db93be461bf8e5672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:10.460205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.462303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.466330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1166/2304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:09 2022] DELETE /identity/v3/projects/27f356471ca5432db93be461bf8e5672 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:10.471961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:10.473732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:10.480575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:10.616689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c828ec-4d8a-4a1a-bfec-6ef72fa420ef admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:10.670851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ad88-0106-4a41-9caf-7ee7e68ee4b7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:10.682395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:10.692031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:10.692696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:10.693009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:10.693282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] PATH_INFO: `/v3/users/5e6dacfa15ed4a15895725c6827e01f6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:10.696144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6dacfa15ed4a15895725c6827e01f6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:10.698520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:10.783051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6dacfa15ed4a15895725c6827e01f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.784939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6dacfa15ed4a15895725c6827e01f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.790856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:10.791603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:10.791886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:10.792173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/users/60accc0c23bc44f9a03f37c081f479eb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:10.801932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6dacfa15ed4a15895725c6827e01f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.820728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6dacfa15ed4a15895725c6827e01f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.822976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-103562b9-2b7b-4f95-99a5-93ccfb6ae963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6dacfa15ed4a15895725c6827e01f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.840597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:delete_user(user_id=60accc0c23bc44f9a03f37c081f479eb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:10.842948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:10.881431 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1167/2305] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:10 2022] DELETE /identity/v3/users/5e6dacfa15ed4a15895725c6827e01f6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:10.884871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bbea-c515-4655-a6c1-680131e04f64 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:10.885667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bbea-c515-4655-a6c1-680131e04f64 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:10.886278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bbea-c515-4655-a6c1-680131e04f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:10.917925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e971bbea-c515-4655-a6c1-680131e04f64 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:10.920863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e971bbea-c515-4655-a6c1-680131e04f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:10.932271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60accc0c23bc44f9a03f37c081f479eb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.933833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60accc0c23bc44f9a03f37c081f479eb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.935845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60accc0c23bc44f9a03f37c081f479eb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.947510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60accc0c23bc44f9a03f37c081f479eb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:10.968502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60accc0c23bc44f9a03f37c081f479eb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.019223 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1139/2306] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:10 2022] DELETE /identity/v3/users/60accc0c23bc44f9a03f37c081f479eb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:11.025632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:11.031317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:11.059817 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1168/2307] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:11.062591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:11.063109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:11.063639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:11.127122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:11.135201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:11.216364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:11.294682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3500a-af92-4557-b036-0abd6a1b4b08 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:11.326957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:11.331422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:11.331853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:11.332261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:11.339578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9d62f2c0fbd4773994c94cfbcac0674)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:11.353136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:11.380679 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1169/2308] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:11.386150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:11.407085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3677cc-e6b9-4f9f-b0d9-93fa003baa75 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:11.416233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:11.417493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:11.418134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:11.418759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:11.420554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:11.421275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:11.428499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:11.458374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1170/2309] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:11.459360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:11.524082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d2aa8-2dc2-4ab4-b48f-dd615b91bce0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:11.557237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:11.587566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d62f2c0fbd4773994c94cfbcac0674', 'request_id': 'req-29dfca21-78a0-41b7-b219-61ab23d8df01'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.610617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d62f2c0fbd4773994c94cfbcac0674', 'request_id': 'req-29dfca21-78a0-41b7-b219-61ab23d8df01'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.628683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d62f2c0fbd4773994c94cfbcac0674', 'request_id': 'req-29dfca21-78a0-41b7-b219-61ab23d8df01'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.677626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] The token cache is being invalidate because project d9d62f2c0fbd4773994c94cfbcac0674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:11.678626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.680967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:11.696045 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1140/2310] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:11 2022] DELETE /identity/v3/projects/d9d62f2c0fbd4773994c94cfbcac0674 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:11.742914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:11.744006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:11.744296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:11.744604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:11.745672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:11.750775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3ff8-8c37-478a-b60f-72bd28da34e6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:11.827305 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1171/2311] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:11 2022] POST /identity/v3/projects => generated 387 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:11.828432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:11.830958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:11.886423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfca21-78a0-41b7-b219-61ab23d8df01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:11.990684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:11.991377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:11.991377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:11.993882 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1172/2312] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:12.040042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:12.044611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:12.199916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:12.209297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.209601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.210102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.213846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:12.226155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:12.338159 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1141/2313] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:11 2022] POST /identity/v3/users => generated 294 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:12.347708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:12.394806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc2669-073a-468a-beca-4809836eb769 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:12.405540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:12.406211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.406486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.406756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.407460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:12.409387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:12.436407 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1142/2314] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:12.437931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:12.445957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:12.450949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:12.467137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23920b5-3c66-4053-9aa4-b772d683dbfd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:12.483985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:12.484629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.484930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.485247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.485890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:12.487558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:12.508978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1143/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:12.518026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:12.540493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bdcd-be42-4fbe-b88e-08a75d662f30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:12.554547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:12.555311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.555597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.555922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] PATH_INFO: `/v3/projects/cdc8b6c3e715487293067ca378466ca4/users/66a05c50f8b744f0b5c22c7a33e88530/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.571476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:12.601180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc8b6c3e715487293067ca378466ca4, user_id=66a05c50f8b744f0b5c22c7a33e88530, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:12.611105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88d32c-91e1-4f1c-a542-c433aaa7d455 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:12.637548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04821-008e-40cf-8bbc-a1a9542a9710 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:12.670377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1144/2316] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:12 2022] PUT /identity/v3/projects/cdc8b6c3e715487293067ca378466ca4/users/66a05c50f8b744f0b5c22c7a33e88530/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:12.681879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.682440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.686734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.790684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:12.791405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:12.791679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:12.791992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:12.794392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=591c284c04044d2e91aa94035ab6eb63)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:12.796629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:12.802742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] MFA Rules not processed for user `66a05c50f8b744f0b5c22c7a33e88530`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:12.805191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:12.815796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1173/2317] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:12 2022] GET /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63 => generated 373 bytes in 777 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:13.092368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1145/2318] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:13.100203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:13.292518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd233-f96f-42f0-a804-8c59aed64dc9 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:13.321222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:13.322711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:13.323266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:13.323755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:13.324733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:13.329457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:13.416302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1174/2319] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:13 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:13.420683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:13.430767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:13.437733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb53d51-90e0-459c-8a0f-b3714d3d64ff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:13.554495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:13.559662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:13.625338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:13.626075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:13.626467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:13.627657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:13.629164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:13.637758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee119cd4-12b5-4f33-9199-0fa43f5adeb0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:13.753933 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1146/2320] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:13 2022] POST /identity/v3/users => generated 300 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:13.755224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f87db-a017-4deb-9038-8d454e81308e None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:13.755824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f87db-a017-4deb-9038-8d454e81308e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:13.756381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f87db-a017-4deb-9038-8d454e81308e None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:13.763644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1147/2321] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:13.766522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f87db-a017-4deb-9038-8d454e81308e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:13.791573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f87db-a017-4deb-9038-8d454e81308e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:13.808207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:13.809974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:13.810424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:13.810849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:13.811756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:13.814544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:13.834161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb486a40-320f-4059-8939-a59de5ea618e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:13.843662 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1148/2322] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:13.848255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:13.864257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:13.865110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:13.865463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:13.865833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] PATH_INFO: `/v3/projects/8147473bf7ed4b89bbdc689dbea7f248` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:13.872232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8147473bf7ed4b89bbdc689dbea7f248)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:13.881381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:13.903039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:14.037184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8147473bf7ed4b89bbdc689dbea7f248', 'request_id': 'req-6f5377cb-8771-4ae2-945c-b5313fe4abe6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:14.046442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8147473bf7ed4b89bbdc689dbea7f248', 'request_id': 'req-6f5377cb-8771-4ae2-945c-b5313fe4abe6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:14.057815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8147473bf7ed4b89bbdc689dbea7f248', 'request_id': 'req-6f5377cb-8771-4ae2-945c-b5313fe4abe6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:14.067976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.082791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] The token cache is being invalidate because project 8147473bf7ed4b89bbdc689dbea7f248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:14.083132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:14.084244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:14.094120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1175/2323] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:13 2022] DELETE /identity/v3/projects/8147473bf7ed4b89bbdc689dbea7f248 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:14.094120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.094120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:14.197023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5377cb-8771-4ae2-945c-b5313fe4abe6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.214229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.215798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.216299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.218076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] PATH_INFO: `/v3/projects/5531e84096ee46eabd5df958c2eeba45/users/2ac52977718e4fadbac8a3a1e410a1ba/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.253328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31c305-fbc7-47b0-bfd6-b312bd0ab705 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.281366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5531e84096ee46eabd5df958c2eeba45, user_id=2ac52977718e4fadbac8a3a1e410a1ba, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.282326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:14.289590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbd12-0a6f-4805-a4dc-a3fb08789c8f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.313697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1176/2324] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:14 2022] PUT /identity/v3/projects/5531e84096ee46eabd5df958c2eeba45/users/2ac52977718e4fadbac8a3a1e410a1ba/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:14.315874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291316e-a82d-4112-8afd-d339e88bbd22 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.316322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291316e-a82d-4112-8afd-d339e88bbd22 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.317075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291316e-a82d-4112-8afd-d339e88bbd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.346127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.346979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.347469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7291316e-a82d-4112-8afd-d339e88bbd22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:14.347649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.348001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.350683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7291316e-a82d-4112-8afd-d339e88bbd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:14.350996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=591c284c04044d2e91aa94035ab6eb63)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.352701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.362928 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1149/2325] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:13 2022] GET /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63 => generated 373 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:14.368350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.398650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e33b-0ee4-4daf-bd0e-12d2284ec0e3 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.451960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1177/2326] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:14.462722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.463080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.463247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.499766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:14.501250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:14.517177 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1178/2327] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:14.518494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.534858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd116ef-1152-490f-849c-b15e15f83fa7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.540353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.541717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.541717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.542073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.542638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:14.543020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.545687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.557328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:14.569864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1179/2328] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:14.573756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.594201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.595994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.597060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f197c5-a28c-42be-b5c4-ccded59572c6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.597394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.597802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.601012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.606541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.608419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.613034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.614343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.615226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.617292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.621317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.643349 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1150/2329] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:14.646329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.670906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6886-e4e3-4ec1-ab73-a350ae98c37e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.678152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.679176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.679463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.679815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] PATH_INFO: `/v3/projects/5531e84096ee46eabd5df958c2eeba45/users/2ac52977718e4fadbac8a3a1e410a1ba/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.683528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5531e84096ee46eabd5df958c2eeba45, user_id=2ac52977718e4fadbac8a3a1e410a1ba, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.687426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673d65-2bac-415d-8e74-de0c2613a1aa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.707568 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1151/2330] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:14 2022] PUT /identity/v3/projects/5531e84096ee46eabd5df958c2eeba45/users/2ac52977718e4fadbac8a3a1e410a1ba/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:14.719261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2690a-6335-44ea-930b-5036ac66a779 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.719599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2690a-6335-44ea-930b-5036ac66a779 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.719919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2690a-6335-44ea-930b-5036ac66a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.726423 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1180/2331] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:14.730666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:14.769069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4ea2690a-6335-44ea-930b-5036ac66a779 None None] MFA Rules not processed for user `2ac52977718e4fadbac8a3a1e410a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:14.770837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ea2690a-6335-44ea-930b-5036ac66a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:14.902717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a56b00-6e5b-45d8-a5d6-c42680067ae4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:14.911606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:14.912255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.912571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.913623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.914401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:14.916568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:14.923748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1152/2332] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:14.938609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:14.939177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:14.939727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:14.968550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] MFA Rules not processed for user `66a05c50f8b744f0b5c22c7a33e88530`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:14.969965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:14.987930 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1181/2333] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:14.989973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.015575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:15.018453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a8cdf-84ff-4db9-bd1f-492201ad2fd2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:15.030863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:15.032107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.032613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.033130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.034357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:15.040283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:15.072432 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1182/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:15.075450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.081823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1153/2335] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:15.094677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942fb0-d954-4ef1-acc5-9a7f1e47a7de admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:15.100479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:15.101197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.101499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.101837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.102421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:15.104092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6f1a6-4847-40c8-819e-ac2fd81525f6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:15.117822 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1183/2336] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:15.122700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.137088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ce4f-5abc-456b-a74a-c3a7ce5ea0ca None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:15.143388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:15.144108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.144387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.144689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] PATH_INFO: `/v3/projects/104fb3926d1943d29ac30dabd56ab2d2/users/a85c88bc4e1a4e7989c1761102ee215c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.185943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=104fb3926d1943d29ac30dabd56ab2d2, user_id=a85c88bc4e1a4e7989c1761102ee215c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:15.189371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c07cb3-1a06-4dce-ba99-2cf106de6c1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:15.235469 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1154/2337] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:15 2022] PUT /identity/v3/projects/104fb3926d1943d29ac30dabd56ab2d2/users/a85c88bc4e1a4e7989c1761102ee215c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:15.242242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.242734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.243787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.295979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] MFA Rules not processed for user `a85c88bc4e1a4e7989c1761102ee215c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:15.298238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.301212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.301689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.302154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.304635 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1155/2338] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:15.312859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:15.316069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.498776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1184/2339] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:15.500631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.504371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.598744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:15.607969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.610609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.705315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff5e99-4972-4030-8101-8844ed816906 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:15.716360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:15.717038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.717323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.717599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.722095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.787463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727d45-ea8c-4567-affc-52a2f73967d1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:15.804106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ed2b5096a340bab7b481029b1e07c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '721c3030a373477dbd5847ba063705ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:15.806088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.807025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.808163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.813887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorizing `identity:get_project(project_id=591c284c04044d2e91aa94035ab6eb63)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:15.819433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:15.824255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1156/2340] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:15 2022] GET /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63 => generated 373 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:15.826532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:15.870656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:15.873276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681a1f-e62c-499f-9a4e-67f943d425f1 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:15.893035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1185/2341] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:15.896509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:15.896778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:15.897078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:15.959853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:15.978961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] MFA Rules not processed for user `d76e0eb51a9b418bb28e81b5ac1520f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:15.981966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:15.988245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237398b-7f49-476f-b27c-c785d33e9a3f tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.007318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.008301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.008763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.009248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.010331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.027245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.090904 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1157/2342] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:15 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:16.095713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.148886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1186/2343] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:16.151878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.155459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:16.215113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f749e2-3680-4e54-a5e2-fa993f70ab68 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.275296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f46ca-5705-43da-84c3-98f0e9da29f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.287238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.291579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.292121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.292666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.298020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.300814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.336105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1158/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:16 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:16.338824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.352741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.354841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.355530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.357062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.359480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.365763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.366432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c654-84f2-4097-954a-d3a413bfcbdb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.379211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.380325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:16.383004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.383473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.383750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.387563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.390690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.447999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1159/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:16.450682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.467811 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1187/2346] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:16 2022] POST /identity/v3/projects => generated 369 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:16.473532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.489530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7f84-ac8a-4635-bf42-cd38683581b3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.669573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc8b2-729f-44d2-b917-b827bec00f24 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.672702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.673427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.673709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.673986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] PATH_INFO: `/v3/projects/50103cb27ce1440b807401655a4c0820/users/1481c34ced9b4af4a9f149215f35e8c4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.689338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.690889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.692795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.693481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.695495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.702387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.787682 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1188/2347] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:16 2022] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:16.794392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:16.799534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:16.861104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050496ba-349c-4e87-a76b-94dc6c3eaf20 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:16.878963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:16.880116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:16.884373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:16.884667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] PATH_INFO: `/v3/users/46e1419ed74945a1931ee434a1fc9d97` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:16.888882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e1419ed74945a1931ee434a1fc9d97)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.891012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:16.986524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50103cb27ce1440b807401655a4c0820, user_id=1481c34ced9b4af4a9f149215f35e8c4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:16.998419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:17.031354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e1419ed74945a1931ee434a1fc9d97'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:17.032587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e1419ed74945a1931ee434a1fc9d97'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:17.040795 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1160/2348] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:16 2022] PUT /identity/v3/projects/50103cb27ce1440b807401655a4c0820/users/1481c34ced9b4af4a9f149215f35e8c4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:17.042151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:17.065634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e1419ed74945a1931ee434a1fc9d97'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:17.087262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e1419ed74945a1931ee434a1fc9d97'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:17.089857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e1419ed74945a1931ee434a1fc9d97'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:17.143536 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1189/2349] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:16 2022] DELETE /identity/v3/users/46e1419ed74945a1931ee434a1fc9d97 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:17.144979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:17.150051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:17.234739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:17.296365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e56b8-d668-43b1-a5cf-ceffabc8c19b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:17.380635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:17.495947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92a11-7d2b-4de0-8b16-b9ef7235247e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:17.499540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:17.504258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.511398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.512048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.513768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:17.517859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7ebb-5f89-4fb7-8064-cbb07623b954 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:17.527409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:17.528442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.528926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.529385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.546034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1161/2350] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:17.546280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:17.548729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.549195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.549417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:17.549640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.619043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1190/2351] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:17.624759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:17.634965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:17.664279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:17.665602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:17.690392 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1162/2352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:17.690392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:17.721646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7027-1b92-47e1-a83b-c44608ff9dc9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:17.738898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:17.739604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.739948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.740250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] PATH_INFO: `/v3/projects/50103cb27ce1440b807401655a4c0820/users/1481c34ced9b4af4a9f149215f35e8c4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.740536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca09ab-9d0d-43a9-a1b4-34c1c511d3c1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:17.745934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50103cb27ce1440b807401655a4c0820, user_id=1481c34ced9b4af4a9f149215f35e8c4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:17.749147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:17.775891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:17.779025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.781667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.782739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] PATH_INFO: `/v3/projects/209ee62e87b644d88681cd0ff30bcb78/users/e1ab306d44cc4ac683d6a1715472c18a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.794292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1163/2353] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:17 2022] PUT /identity/v3/projects/50103cb27ce1440b807401655a4c0820/users/1481c34ced9b4af4a9f149215f35e8c4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:17.795440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:17.800018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:17.852552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209ee62e87b644d88681cd0ff30bcb78, user_id=e1ab306d44cc4ac683d6a1715472c18a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:17.868674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a5e4-389d-4bf7-9ecc-e77adaa7f172 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:17.926793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1191/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:17 2022] PUT /identity/v3/projects/209ee62e87b644d88681cd0ff30bcb78/users/e1ab306d44cc4ac683d6a1715472c18a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:17.928624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9560-d8a1-4834-8716-e8a44c184225 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.931625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9560-d8a1-4834-8716-e8a44c184225 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.933509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc9560-d8a1-4834-8716-e8a44c184225 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.938426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1192/2355] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:52:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:17.942276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:17.945185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:17.945465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:17.950967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f10ce-d940-498d-bde7-6d7354644057 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:18.001180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] MFA Rules not processed for user `1481c34ced9b4af4a9f149215f35e8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:18.002884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:18.118371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1193/2356] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:18.119878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:18.177083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:18.180216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:18.183057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:18.184311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:18.300237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:18.309692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b04daf-64b2-4925-97ba-8e0b810e2346 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:18.328074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:18.334172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:18.336266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:18.336754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:18.342540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:18.349266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3743-525c-49c4-89c0-438fa8b95762 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:18.415377 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1194/2357] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:18.421960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:18.422479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:18.422986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:18.452377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:18.457224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:18.492607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1164/2358] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:18.493648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:18.523372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:18.526579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:18.538708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2f36-091c-4bce-a7d0-e1f5735d329b service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:18.544520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:18.546225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:18.546225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:18.546225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] PATH_INFO: `/v3/projects/209ee62e87b644d88681cd0ff30bcb78/users/e1ab306d44cc4ac683d6a1715472c18a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:18.548512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209ee62e87b644d88681cd0ff30bcb78, user_id=e1ab306d44cc4ac683d6a1715472c18a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:18.551914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:18.574023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1165/2359] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:18 2022] PUT /identity/v3/projects/209ee62e87b644d88681cd0ff30bcb78/users/e1ab306d44cc4ac683d6a1715472c18a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:18.577337 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1195/2360] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:52:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:18.639956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:18.642288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:18.832552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99716432-61b0-4105-b6ed-8ff21519ebb3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:18.838018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:18.839048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:18.839459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:18.839941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:18.859145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:18.865438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:18.883139 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1166/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:52:19.464408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:19.467419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:19.684531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:19.852366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a021d-ec4b-403e-816c-f22b72d11891 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:20.032420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:20.033494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:20.038216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:20.038216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:20.234019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:20.235753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:20.268797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1196/2362] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:20.328898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:20.330421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:20.516674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c2058-5441-41e8-810e-1ae93235240a service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:20.525986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:20.526952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:20.527416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:20.528433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] PATH_INFO: `/v3/projects/591c284c04044d2e91aa94035ab6eb63` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:20.534171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591c284c04044d2e91aa94035ab6eb63)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:20.536614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:20.716362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591c284c04044d2e91aa94035ab6eb63', 'request_id': 'req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:20.733952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591c284c04044d2e91aa94035ab6eb63', 'request_id': 'req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:20.742108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:20.766835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591c284c04044d2e91aa94035ab6eb63', 'request_id': 'req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:20.815016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] The token cache is being invalidate because project 591c284c04044d2e91aa94035ab6eb63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:20.815016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:20.816072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:20.826195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1167/2363] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:20 2022] DELETE /identity/v3/projects/591c284c04044d2e91aa94035ab6eb63 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:20.830189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:20.859969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d52f-24d7-459e-927e-3e32437849e0 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:21.054718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:21.055659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:21.055940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:21.058250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] PATH_INFO: `/v3/users/f6ed2b5096a340bab7b481029b1e07c8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:21.059847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ed2b5096a340bab7b481029b1e07c8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:21.061973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:21.087674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:21.195175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ed2b5096a340bab7b481029b1e07c8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:21.195940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ed2b5096a340bab7b481029b1e07c8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:21.213032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ed2b5096a340bab7b481029b1e07c8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:21.230238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ed2b5096a340bab7b481029b1e07c8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:21.233174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ed2b5096a340bab7b481029b1e07c8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:21.283497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:21.288317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:21.333554 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1197/2364] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:20 2022] DELETE /identity/v3/users/f6ed2b5096a340bab7b481029b1e07c8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:21.485681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373d6a-9a38-49b9-b6fa-dd2d7be827e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:21.678423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:21.679790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:21.680272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:21.680767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:21.685504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:21.910453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:21.913841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461bf57-794e-4a7c-a1e5-1aa174014d98 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:21.941634 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1168/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:23.413590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:23.415343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:23.584331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3caf5-78df-430f-b540-3920f85c4045 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:23.598283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:23.599270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:23.599871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:23.600332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] PATH_INFO: `/v3/projects/721c3030a373477dbd5847ba063705ed` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:23.603041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721c3030a373477dbd5847ba063705ed)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:23.605353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:23.759827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721c3030a373477dbd5847ba063705ed', 'request_id': 'req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:23.797227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721c3030a373477dbd5847ba063705ed', 'request_id': 'req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:23.835360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721c3030a373477dbd5847ba063705ed', 'request_id': 'req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:23.894871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] The token cache is being invalidate because project 721c3030a373477dbd5847ba063705ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:23.904868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:23.907746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fbe3d01-8dd7-4171-95d9-c0e5b19e14f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:23.910715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1198/2366] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:23 2022] DELETE /identity/v3/projects/721c3030a373477dbd5847ba063705ed => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:23.917076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:23.922619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:23.923315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:23.998377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:23.999946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:24.126435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:24.227225 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1169/2367] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:24.237580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640252-fcab-443d-be54-d65600759127 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:24.238121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640252-fcab-443d-be54-d65600759127 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:24.238569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640252-fcab-443d-be54-d65600759127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:24.271920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-57640252-fcab-443d-be54-d65600759127 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:24.273305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-57640252-fcab-443d-be54-d65600759127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:24.314955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:24.325080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1199/2368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:24.349202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d444cdd-e96c-41f8-b84e-e99ae9ada25b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:24.369688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:24.371086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:24.371279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:24.372249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:24.373689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:24.374396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:24.377524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:24.449715 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1170/2369] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:24.453306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57640252-fcab-443d-be54-d65600759127 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:24.474913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57640252-fcab-443d-be54-d65600759127 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:24.484610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:24.486262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:24.487348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:24.488157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:24.489693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:24.495832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:24.523034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:24.577902 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1200/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:24 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:24.584054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:24.613951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848ba2-1624-448a-9c40-48c5d4eca400 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:24.741963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:24.742961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:24.743359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:24.743808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:24.744725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:24.747942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:24.796325 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1171/2371] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:24 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:24.802860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:24.839054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf9c0-a2ed-495a-a996-14500168171f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:24.870143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:24.873423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:24.874065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:24.875060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:24.877692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:24.896387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:24.943024 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1201/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:24.950320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:24.998565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe3e0-cc7b-4456-b247-3e2f75297df7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:25.018861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:25.019674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:25.020041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:25.020417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:25.021868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:25.029644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9956b6-2a27-4ad1-808a-3ff1fe6bbf42 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:25.054313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1172/2373] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:25.060406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:25.082020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb57a-5a8b-403d-9335-a5eb8e459ad5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:25.098199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:25.099120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:25.099508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:25.099947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd/users/b31f31eb0a7b4c14be4317c2baa47182/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:25.163912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db49c69ff8648759c5d61d8b149dedd, user_id=b31f31eb0a7b4c14be4317c2baa47182, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:25.168846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:25.208293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1202/2374] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:25 2022] PUT /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd/users/b31f31eb0a7b4c14be4317c2baa47182/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:25.229480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:25.230037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:25.230453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:25.299802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] MFA Rules not processed for user `b31f31eb0a7b4c14be4317c2baa47182`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:25.302878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:25.484941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1173/2375] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:25.486433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:25.674981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc725-5817-4f13-8bc7-8428f3fb2600 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:25.689976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:25.690744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:25.691112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:25.691496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:25.692415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:25.694955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:25.811571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1203/2376] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:25 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:25.813593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:25.836689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6bef8-c063-42fe-b6b7-adc2c366b6a9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:25.873829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:25.978984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:25.980504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:25.983145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:25.983669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:25.984535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:25.992022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:26.105272 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1174/2377] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:25 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:26.106372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:26.155295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8234ad-47fb-400a-b779-e5b074f4aedb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:26.204842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:26.206464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:26.214691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:26.216318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:26.221747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:26.237311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:26.279313 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1204/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:26.281619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:26.309987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ed059-59d8-44f9-857b-27b28aed71c6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:26.324311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:26.328246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:26.329002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:26.329698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] PATH_INFO: `/v3/projects/7f811cfd351345fd9baf53ebdead0e20/users/58c4b31e91d0411dbf08869c3640fb95/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:26.389449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f811cfd351345fd9baf53ebdead0e20, user_id=58c4b31e91d0411dbf08869c3640fb95, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:26.397350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:26.431908 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1175/2379] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:26 2022] PUT /identity/v3/projects/7f811cfd351345fd9baf53ebdead0e20/users/58c4b31e91d0411dbf08869c3640fb95/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:26.436600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:26.477165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bbf89-4473-4c8d-8437-129ebc3c0d3d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:26.668839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:26.670605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:26.671248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:26.671890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:26.673371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:26.675975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5dad-0816-4c49-938a-119c733de17b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:26.703919 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1205/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:26.708324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:26.725701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b831-ab65-45ed-8415-e8ae5f5b8d4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:26.734714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:26.736081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:26.737919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:26.737919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] PATH_INFO: `/v3/projects/7f811cfd351345fd9baf53ebdead0e20/users/58c4b31e91d0411dbf08869c3640fb95/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:26.741418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f811cfd351345fd9baf53ebdead0e20, user_id=58c4b31e91d0411dbf08869c3640fb95, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:26.745867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:26.768726 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1176/2381] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:26 2022] PUT /identity/v3/projects/7f811cfd351345fd9baf53ebdead0e20/users/58c4b31e91d0411dbf08869c3640fb95/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:26.780109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:26.780842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:26.781490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:26.868686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] MFA Rules not processed for user `58c4b31e91d0411dbf08869c3640fb95`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:26.872565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:26.907177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:26.914468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:26.919879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:27.063614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1206/2382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:27.076660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd067-f934-463e-b2b8-ced674e0a26a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:27.084612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:27.086303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:27.086483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:27.086812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:27.089178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:27.221502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:27.223472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf34e14-bf08-4e9d-b1ba-657b31b766b1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:27.238663 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1177/2383] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:27.933782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:27.935319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:27.962375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aafbf-bf0b-48ab-947e-c9973306dd20 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:27.973484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:27.973976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:27.974250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:27.974706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:27.983895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:27.986028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:27.999305 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1207/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:28.044592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f054-c31d-4d38-beda-c48e5f812a65 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:28.044875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f054-c31d-4d38-beda-c48e5f812a65 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:28.045204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f054-c31d-4d38-beda-c48e5f812a65 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:28.046933 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1178/2385] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:28.054413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:28.071601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:28.083369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532c9f-8d96-4ad0-9bfc-67e6d30d4757 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:28.088891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:28.089567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:28.090100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:28.091272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:28.092643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:28.094818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0642c3-2527-485d-939b-700ac8425139 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:28.097076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1208/2386] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:28 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:28.519847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:28.521851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:28.522905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:28.538917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:28.539931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:28.540724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:28.544820 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1209/2387] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:28.554141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:28.563877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:28.586537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:28.590271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:28.619145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:28.648960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2595d-e20f-4d12-a433-16470cd37d15 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:28.676002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:28.679430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:28.680129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:28.685705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:28.692179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:28.707854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6442ad-28bd-4094-9398-b773c2bcdfc5 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:28.716888 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1210/2388] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:28 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:28.722422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1179/2389] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:29.060436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b88bb-8524-465b-8b90-26a0008acc43 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:29.061383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b88bb-8524-465b-8b90-26a0008acc43 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:29.061655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b88bb-8524-465b-8b90-26a0008acc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:29.104045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-918b88bb-8524-465b-8b90-26a0008acc43 None None] MFA Rules not processed for user `b31f31eb0a7b4c14be4317c2baa47182`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:29.105640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-918b88bb-8524-465b-8b90-26a0008acc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:29.204986 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1211/2390] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:29.791418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:29.820397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48cdd-2012-4ad5-a708-e9fa24fa722c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:29.838631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:29.840538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:29.841971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:29.842807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:29.858429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:29.862616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:29.903031 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1180/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:31.863698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed759c-15ed-4461-bab4-e1f8e3888e1c None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:31.865922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed759c-15ed-4461-bab4-e1f8e3888e1c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:31.868408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed759c-15ed-4461-bab4-e1f8e3888e1c None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:31.873237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1212/2392] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:31.893791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:31.920462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:31.927952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0ea0-4377-4c4c-a4d1-3e83f852645e service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:31.933273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:31.934610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:31.934896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:31.935204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:31.936513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:31.938724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:31.950380 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1181/2393] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:31 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:32.265365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93ccf-6b27-49c5-ac70-7eaf8b9f7117 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:32.265659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93ccf-6b27-49c5-ac70-7eaf8b9f7117 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:32.266088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93ccf-6b27-49c5-ac70-7eaf8b9f7117 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:32.267953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1213/2394] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:32.275107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:32.302439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:32.315744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470c7e-df2e-45fc-b518-127b6254adf4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:32.323946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:32.325547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:32.327354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:32.328534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:32.331937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:32.339004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:32.346972 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1182/2395] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:32 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:32.436501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5680f2-5352-45d9-a896-c4360817ec11 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:32.437333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5680f2-5352-45d9-a896-c4360817ec11 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:32.438782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5680f2-5352-45d9-a896-c4360817ec11 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:32.441949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1214/2396] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:32.450327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:32.525978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:32.554920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38b35-abd1-41db-8652-e60e8b2fc3c1 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:32.567347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:32.568302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:32.568782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:32.569168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:32.570881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:32.573357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:32.614680 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1183/2397] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:32 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:32.710460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248db5e-cf35-420f-8dc0-b151702cd42d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:32.711268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248db5e-cf35-420f-8dc0-b151702cd42d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:32.711406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248db5e-cf35-420f-8dc0-b151702cd42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:32.754255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3248db5e-cf35-420f-8dc0-b151702cd42d None None] MFA Rules not processed for user `b31f31eb0a7b4c14be4317c2baa47182`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:32.759608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3248db5e-cf35-420f-8dc0-b151702cd42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:32.773560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:32.776526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:32.786462 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1215/2398] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:32.996774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b91ed-9f3a-465c-b0cb-48dc11e8ca8f tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:33.050373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:33.051080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:33.051363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:33.051633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] PATH_INFO: `/v3/users/a85c88bc4e1a4e7989c1761102ee215c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:33.058088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85c88bc4e1a4e7989c1761102ee215c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:33.060326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:33.244361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85c88bc4e1a4e7989c1761102ee215c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:33.245310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85c88bc4e1a4e7989c1761102ee215c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:33.246118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85c88bc4e1a4e7989c1761102ee215c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:33.275580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85c88bc4e1a4e7989c1761102ee215c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:33.309556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85c88bc4e1a4e7989c1761102ee215c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:33.329405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:33.358576 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1184/2399] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:32 2022] DELETE /identity/v3/users/a85c88bc4e1a4e7989c1761102ee215c => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:33.363733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6332-b10c-441d-84e5-dc846a8204f4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:33.365323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6332-b10c-441d-84e5-dc846a8204f4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:33.366186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6332-b10c-441d-84e5-dc846a8204f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:33.408888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f20e6332-b10c-441d-84e5-dc846a8204f4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:33.410190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f20e6332-b10c-441d-84e5-dc846a8204f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:33.630574 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1216/2400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:33.648011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:33.649863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:33.796795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733278a-9f1a-45d6-adc0-8eb6c73e91da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:33.797341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733278a-9f1a-45d6-adc0-8eb6c73e91da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:33.797904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733278a-9f1a-45d6-adc0-8eb6c73e91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:33.812713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99d4d-04ba-432c-ae4c-634b94c77a1f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:33.818909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:33.819694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:33.820055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:33.820827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:33.834682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:33.836290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ec9c-fac7-4059-affd-c48a1af287e6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:33.862365 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1185/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:33.877786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:33.882401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f733278a-9f1a-45d6-adc0-8eb6c73e91da None None] MFA Rules not processed for user `e1ab306d44cc4ac683d6a1715472c18a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:33.885666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f733278a-9f1a-45d6-adc0-8eb6c73e91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.061695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:34.062637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:34.062637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:34.063661 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1186/2402] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:52:34.070802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:34.073109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.099601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1217/2403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:34.112168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:34.113626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:34.114584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:34.166208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] MFA Rules not processed for user `d76e0eb51a9b418bb28e81b5ac1520f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:34.172847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.319405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:34.325592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.333676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1218/2404] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:34.460570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c349a2-92fe-4553-ac74-c91dfd0dd2b8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:34.466024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:34.466689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:34.467553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:34.467863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:34.469321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:34.472052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:34.474074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1187/2405] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:34 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:34.617487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:34.630344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.681084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af33c9-1046-4e22-a1be-355aea847647 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:34.689889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:34.690920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:34.691447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:34.691935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:34.694270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.707198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:34.709100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b20f5-5694-4c63-b9ca-ef844e93ce49 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:34.721467 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1219/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:34.867029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:34.870901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:34.942376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5659-7fa7-4124-9006-3b9419021a48 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:34.958682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:34.960978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:34.961934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:34.962651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] PATH_INFO: `/v3/projects/104fb3926d1943d29ac30dabd56ab2d2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:34.966615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104fb3926d1943d29ac30dabd56ab2d2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:34.974344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:35.038841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:35.039305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:35.039677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:35.041233 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1220/2407] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:35.060811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:35.082533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:35.122609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:35.127606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104fb3926d1943d29ac30dabd56ab2d2', 'request_id': 'req-613f1d38-d76b-4329-88f1-d054476c60e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.136212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104fb3926d1943d29ac30dabd56ab2d2', 'request_id': 'req-613f1d38-d76b-4329-88f1-d054476c60e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.150678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104fb3926d1943d29ac30dabd56ab2d2', 'request_id': 'req-613f1d38-d76b-4329-88f1-d054476c60e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.151182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc561-1d3f-4569-a66f-829828940840 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:35.184983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] The token cache is being invalidate because project 104fb3926d1943d29ac30dabd56ab2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:35.185691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.187428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.195584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1188/2408] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:34 2022] DELETE /identity/v3/projects/104fb3926d1943d29ac30dabd56ab2d2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:35.197326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:35.201409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:35.349790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:35.350909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:35.351403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:35.351983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:35.359708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:35.364555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d00b3a-e1a0-4a68-911d-48c9f349b6af tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:35.381899 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1221/2409] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:35 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:35.436676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f1d38-d76b-4329-88f1-d054476c60e5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:35.457518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:35.458259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:35.458680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:35.458850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] PATH_INFO: `/v3/users/1481c34ced9b4af4a9f149215f35e8c4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:35.461544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1481c34ced9b4af4a9f149215f35e8c4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:35.465821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:35.609250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1481c34ced9b4af4a9f149215f35e8c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.610700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1481c34ced9b4af4a9f149215f35e8c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.619323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1481c34ced9b4af4a9f149215f35e8c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.628977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1481c34ced9b4af4a9f149215f35e8c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.642466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1481c34ced9b4af4a9f149215f35e8c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:35.688643 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1189/2410] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:35 2022] DELETE /identity/v3/users/1481c34ced9b4af4a9f149215f35e8c4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:36.709747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:36.709747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:36.709747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:36.709747 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1222/2411] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:36.745272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:36.752802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:36.838594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:36.851284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:36.855069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:36.964158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:36.985183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:36.990809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:37.114826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812059ee-0b2e-4f28-8d5a-2d9d79ff3b34 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:37.165529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:37.171212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.174205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.176408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] PATH_INFO: `/v3/projects/50103cb27ce1440b807401655a4c0820` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.181379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50103cb27ce1440b807401655a4c0820)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:37.191218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:37.322358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc92a4-12d4-49f7-a6bc-4528cb635cca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:37.361357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50103cb27ce1440b807401655a4c0820', 'request_id': 'req-14b4aecf-4f19-4a92-abbb-1a381b36596f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:37.377341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50103cb27ce1440b807401655a4c0820', 'request_id': 'req-14b4aecf-4f19-4a92-abbb-1a381b36596f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:37.390913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50103cb27ce1440b807401655a4c0820', 'request_id': 'req-14b4aecf-4f19-4a92-abbb-1a381b36596f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:37.409187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] The token cache is being invalidate because project 50103cb27ce1440b807401655a4c0820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:37.409487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:37.410459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-14b4aecf-4f19-4a92-abbb-1a381b36596f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:37.413647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1223/2412] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:36 2022] DELETE /identity/v3/projects/50103cb27ce1440b807401655a4c0820 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:37.422117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e493-87bc-45d4-a7a9-81c52d9cb849 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.422478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e493-87bc-45d4-a7a9-81c52d9cb849 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.422703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e493-87bc-45d4-a7a9-81c52d9cb849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.459036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5185e493-87bc-45d4-a7a9-81c52d9cb849 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:37.460496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5185e493-87bc-45d4-a7a9-81c52d9cb849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:37.507696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:37.509312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.509910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.510816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.514352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:37.518354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249862a-980d-43b0-8f86-4691147c48c3 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:37.521023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1190/2413] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:36 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 780 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:37.600851 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1224/2414] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:37.603365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.603703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.603983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.695679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:37.702701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:37.724276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.724276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.724276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.770488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1191/2415] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:37.772935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:37.773534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] MFA Rules not processed for user `b31f31eb0a7b4c14be4317c2baa47182`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:37.786510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:37.799511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6108f2e-4374-4d4f-b581-f6cd2b9ca8b6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:37.822611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:37.826766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.827129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.827415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.828186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:37.828493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:37.838996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:37.909360 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1192/2416] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:37.914669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:37.969918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54903-d263-44f4-8266-c176d7d92c32 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:37.988672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:37.989387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:37.989659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:37.995952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:37.997369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:37.999382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:38.001902 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1225/2417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:38.100306 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1193/2418] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:37 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:38.103377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:38.122313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:38.136832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686c384-55df-408d-a53d-fdeb11aa0b27 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:38.343585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:38.345734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:38.346735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:38.348331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:38.350490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:38.357967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:38.443726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1226/2419] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:38 2022] POST /identity/v3/users => generated 297 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:38.461220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:38.479852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a982c-3a13-4071-b870-743b5387e1b4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:38.490201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:38.495314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:38.495771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:38.497076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:38.498565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:38.502448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:38.519398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1194/2420] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:38.524661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:38.541315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f5e6-48d0-4764-bbcb-36af9a07d62b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:38.548207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:38.549343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:38.549633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:38.550115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:38.550865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:38.557713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f64a5-6b15-43f5-9013-0af5e658fe38 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:38.585884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1227/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:38.592202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:38.624219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6535-cecb-4616-8ee7-a04291d57e47 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:38.634300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:38.638365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:38.638750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:38.639015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] PATH_INFO: `/v3/projects/ce1d3c320b4544ecba3c0d468fd4b979/users/8f51cb73af7746818795c46df2cab295/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:38.698045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1d3c320b4544ecba3c0d468fd4b979, user_id=8f51cb73af7746818795c46df2cab295, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:38.715079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:38.728178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:38.740619 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1195/2422] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:38 2022] PUT /identity/v3/projects/ce1d3c320b4544ecba3c0d468fd4b979/users/8f51cb73af7746818795c46df2cab295/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:38.759572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:38.760455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:38.760455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:38.802928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] MFA Rules not processed for user `8f51cb73af7746818795c46df2cab295`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:38.804359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:38.915684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1228/2423] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:38.922426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.048292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ea77-e004-4e28-8721-de342da0d0b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.056132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.057501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.057945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.059325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.060281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.062523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.109350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1196/2424] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:38 2022] POST /identity/v3/projects => generated 393 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:39.112388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.154682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a49359-fda8-44f3-91a1-218920c31c5f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.333137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.333940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.334226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.334497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.337408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.339778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.424689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.434880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1229/2425] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:39 2022] POST /identity/v3/users => generated 303 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:39.441724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a44607-cc81-4790-80e5-0eaf5974c795 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.458114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.458114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.458358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.458510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.459350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.461197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.488663 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1197/2426] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:39.493349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.498445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:39.507235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5188cd2-ac4d-4428-9ac3-d6e9bc5d4500 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.523540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.524527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.524771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.525088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] PATH_INFO: `/v3/projects/e44f30589a6b493294cb5886025933c2/users/ccb03b5980de4ebe8c3be60d46bfe8ab/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.568423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44f30589a6b493294cb5886025933c2, user_id=ccb03b5980de4ebe8c3be60d46bfe8ab, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.573046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.612942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1230/2427] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:39 2022] PUT /identity/v3/projects/e44f30589a6b493294cb5886025933c2/users/ccb03b5980de4ebe8c3be60d46bfe8ab/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:39.613157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.632115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb42f3-1b02-4636-96d7-c959d9194074 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.791769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.792445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.792708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.793013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.793853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.795810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339a47c-78d1-46fe-8d74-edc56b16c021 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.838696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:39.839879 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1198/2428] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:39.853908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e280-f986-4c57-afcc-7bbb1549409c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:39.862058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:39.862750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.863483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.863778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] PATH_INFO: `/v3/projects/e44f30589a6b493294cb5886025933c2/users/ccb03b5980de4ebe8c3be60d46bfe8ab/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.866554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44f30589a6b493294cb5886025933c2, user_id=ccb03b5980de4ebe8c3be60d46bfe8ab, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:39.869593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeb942-055c-4190-9145-2799837034c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:39.889240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1231/2429] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:39 2022] PUT /identity/v3/projects/e44f30589a6b493294cb5886025933c2/users/ccb03b5980de4ebe8c3be60d46bfe8ab/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:39.897438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.897777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.897984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.931493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:39.931777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:39.932054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:39.934689 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1232/2430] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:39.941470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:52:39.945454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:39.985370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] MFA Rules not processed for user `ccb03b5980de4ebe8c3be60d46bfe8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:39.988163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:40.077673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:40.087569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:40.089093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:40.101197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1199/2431] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:40.205106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fff16-31d0-465a-b27d-ccf0596fbe69 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:40.211611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c4b31e91d0411dbf08869c3640fb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f811cfd351345fd9baf53ebdead0e20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:40.212571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:40.213742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:40.213742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:40.215124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorizing `identity:get_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:40.217936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:40.220399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1233/2432] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:52:39 2022] GET /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 381 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:40.728889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:40.731365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:40.748652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0702b-1f5a-4a2a-8251-63e82a0c5359 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:40.755637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:40.756486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:40.756605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:40.757054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:40.782612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:40.785631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e6d84-8c5d-4d34-a9b8-ff1392da4ff5 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:40.810328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1200/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:41.099089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:41.102091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:41.235359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3caa9d-8e17-4e71-9e8b-92f683089a7b tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:41.255695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:41.256367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:41.256648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:41.256963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] PATH_INFO: `/v3/users/b31f31eb0a7b4c14be4317c2baa47182` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:41.258984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31f31eb0a7b4c14be4317c2baa47182)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:41.261043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:41.264703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:41.369904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31f31eb0a7b4c14be4317c2baa47182'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.370878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31f31eb0a7b4c14be4317c2baa47182'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.382858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31f31eb0a7b4c14be4317c2baa47182'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.399586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31f31eb0a7b4c14be4317c2baa47182'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.400363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31f31eb0a7b4c14be4317c2baa47182'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.472527 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1234/2434] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:41 2022] DELETE /identity/v3/users/b31f31eb0a7b4c14be4317c2baa47182 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:41.476871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:41.477419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:41.477889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:41.534965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:41.536285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:41.575890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:41.578035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:41.667847 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1201/2435] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:41.681020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:41.684653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:41.726135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9f45-1579-4b56-b444-59938619fe36 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:41.741779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:41.742765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:41.743206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:41.743637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] PATH_INFO: `/v3/users/8f51cb73af7746818795c46df2cab295` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:41.747311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f51cb73af7746818795c46df2cab295)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:41.749618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:41.804963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291dcd-74e5-41a2-9f1f-f373bc492499 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:41.810325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:41.811001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:41.811280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:41.811547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:41.827917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:41.829432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9c06c-afac-4afd-82d3-185d803525ad service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:41.845595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1202/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:52:41.849890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f51cb73af7746818795c46df2cab295'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.851660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f51cb73af7746818795c46df2cab295'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.865885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f51cb73af7746818795c46df2cab295'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.877538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f51cb73af7746818795c46df2cab295'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.878469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f51cb73af7746818795c46df2cab295'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:41.897428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:41.903188 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1235/2437] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:41 2022] DELETE /identity/v3/users/8f51cb73af7746818795c46df2cab295 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:41.908814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cca9-d709-480f-be33-be97df5be55c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:41.908814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cca9-d709-480f-be33-be97df5be55c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:41.909990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5cca9-d709-480f-be33-be97df5be55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:41.939922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1cd5cca9-d709-480f-be33-be97df5be55c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:41.941737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1cd5cca9-d709-480f-be33-be97df5be55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:42.100377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1203/2438] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:42.123024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:42.125637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:42.241934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032270f-1580-4a50-aeaf-1cb8b8158253 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:42.249024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:42.249731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:42.250074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:42.250410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:42.264017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:42.265693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:42.281076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1236/2439] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:42.582059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a879-da37-4292-9026-262da456f773 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:42.582983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a879-da37-4292-9026-262da456f773 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:42.583407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494a879-da37-4292-9026-262da456f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:42.635213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:42.635644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f494a879-da37-4292-9026-262da456f773 None None] MFA Rules not processed for user `a7e06c8681bd48ce9422147f306cd27c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:42.636881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:42.641305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f494a879-da37-4292-9026-262da456f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:42.663790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aacb0-8121-4c50-b7b5-74e50555a02b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:42.685823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:42.689614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:42.689892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:42.690145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] PATH_INFO: `/v3/projects/9db49c69ff8648759c5d61d8b149dedd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:42.694451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db49c69ff8648759c5d61d8b149dedd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:42.702381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:42.780419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:42.830074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db49c69ff8648759c5d61d8b149dedd', 'request_id': 'req-b54cfaff-1d90-45a6-989b-adfd52c81c85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:42.854052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db49c69ff8648759c5d61d8b149dedd', 'request_id': 'req-b54cfaff-1d90-45a6-989b-adfd52c81c85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:42.872672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db49c69ff8648759c5d61d8b149dedd', 'request_id': 'req-b54cfaff-1d90-45a6-989b-adfd52c81c85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:42.899227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] The token cache is being invalidate because project 9db49c69ff8648759c5d61d8b149dedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:42.899610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:42.900955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1204/2440] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:42.905730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:42.910169 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1237/2441] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:42 2022] DELETE /identity/v3/projects/9db49c69ff8648759c5d61d8b149dedd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:42.913587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494a879-da37-4292-9026-262da456f773 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:42.930124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494a879-da37-4292-9026-262da456f773 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:43.051556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:43.053614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:43.085725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:43.087556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:43.088104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:43.088551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] PATH_INFO: `/v3/users/58c4b31e91d0411dbf08869c3640fb95` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:43.094095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c4b31e91d0411dbf08869c3640fb95)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:43.096117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:43.215416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfaff-1d90-45a6-989b-adfd52c81c85 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:43.232765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c4b31e91d0411dbf08869c3640fb95'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.234897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c4b31e91d0411dbf08869c3640fb95'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.237067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c4b31e91d0411dbf08869c3640fb95'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.240917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:43.241768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:43.242353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:43.243724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] PATH_INFO: `/v3/projects/ce1d3c320b4544ecba3c0d468fd4b979` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:43.248313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1d3c320b4544ecba3c0d468fd4b979)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:43.251492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:43.253862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c4b31e91d0411dbf08869c3640fb95'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.281303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c4b31e91d0411dbf08869c3640fb95'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.338097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:43.339128 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1205/2442] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:42 2022] DELETE /identity/v3/users/58c4b31e91d0411dbf08869c3640fb95 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:43.363820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1d3c320b4544ecba3c0d468fd4b979', 'request_id': 'req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.377518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1d3c320b4544ecba3c0d468fd4b979', 'request_id': 'req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.392937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1d3c320b4544ecba3c0d468fd4b979', 'request_id': 'req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.421127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] The token cache is being invalidate because project ce1d3c320b4544ecba3c0d468fd4b979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:43.421420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.422985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.428794 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1238/2443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:43 2022] DELETE /identity/v3/projects/ce1d3c320b4544ecba3c0d468fd4b979 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:43.443914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:43.451125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:43.576766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:43.615953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d993-b741-4941-833a-d25ef8261b43 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:43.709887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:43.710823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:43.711102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:43.711455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] PATH_INFO: `/v3/users/ccb03b5980de4ebe8c3be60d46bfe8ab` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:43.712954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb03b5980de4ebe8c3be60d46bfe8ab)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:43.715531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:43.837362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb03b5980de4ebe8c3be60d46bfe8ab'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.841235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb03b5980de4ebe8c3be60d46bfe8ab'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.844057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb03b5980de4ebe8c3be60d46bfe8ab'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.864669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb03b5980de4ebe8c3be60d46bfe8ab'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.883613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d279c9b-429e-4a1a-aa20-3ba3342609ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb03b5980de4ebe8c3be60d46bfe8ab'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:43.932571 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1206/2444] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:43 2022] DELETE /identity/v3/users/ccb03b5980de4ebe8c3be60d46bfe8ab => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:44.265660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:44.267572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:44.287137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0fc0-3d57-43f1-9e6f-45a56788dc5f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:44.415459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:44.416106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:44.416379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:44.416654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] PATH_INFO: `/v3/projects/7f811cfd351345fd9baf53ebdead0e20` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:44.419272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f811cfd351345fd9baf53ebdead0e20)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:44.420288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:44.514946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f811cfd351345fd9baf53ebdead0e20', 'request_id': 'req-548178be-b92b-4d37-a4c1-d5cf6950fd37'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:44.531579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f811cfd351345fd9baf53ebdead0e20', 'request_id': 'req-548178be-b92b-4d37-a4c1-d5cf6950fd37'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:44.559246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f811cfd351345fd9baf53ebdead0e20', 'request_id': 'req-548178be-b92b-4d37-a4c1-d5cf6950fd37'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:44.593307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] The token cache is being invalidate because project 7f811cfd351345fd9baf53ebdead0e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:44.593997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:44.594996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:44.598014 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1239/2445] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:44 2022] DELETE /identity/v3/projects/7f811cfd351345fd9baf53ebdead0e20 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:44.604337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:44.605168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:44.605442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:44.634979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:44.637782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:44.651097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:44.651941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:44.773684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:44.802392 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1207/2446] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:44.803594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:44.811502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:44.843189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548178be-b92b-4d37-a4c1-d5cf6950fd37 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:44.851745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f24d-b326-4d95-a3ea-2cd5bab32dc0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:44.859839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:44.860483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:44.860848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:44.861071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:44.868434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:44.875388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:44.876080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:44.876434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:44.876610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] PATH_INFO: `/v3/projects/e44f30589a6b493294cb5886025933c2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:44.881839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44f30589a6b493294cb5886025933c2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:44.884074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:44.910327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:45.019973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44f30589a6b493294cb5886025933c2', 'request_id': 'req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:45.045091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44f30589a6b493294cb5886025933c2', 'request_id': 'req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:45.062137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44f30589a6b493294cb5886025933c2', 'request_id': 'req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:45.062664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.066484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e2982-e78a-4c34-957c-3e20c69939b9 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.101540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] The token cache is being invalidate because project e44f30589a6b493294cb5886025933c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:45.101540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:45.108707 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1240/2447] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:52:45.114031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.114504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.116495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.121107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2cd11d04-bbbd-4fba-b328-13dc8f8573b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:45.129000 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1208/2448] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:44 2022] DELETE /identity/v3/projects/e44f30589a6b493294cb5886025933c2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:45.134479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aebb7-bfa3-4723-903d-660b38a64448 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.137119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aebb7-bfa3-4723-903d-660b38a64448 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.137628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aebb7-bfa3-4723-903d-660b38a64448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.221389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:45.226600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:45.226752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5f5aebb7-bfa3-4723-903d-660b38a64448 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:45.228237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5f5aebb7-bfa3-4723-903d-660b38a64448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:45.394980 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1209/2449] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:45.434547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1241/2450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:45.439516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.446015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.446592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.449100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.459455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28239-3d25-4781-b3b9-314c17b9d27a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:45.472774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:45.473050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.473277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.473580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.474357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:45.474660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.480213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.512370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:45.516624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:45.525143 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1242/2451] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:45.533034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.548331 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1210/2452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:45.556734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.565286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38577790-9345-4598-b24d-a89a8f638042 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:45.579993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:45.583207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.584594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd734ce-7593-4656-953f-23c2e73ab658 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:45.585446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.586303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.591217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.593609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:45.594855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.596555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.597057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.597867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:45.598410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.600294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.604572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.622976 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1211/2453] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:45.629789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.656214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5f716-0320-42d8-940a-a16b2473350f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:45.670814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:45.672008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.672712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.673634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.676560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.696170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.743746 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1243/2454] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:45.751414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.794255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1212/2455] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:45.798394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:45.906426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:45.915862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:45.920439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e2c1-b3b8-4740-aa68-bdcdd51832c4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:45.927587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:45.929010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:45.929586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:45.930073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:45.931329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:45.934038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f34bf-d311-4058-809f-0d04cce71832 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:45.991727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b49b8-a5a7-4516-840c-c6c9efd2c5ad admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.015781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.016413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.016688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.017563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1213/2456] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:46.019181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.019465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.019732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.020941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.021820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.023538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.071076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1244/2457] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:45 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:46.071076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.089351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] MFA Rules not processed for user `66a05c50f8b744f0b5c22c7a33e88530`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:46.090828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:46.092524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c58db6-991a-457a-9bd5-a13be84efe19 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.101904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.104053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.108188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.108846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.110260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.114550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.156136 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1245/2458] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:46.156136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.185365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f6b4-f2ba-42a5-a64c-46f652b1604e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.207323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.208748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.209285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.210029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.213070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.218040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.238960 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1214/2459] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:46.241033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.258036 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1246/2460] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:46.261726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.268526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d7c57-04a7-4e57-bf00-cc130e3bab52 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.280705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.281639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.282092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.282442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.283470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.285363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.293602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50780062-2cc0-4eec-9952-ed3bcf58fa07 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.303111 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1215/2461] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:46.310911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.312324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.314010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.317936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.318868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.320507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.325132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.335243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5499-fe99-4ddd-ba30-2f2c3e6f84df admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.349542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.349542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.349542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.349542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] PATH_INFO: `/v3/projects/526162623af04412b3a4b1d8da5b3e55/users/c98c3d5d536b4c978ef3c50ad1f82211/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.363775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1247/2462] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:46.370538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.372773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=526162623af04412b3a4b1d8da5b3e55, user_id=c98c3d5d536b4c978ef3c50ad1f82211, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.375586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6c42d-61f5-4e32-a335-0a59e88b33cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.389436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225f046-228c-49ac-a10a-c7e125c0d0d4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.393211 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1216/2463] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:46 2022] PUT /identity/v3/projects/526162623af04412b3a4b1d8da5b3e55/users/c98c3d5d536b4c978ef3c50ad1f82211/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:46.404778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.406714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.406877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.441341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] MFA Rules not processed for user `c98c3d5d536b4c978ef3c50ad1f82211`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:46.443339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:46.508103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.509331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.509835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.510796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] PATH_INFO: `/v3/projects/deda8f2ff6954d0cabba8b9f90ef661d/users/af624e5446534f5290b44cbf6287634f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.541947 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1217/2464] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:46.549074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.562539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=deda8f2ff6954d0cabba8b9f90ef661d, user_id=af624e5446534f5290b44cbf6287634f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.564947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fcfe6-faf1-40bb-b251-310d2407751e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.569465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f836-2030-4b2e-bc4a-91788eeb163b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.577175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.577822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.578110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.578537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.579434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.581353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.582008 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1248/2465] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:46 2022] PUT /identity/v3/projects/deda8f2ff6954d0cabba8b9f90ef661d/users/af624e5446534f5290b44cbf6287634f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:46.586851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.587251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.587402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.612306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:46.613758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:46.621953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1218/2466] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:46 2022] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:46.628381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.683033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:46.746920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1249/2467] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:46.759737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4be14-d307-44e1-9de0-08215f5ccc7b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.765478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.766402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.766806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.767294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.768517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.768714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:46.769425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.771416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.807108 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1219/2468] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:46 2022] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:52:46.811496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.830398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3410c-7d5e-439b-a626-87f8aebe4468 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.836489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:46.837471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.838276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.838582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.838909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.839601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.841633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:46.864529 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1220/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:52:46.869160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:46.893367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b764-f961-428f-9585-b336a102ef07 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.908414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:46.909063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e439a23-4d45-48f5-b548-de5c525cfd43 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:46.909239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:46.909393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:46.909667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] PATH_INFO: `/v3/projects/45cfc3427bc446a68d17787d058bac4f/users/5f0931e7ae174ab9aa1eb60c9c65a541/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:46.956948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cfc3427bc446a68d17787d058bac4f, user_id=5f0931e7ae174ab9aa1eb60c9c65a541, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:46.958615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:47.001462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:47.002196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.002697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.004200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.010277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1221/2470] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:46 2022] PUT /identity/v3/projects/45cfc3427bc446a68d17787d058bac4f/users/5f0931e7ae174ab9aa1eb60c9c65a541/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:47.015039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:47.030599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:47.033005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:47.053485 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1250/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:47.222331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da231388-0da1-4d3e-bf5c-8658381ac981 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:47.229658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:47.231104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.231625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.232166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.233359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:47.236938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd1b3d-7943-4615-9001-04e6f574bee1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:47.259469 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1222/2472] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:47.260365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:47.285468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7c86-249e-4ddd-9cc9-5df967f6fe21 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:47.298386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:47.300714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.301116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.301487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] PATH_INFO: `/v3/projects/45cfc3427bc446a68d17787d058bac4f/users/5f0931e7ae174ab9aa1eb60c9c65a541/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.305057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cfc3427bc446a68d17787d058bac4f, user_id=5f0931e7ae174ab9aa1eb60c9c65a541, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:47.307822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:47.343991 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1251/2473] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:47 2022] PUT /identity/v3/projects/45cfc3427bc446a68d17787d058bac4f/users/5f0931e7ae174ab9aa1eb60c9c65a541/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:47.355963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.356539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.357094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.462059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] MFA Rules not processed for user `5f0931e7ae174ab9aa1eb60c9c65a541`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:47.472538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:47.819789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:47.843668 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1223/2474] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:47.855740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:47.858133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:48.035913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746fe08-2f1c-4344-b2b7-46c408d3e106 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:48.053421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:48.054207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.054817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.055986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.068949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:48.070800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1543b-d69a-4bba-8811-a21e9020879d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:48.083550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1252/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:48.258525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:48.358327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313283-18f3-4511-b845-0332e2813bcd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:48.364224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:48.365001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.365211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.365483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] PATH_INFO: `/v3/users/c98c3d5d536b4c978ef3c50ad1f82211` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.366859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98c3d5d536b4c978ef3c50ad1f82211)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:48.368826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:48.469846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98c3d5d536b4c978ef3c50ad1f82211'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:48.470823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98c3d5d536b4c978ef3c50ad1f82211'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:48.471914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98c3d5d536b4c978ef3c50ad1f82211'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:48.491952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98c3d5d536b4c978ef3c50ad1f82211'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:48.530633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98c3d5d536b4c978ef3c50ad1f82211'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:48.569860 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1224/2476] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:48 2022] DELETE /identity/v3/users/c98c3d5d536b4c978ef3c50ad1f82211 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:48.575656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.576213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.576645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.659169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:48.660679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:48.792006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:48.845761 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1253/2477] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:48.874468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:48.876199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:48.962089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04006a2-831d-42a2-9fd0-cd0a5faf32cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:48.967849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:48.968762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.969079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.969420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.996617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:48.996617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:49.004644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1225/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:49.800694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:49.804568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:49.858535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9e45-ffd8-4a37-9116-f0951f5451e1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:49.873903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:49.874823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:49.877453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:49.878106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] PATH_INFO: `/v3/projects/526162623af04412b3a4b1d8da5b3e55` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:49.882722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526162623af04412b3a4b1d8da5b3e55)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:49.887696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:49.978251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526162623af04412b3a4b1d8da5b3e55', 'request_id': 'req-108d5320-fcd2-4bcd-8174-198363e0d6b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:49.988324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526162623af04412b3a4b1d8da5b3e55', 'request_id': 'req-108d5320-fcd2-4bcd-8174-198363e0d6b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.002763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526162623af04412b3a4b1d8da5b3e55', 'request_id': 'req-108d5320-fcd2-4bcd-8174-198363e0d6b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.022858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] The token cache is being invalidate because project 526162623af04412b3a4b1d8da5b3e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:50.023270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.024060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.026591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1254/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:49 2022] DELETE /identity/v3/projects/526162623af04412b3a4b1d8da5b3e55 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:50.032701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:50.051456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031ec9-52ee-4cf0-9f77-bc9c5c355dcc service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:50.095257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:50.172948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:50.173623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:50.173903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:50.174360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] PATH_INFO: `/v3/users/5f0931e7ae174ab9aa1eb60c9c65a541` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:50.176485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0931e7ae174ab9aa1eb60c9c65a541)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:50.178645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:50.260927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0931e7ae174ab9aa1eb60c9c65a541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.263090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0931e7ae174ab9aa1eb60c9c65a541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.263997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0931e7ae174ab9aa1eb60c9c65a541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.278540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0931e7ae174ab9aa1eb60c9c65a541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.291933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5ae285a-d460-49bc-bc9f-6e3dc736a989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0931e7ae174ab9aa1eb60c9c65a541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:50.326369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1226/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:52:50 2022] DELETE /identity/v3/users/5f0931e7ae174ab9aa1eb60c9c65a541 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:51.968841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:51.970419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:52.006890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5320-fcd2-4bcd-8174-198363e0d6b6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:52.196406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:52.199084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:52.200594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:52.201382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] PATH_INFO: `/v3/projects/45cfc3427bc446a68d17787d058bac4f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:52.204424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cfc3427bc446a68d17787d058bac4f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:52.215438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:52.337065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cfc3427bc446a68d17787d058bac4f', 'request_id': 'req-f349913f-a7e0-4c96-93a3-6f696f5328d5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:52.354871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cfc3427bc446a68d17787d058bac4f', 'request_id': 'req-f349913f-a7e0-4c96-93a3-6f696f5328d5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:52.368346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cfc3427bc446a68d17787d058bac4f', 'request_id': 'req-f349913f-a7e0-4c96-93a3-6f696f5328d5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:52.419020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] The token cache is being invalidate because project 45cfc3427bc446a68d17787d058bac4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:52:52.421937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:52.428022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f349913f-a7e0-4c96-93a3-6f696f5328d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:52:52.437450 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1255/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:52:51 2022] DELETE /identity/v3/projects/45cfc3427bc446a68d17787d058bac4f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:52:52.443104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:52.443849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:52.443849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:52.486484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:52.487777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:52.654106 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1227/2482] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:52:52.655878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:52.656241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:52.656505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:52.702046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:52.706385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:52.747343 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1256/2483] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:52.752279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:52.767282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaf5c4-4004-4b60-84c8-7195a8c2e0a3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:52.780633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:52.782146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:52.782428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:52.782702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:52.783386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:52:52.785719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:52.791672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:52.836093 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1228/2484] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:52:52.838281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:52.842745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:52.866681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d784a-e78a-4552-b461-9a9fd14e01e4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:52.876671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:52.877369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:52.877648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:52.877918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:52.878558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:52.880698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:52.973103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1257/2485] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:52:52 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:52.975315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:52.990082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b0d1-0cfe-4251-9784-7ae629ef7bb8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:53.056884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:53.109412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:53.111268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.111777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.112343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.113332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:53.115733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:53.150914 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1229/2486] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:52:52 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:52:53.155900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:53.182070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9b05-fe0f-4ae8-a243-4fb7b0b25fb9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:53.192218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:53.193216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.193651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.194074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.194892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:53.197106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:53.211202 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1258/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:52:53.215576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:53.238466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470500c7-1b86-46e4-a8f6-09679af4d9ec admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:53.244148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:53.244861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.245159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.245522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.246138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:53.249206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252cd47-76e8-44bf-8409-b28dc44dafcd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:53.267083 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1230/2488] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:52:53.267978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:53.287525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05955ee6-7b36-4e90-8dae-e54b9c765cec admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:53.295025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:53.296506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.297548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.298126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] PATH_INFO: `/v3/projects/a563769bd6e84594b3837db9d0fdafd4/users/52e08cff441e4fb0b01886d81a7b5ad6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.322932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a563769bd6e84594b3837db9d0fdafd4, user_id=52e08cff441e4fb0b01886d81a7b5ad6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:53.327930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:53.366212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1259/2489] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:52:53 2022] PUT /identity/v3/projects/a563769bd6e84594b3837db9d0fdafd4/users/52e08cff441e4fb0b01886d81a7b5ad6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:52:53.373211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53681c-6420-4135-a429-428b8ef9a2f2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.373493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53681c-6420-4135-a429-428b8ef9a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.373757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53681c-6420-4135-a429-428b8ef9a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.417687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7c53681c-6420-4135-a429-428b8ef9a2f2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:53.418984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7c53681c-6420-4135-a429-428b8ef9a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:53.562158 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1231/2490] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:53.587700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:53.589568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:53.797923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733335-cb11-4d50-9100-7e43a1a70097 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:53.814020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:53.817230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.817786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.818278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.840471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:53.844399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:53.876756 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1260/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:55.144817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4097e1-524d-4f70-b91b-a46be8689140 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:55.145770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4097e1-524d-4f70-b91b-a46be8689140 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:55.146188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4097e1-524d-4f70-b91b-a46be8689140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:55.188694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4b4097e1-524d-4f70-b91b-a46be8689140 None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:55.205541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b4097e1-524d-4f70-b91b-a46be8689140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:55.344584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1232/2492] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:57.174627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:57.176868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:57.287740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4d06-eae9-4793-99af-7ece27f81e63 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:57.295929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:57.297469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:57.298352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:57.298352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:57.301151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:57.360418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:57.406527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:57.411780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:57.439998 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1261/2493] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:01.575480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e7cc-7809-46f4-b7b4-1e15b98255c2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:01.576505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e7cc-7809-46f4-b7b4-1e15b98255c2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:01.577098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e7cc-7809-46f4-b7b4-1e15b98255c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:01.668453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0447e7cc-7809-46f4-b7b4-1e15b98255c2 None None] MFA Rules not processed for user `af624e5446534f5290b44cbf6287634f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:01.672650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0447e7cc-7809-46f4-b7b4-1e15b98255c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:01.803725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:01.870001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1233/2494] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:02.158016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:02.160406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:02.188134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b0ce-f58a-4b55-af46-2ad425a677c6 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:02.199248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:02.199890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:02.200178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:02.200450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:02.222476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:02.224336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:02.248750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1262/2495] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:03.615405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4579a-e917-44c2-9bf7-0cf968ada4bd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:03.616171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4579a-e917-44c2-9bf7-0cf968ada4bd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:03.616171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4579a-e917-44c2-9bf7-0cf968ada4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:03.666237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e8a4579a-e917-44c2-9bf7-0cf968ada4bd None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:03.667980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e8a4579a-e917-44c2-9bf7-0cf968ada4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:03.696848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1234/2496] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:53:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:04.193680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:04.195399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:04.236303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec4c04-1b9d-4d7f-8c4e-48bcee4b3cbc service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:04.243189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:04.244630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:04.246132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:04.246507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:04.263482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:04.265390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:04.301771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1263/2497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:53:05.325292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:05.326169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:05.326768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:05.369544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] MFA Rules not processed for user `52e08cff441e4fb0b01886d81a7b5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:05.372234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:05.499766 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1235/2498] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:05.504174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:05.549567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ad1f-6f9b-44c0-8011-a0076f3a7cb3 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:05.563383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:05.565120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:05.565453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:05.567091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:05.568198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:05.571836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:05.629525 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1264/2499] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:05 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:05.635169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:05.655000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889ba2-1f16-41e5-b24d-cf2966aaa224 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:05.851521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:05.852154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:05.853159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:05.853436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:05.854097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:05.858100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:05.902701 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1236/2500] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:05 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:05.904788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:05.929147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8558cf-3e17-4e0b-8f82-caef99967cc8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:05.941538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:05.942359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:05.942811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:05.943209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:05.944124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:05.946730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:05.967128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:05.976843 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1265/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:06.001040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91350-54a6-4e7f-ba8a-bcf97e4775bf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:06.014358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:06.017148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:06.017567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:06.017845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] PATH_INFO: `/v3/projects/f48609889f6f4df38e301223dbd1ed62/users/35d39c6d11d946f7b2bfc041d7a949b1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:06.062440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48609889f6f4df38e301223dbd1ed62, user_id=35d39c6d11d946f7b2bfc041d7a949b1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:06.069795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:06.099572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:06.108956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1237/2502] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:05 2022] PUT /identity/v3/projects/f48609889f6f4df38e301223dbd1ed62/users/35d39c6d11d946f7b2bfc041d7a949b1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:06.117294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41710-dab0-4a77-91d4-d27a6423ea15 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:06.257486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:06.258805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:06.259645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:06.260153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:06.261611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:06.263937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c2ce0-7591-4f12-8bbb-4f5864123115 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:06.290489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1266/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:06.295309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:06.319078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6d40-4882-42f2-980a-f90c3e0dd803 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:06.328211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:06.330011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:06.330553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:06.331748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] PATH_INFO: `/v3/projects/f48609889f6f4df38e301223dbd1ed62/users/35d39c6d11d946f7b2bfc041d7a949b1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:06.336876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48609889f6f4df38e301223dbd1ed62, user_id=35d39c6d11d946f7b2bfc041d7a949b1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:06.340737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:06.400947 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1238/2504] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:06 2022] PUT /identity/v3/projects/f48609889f6f4df38e301223dbd1ed62/users/35d39c6d11d946f7b2bfc041d7a949b1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:10.474755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:10.475324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:10.475714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:10.546234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] MFA Rules not processed for user `9dc12014773b4f9fb34ff214c07d7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:10.560043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:10.824709 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1267/2505] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:14.492647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:14.494733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:14.552806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:14.646294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9622b-99f2-403c-ab3b-5710795ed78c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:14.656889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:14.658159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:14.658601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:14.659030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:14.662383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:14.677153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:14.679104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33d303-699b-4c53-b4e1-32948430e58b service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:14.694622 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1239/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:16.793507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:16.821413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdac9ac-ea9d-45c1-8e2b-566deedd00dc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:16.836861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:16.838885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:16.839770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:16.840530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:16.844415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:16.869355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:16.872402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815e3d-b7ff-4e5a-8dbb-391315a2b6be service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:16.898981 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1268/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:19.755564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:19.756128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:19.757275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:19.799358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] MFA Rules not processed for user `35d39c6d11d946f7b2bfc041d7a949b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:19.800980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:19.914057 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1240/2508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:19.926594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1f36-ac79-4b58-88b5-0bbc4f72df41 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:19.927199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1f36-ac79-4b58-88b5-0bbc4f72df41 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:19.927291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1f36-ac79-4b58-88b5-0bbc4f72df41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:19.958031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7dff1f36-ac79-4b58-88b5-0bbc4f72df41 None None] MFA Rules not processed for user `52e08cff441e4fb0b01886d81a7b5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:19.960289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7dff1f36-ac79-4b58-88b5-0bbc4f72df41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:19.967555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:20.142522 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1269/2509] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:21.279762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:21.404193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50d79e-3f4a-4849-9313-ec62a49d302a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:21.414103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:21.414855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:21.415297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:21.415632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:21.426971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:21.429813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f76f-566e-40d1-8bb3-1843fcb125d1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:21.469773 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1241/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:27.009032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0e24-bc41-43f8-a6ac-fa43478f9c56 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:27.009860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0e24-bc41-43f8-a6ac-fa43478f9c56 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:27.009860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0e24-bc41-43f8-a6ac-fa43478f9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:27.045219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5c6f0e24-bc41-43f8-a6ac-fa43478f9c56 None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:27.047691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c6f0e24-bc41-43f8-a6ac-fa43478f9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:27.159366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1270/2511] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:30.404640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8482-605c-4c5d-be9d-d896de9725c3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:30.407536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8482-605c-4c5d-be9d-d896de9725c3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:30.407536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8482-605c-4c5d-be9d-d896de9725c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:30.470944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c51b8482-605c-4c5d-be9d-d896de9725c3 None None] MFA Rules not processed for user `d76e0eb51a9b418bb28e81b5ac1520f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:30.473597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c51b8482-605c-4c5d-be9d-d896de9725c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:30.528288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:30.637816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1242/2512] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:37.147229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=46 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:39.317239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.317780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.318694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.320460 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1271/2513] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 09:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:39.362918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.363640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.363640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.389806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:39.391702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:39.402616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1243/2514] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:39.438441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:39.440229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:39.461504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7313-7cfb-48f7-9adf-0dd4dbaa9f2a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:39.469528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:39.470359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.470678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.471662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.482251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:39.484147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:39.496496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1272/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:39.623958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:39.627121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:39.730201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03e109-73f1-4453-a476-60360ca29e05 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:39.736147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:39.736812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.737222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.737592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] PATH_INFO: `/v3/users/af624e5446534f5290b44cbf6287634f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.738927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af624e5446534f5290b44cbf6287634f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:39.741041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:39.845927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af624e5446534f5290b44cbf6287634f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:39.847394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af624e5446534f5290b44cbf6287634f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:39.848168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af624e5446534f5290b44cbf6287634f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:39.876845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af624e5446534f5290b44cbf6287634f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:39.907156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eaae6927-283e-44bd-96da-6b8b8211c172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af624e5446534f5290b44cbf6287634f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:39.940971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1244/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:39 2022] DELETE /identity/v3/users/af624e5446534f5290b44cbf6287634f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:40.554474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:40.587695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d185ff-6196-4f3c-9930-10d42898e0ea service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:40.979486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:40.983967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:40.986712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:40.987456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] PATH_INFO: `/v3/projects/deda8f2ff6954d0cabba8b9f90ef661d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:40.998782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deda8f2ff6954d0cabba8b9f90ef661d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:41.004383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:41.183119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deda8f2ff6954d0cabba8b9f90ef661d', 'request_id': 'req-2e3adb3d-17b0-4363-810c-965f9f152d60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.196146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deda8f2ff6954d0cabba8b9f90ef661d', 'request_id': 'req-2e3adb3d-17b0-4363-810c-965f9f152d60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.212158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deda8f2ff6954d0cabba8b9f90ef661d', 'request_id': 'req-2e3adb3d-17b0-4363-810c-965f9f152d60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.241977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] The token cache is being invalidate because project deda8f2ff6954d0cabba8b9f90ef661d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:41.242492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.243580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e3adb3d-17b0-4363-810c-965f9f152d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.247398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1273/2517] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:40 2022] DELETE /identity/v3/projects/deda8f2ff6954d0cabba8b9f90ef661d => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:41.253390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.254224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.254669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.298517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:41.299857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:41.355182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:41.463678 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1245/2518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:41.475251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:41.475665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.476752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:41.477311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.477593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.497636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136fc1d-6ec8-44f7-9307-e1b7b1993a3c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:41.503982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:41.505875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.506157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.506650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] PATH_INFO: `/v3/users/66a05c50f8b744f0b5c22c7a33e88530` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.508358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a05c50f8b744f0b5c22c7a33e88530)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:41.512421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:41.533489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:41.536034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:41.566524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1274/2519] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:41.569318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:41.594735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfba4-491b-4f21-b0b5-ad1e0841d43e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:41.616300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:41.617017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.617337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.617599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.618593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:41.619128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:41.621881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:41.675992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1275/2520] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:41.682866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:41.686099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a05c50f8b744f0b5c22c7a33e88530'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.687753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a05c50f8b744f0b5c22c7a33e88530'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.689036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a05c50f8b744f0b5c22c7a33e88530'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.708618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a05c50f8b744f0b5c22c7a33e88530'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.710602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5974e4-cf4e-476d-ad46-1e73b29a9b7c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:41.728285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-95595a69-9085-4659-9507-5e67ccc470f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a05c50f8b744f0b5c22c7a33e88530'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:41.729143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:41.729767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.730778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.731046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.731906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:41.735906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:41.786591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1276/2521] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:41 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:53:41.790540 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1246/2522] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:41 2022] DELETE /identity/v3/users/66a05c50f8b744f0b5c22c7a33e88530 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:41.791808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:41.796893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5038-5582-4928-b912-895c29234c88 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:41.797918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:41.800545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5038-5582-4928-b912-895c29234c88 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:41.800873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc5038-5582-4928-b912-895c29234c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:41.850911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-60bc5038-5582-4928-b912-895c29234c88 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:41.854506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-60bc5038-5582-4928-b912-895c29234c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:41.903666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:41.974360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fce1e-26c4-4d4d-a633-b3f6d6b182eb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:42.020521 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1247/2523] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:42.049427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc5038-5582-4928-b912-895c29234c88 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:42.052753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-60bc5038-5582-4928-b912-895c29234c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:42.177767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:42.178901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.179410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.179906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.181230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:42.190493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:42.199986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:42.212076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc5038-5582-4928-b912-895c29234c88 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:42.217152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:42.218047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.218471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.218886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.232426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:42.234565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:42.248750 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1248/2524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:42.255633 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1277/2525] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:41 2022] POST /identity/v3/users => generated 297 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:42.259986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:42.275193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3de94-93a2-443c-9768-526d71556169 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:42.280846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:42.281566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.281851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.282123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.283065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:42.284803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:42.298492 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1249/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:42.304135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:42.320654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3542ae-5c90-4050-b5ef-9dd7f7281471 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:42.330897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:42.331950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.332519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.332894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.334122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:42.337566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d08f4-9198-44d1-a63f-4cfe0547c1e5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:42.379453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1278/2527] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:42.381671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:42.405827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90a20-758d-436f-a09e-ee6b4d732b3d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:42.414948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:42.416102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.416588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.417103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] PATH_INFO: `/v3/projects/1ea35e35fa5d46d88631ebdea3befcfa/users/2d3eb659dfce47439521ebc65c7c7505/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.469305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea35e35fa5d46d88631ebdea3befcfa, user_id=2d3eb659dfce47439521ebc65c7c7505, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:42.476280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:42.515126 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1250/2528] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:42 2022] PUT /identity/v3/projects/1ea35e35fa5d46d88631ebdea3befcfa/users/2d3eb659dfce47439521ebc65c7c7505/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:42.528195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:42.529145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:42.529657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:42.616410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] MFA Rules not processed for user `2d3eb659dfce47439521ebc65c7c7505`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:42.621503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:42.819665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1279/2529] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:42.849670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:42.852554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:42.993351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a90f12-fd3c-4006-992e-72889a09317c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:43.001884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:43.003961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:43.025532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:43.025532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.025532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.029221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.056433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:43.059744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:43.093013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1251/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:43.135932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:43.161754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fdac3-5d7b-47e3-8b93-f7b1f0809753 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:43.176638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:43.177635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.177635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.178791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] PATH_INFO: `/v3/projects/cdc8b6c3e715487293067ca378466ca4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.181025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc8b6c3e715487293067ca378466ca4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:43.182432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:43.243850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc8b6c3e715487293067ca378466ca4', 'request_id': 'req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.250597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc8b6c3e715487293067ca378466ca4', 'request_id': 'req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.263708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc8b6c3e715487293067ca378466ca4', 'request_id': 'req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.279832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] The token cache is being invalidate because project cdc8b6c3e715487293067ca378466ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:43.280130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.280838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.285419 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1280/2531] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:43 2022] DELETE /identity/v3/projects/cdc8b6c3e715487293067ca378466ca4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:43.286659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:43.309397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24e70-4482-47c5-8f54-f9f8ce5439cb service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:43.404272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:43.406717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.406717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.406717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] PATH_INFO: `/v3/users/2ac52977718e4fadbac8a3a1e410a1ba` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.407053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac52977718e4fadbac8a3a1e410a1ba)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:43.408946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:43.484137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:43.486407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:43.490626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:43.497152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac52977718e4fadbac8a3a1e410a1ba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.499750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac52977718e4fadbac8a3a1e410a1ba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.500857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac52977718e4fadbac8a3a1e410a1ba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.502783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ee8e-71fd-4df9-9e51-cc3e5a6e25c9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:43.509247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:43.509899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.510179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.510450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] PATH_INFO: `/v3/users/2d3eb659dfce47439521ebc65c7c7505` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.513150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3eb659dfce47439521ebc65c7c7505)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:43.515565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:43.516205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac52977718e4fadbac8a3a1e410a1ba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.527528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfb5bbb9-cda3-47b0-a0f5-df8df4966c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac52977718e4fadbac8a3a1e410a1ba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.560668 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1252/2532] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:43 2022] DELETE /identity/v3/users/2ac52977718e4fadbac8a3a1e410a1ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:43.613972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3eb659dfce47439521ebc65c7c7505'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.615023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3eb659dfce47439521ebc65c7c7505'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.641711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3eb659dfce47439521ebc65c7c7505'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.662822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3eb659dfce47439521ebc65c7c7505'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.663714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3eb659dfce47439521ebc65c7c7505'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:43.695963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1281/2533] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:43 2022] DELETE /identity/v3/users/2d3eb659dfce47439521ebc65c7c7505 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:43.703267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.704042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.704582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.728831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:43.730759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:43.836348 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1253/2534] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:43.850663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:43.852409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:43.933709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8d4f4-5b64-4799-af5f-26625cbc3d4f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:43.938128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:43.938940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:43.939321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:43.939694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:43.948288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:43.951920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:43.953888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e67-7e92-48a6-8493-de8332502ec8 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:43.970182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1282/2535] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:53:44.239731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.241824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.255546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b4c5-315c-4c4f-8b5e-7ae1dc817d70 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.262376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.263157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.263476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.263749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] PATH_INFO: `/v3/projects/5531e84096ee46eabd5df958c2eeba45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.266213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5531e84096ee46eabd5df958c2eeba45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.268125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.336860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5531e84096ee46eabd5df958c2eeba45', 'request_id': 'req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.346581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5531e84096ee46eabd5df958c2eeba45', 'request_id': 'req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.356881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5531e84096ee46eabd5df958c2eeba45', 'request_id': 'req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.373167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] The token cache is being invalidate because project 5531e84096ee46eabd5df958c2eeba45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:44.373797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.374865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a4283f2f-ddc1-4385-87e4-052c8b54e3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.376644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1254/2536] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:44 2022] DELETE /identity/v3/projects/5531e84096ee46eabd5df958c2eeba45 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:44.381421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.381778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.382124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.404777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:44.406194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.493837 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1283/2537] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:44.499642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.499916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.500188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.513726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.515251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.529413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b744-866d-4d3d-bc02-31eb78292631 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.534106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:44.535708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.535835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.536405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.536686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.536993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] PATH_INFO: `/v3/projects/1ea35e35fa5d46d88631ebdea3befcfa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.538659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea35e35fa5d46d88631ebdea3befcfa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.540595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.547647 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1255/2538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:44.553014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.570082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea3a1f-07a8-4fe6-95c2-e962af3176b5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.576389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.577344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.577628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.577917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.578611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:44.579108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.580846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.595594 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1256/2539] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:44.600919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.612387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f685f-6698-468c-9297-b7547084b981 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.617077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea35e35fa5d46d88631ebdea3befcfa', 'request_id': 'req-d6a4d269-a722-4dac-8383-1d20936dcbcc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.624255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea35e35fa5d46d88631ebdea3befcfa', 'request_id': 'req-d6a4d269-a722-4dac-8383-1d20936dcbcc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.633081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea35e35fa5d46d88631ebdea3befcfa', 'request_id': 'req-d6a4d269-a722-4dac-8383-1d20936dcbcc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.635699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:44.645553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] The token cache is being invalidate because project 1ea35e35fa5d46d88631ebdea3befcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:44.646156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.646749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6a4d269-a722-4dac-8383-1d20936dcbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:44.648360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1284/2540] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:44 2022] DELETE /identity/v3/projects/1ea35e35fa5d46d88631ebdea3befcfa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:44.654265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a05d-d075-44bd-9720-0e9ea9a369b8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.654697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a05d-d075-44bd-9720-0e9ea9a369b8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.655103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a05d-d075-44bd-9720-0e9ea9a369b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.679302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c641a05d-d075-44bd-9720-0e9ea9a369b8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:44.681054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c641a05d-d075-44bd-9720-0e9ea9a369b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.704686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.705439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.705791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.706133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.707118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.708836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.746003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1257/2541] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:44.750275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.752137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.781343 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1285/2542] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:44.783945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.784235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.784505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.819571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:44.820837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:44.833677 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1286/2543] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:44.835400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.842107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb84a76-10c3-42c0-a75c-f65dc9f0935e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.846099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940a757-4f48-4a0d-a226-e98d11e827bb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.846977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.847594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.847875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.848141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.848772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.850727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.851138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.851666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.851999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.852203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.852844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:44.853171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.854901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.866163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:44.870490 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1287/2544] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:53:44.876373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.882031 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1258/2545] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:44.883352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.898504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374daef0-cdf7-4c26-93ec-b3ebf7951c21 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.905158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.905823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.906051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.906394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.906952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.907607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf293fb-7ee6-4964-87e0-f88cfa110053 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:44.909012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.916073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:44.917309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:44.917886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:44.918455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:44.920300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:44.923178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:44.944328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1288/2546] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:44.950074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1259/2547] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:53:44.950261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.954105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:44.967012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed7ea5-416d-4d7c-99e9-1b9a2cec1378 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.056618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4fdd-8e3d-4de3-95ee-90d2ca91b9aa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.060478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.061592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.062104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.062608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.064010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.064397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.065645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.066333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.066807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.067347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.067903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.070729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.093074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1260/2548] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:45.096503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.119616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1289/2549] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:44 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:45.121685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.123901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0260-7bd4-41de-a153-888e3cc60ee3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.136028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc0a1-18e2-46be-b6bb-454fcf8474de admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.136769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.137664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.138149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.138635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] PATH_INFO: `/v3/projects/3a2f103bd54042fda441f92422cc0ee9/users/0e13fad6a01d458ca587da1818138abf/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.142144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.142822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.143109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.143380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.144038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.145742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.161173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1290/2550] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:45.162256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.172261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2f103bd54042fda441f92422cc0ee9, user_id=0e13fad6a01d458ca587da1818138abf, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.175888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3c4e2-c978-4a21-a19b-b9762b174043 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.177923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be498-a675-4644-879a-bf6a90640d18 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.187762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.188804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.191484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.191484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.191484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.193405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.203587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:45.208944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1291/2551] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:45.213328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1261/2552] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:45 2022] PUT /identity/v3/projects/3a2f103bd54042fda441f92422cc0ee9/users/0e13fad6a01d458ca587da1818138abf/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:45.214468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.228108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.229343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.230429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.255174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a72bc-a913-418c-9b80-92aa612ff5a3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.288426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] MFA Rules not processed for user `0e13fad6a01d458ca587da1818138abf`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:45.291057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.354715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.355846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.356130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.356412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] PATH_INFO: `/v3/projects/f80fef68c5b24dc8b5340141bc1f837d/users/dbd28dab6bef44c28e487a58cc99cb5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.376351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80fef68c5b24dc8b5340141bc1f837d, user_id=dbd28dab6bef44c28e487a58cc99cb5c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.379720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287185b0-44a6-442e-9aea-262b76f1de17 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.401021 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1262/2553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:45.402091 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1292/2554] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:45 2022] PUT /identity/v3/projects/f80fef68c5b24dc8b5340141bc1f837d/users/dbd28dab6bef44c28e487a58cc99cb5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:45.412273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.415106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.415610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.416145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.441181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0cf2-37c9-4482-ac9a-4c266c150841 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.453586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] MFA Rules not processed for user `dbd28dab6bef44c28e487a58cc99cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:45.455471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.477346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:45.547976 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1293/2555] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:45.548644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.552066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.556374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.557113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.557582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.557955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.559600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.570973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.617646 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1263/2556] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:45 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:53:45.617646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.619391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.692052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9d80-8808-4ac9-a306-77a8c2f1c9fe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.732597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04344ac-a436-47f7-ad95-4a9f30f5114a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.737182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.737977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.738335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.738683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.785782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:45.822921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.824367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.824512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.825018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.825409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.826566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.828326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.853918 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1264/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:45.857118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:45.897282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:45.913105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.914846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:45.928748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1294/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:45.977084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee51b1-6a4a-4994-b46e-abbe29f75b27 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:45.984558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:45.985426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.985884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.986201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.986807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:45.988772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.022566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1265/2559] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:45 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:46.028323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.048811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c3bd-3cae-4f0a-bc1b-3d2abe75eef2 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.055794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.056424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.056703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.057042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.057666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.059311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.071559 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1295/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:46.077408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.088374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a5de-f8b7-4188-9521-a79d75e73038 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.095499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.096202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.096483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.096758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] PATH_INFO: `/v3/projects/2014ddc9c6e949318fb7307634d5fd36/users/8a4ad557d1d842c6a5b063b398a13a6b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.117258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2014ddc9c6e949318fb7307634d5fd36, user_id=8a4ad557d1d842c6a5b063b398a13a6b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.122896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.139707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1266/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:46 2022] PUT /identity/v3/projects/2014ddc9c6e949318fb7307634d5fd36/users/8a4ad557d1d842c6a5b063b398a13a6b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:46.143576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.156871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab9a37-4104-4ab2-8874-ec27cd79e462 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.270531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.271149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.271423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.271687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.272327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.274052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90a774-6e22-4ad7-a02e-df7fa880ede5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.296772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.304593 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1296/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:53:46.311789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866eaf8-4cd2-4bd9-bc8b-0916365578c1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.318862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.319911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.320190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.320458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] PATH_INFO: `/v3/projects/2014ddc9c6e949318fb7307634d5fd36/users/8a4ad557d1d842c6a5b063b398a13a6b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.324552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2014ddc9c6e949318fb7307634d5fd36, user_id=8a4ad557d1d842c6a5b063b398a13a6b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.342130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.365673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1267/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:46 2022] PUT /identity/v3/projects/2014ddc9c6e949318fb7307634d5fd36/users/8a4ad557d1d842c6a5b063b398a13a6b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:46.376972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.377304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.377477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.414053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] MFA Rules not processed for user `8a4ad557d1d842c6a5b063b398a13a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:46.416579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:46.508419 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1297/2564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:46.515598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.528779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84548-4d31-4131-aa14-250fad8ac6c5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.534414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.535030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.535304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.535580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.536329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:46.536685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.538802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.561354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.571531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1268/2565] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:46.576373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687539c-3b99-4719-bf73-4a4dafbaa618 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.591054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.591686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.591964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.592798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.593336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.598712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.658302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1298/2566] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:53:46.660180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.673461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6127c47-7751-47a2-9c97-9c5bdfe1b145 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.816517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.817318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.817600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.817869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.818523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:46.818972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.820771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aa569-80cb-470f-8f9f-54c19ba72ff1 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.845956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1269/2567] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:46.963399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.966016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:47.024369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:47.049839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.050122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.050398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.058068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:47.063096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7110-48a9-4532-a9b6-e5767ae20500 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.069425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.070042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.070325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.070595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.079777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:47.079963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.081275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:47.081425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cd28b-d5e0-461e-b2f1-4336ece91326 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.092668 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1299/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:47.123234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.123518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.123786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.125173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1300/2569] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:47.130136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:53:47.152879 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1270/2570] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:47.155733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.173912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cef9-396c-4369-88b9-db2cdb7c902e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.184805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.185849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.186011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.186285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects/185b02aab0664605b27f84cdf7b357d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.188044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:get_project(project_id=185b02aab0664605b27f84cdf7b357d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.190675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8151b-f779-464f-a0d1-5ed618c64ac2 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.192839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1301/2571] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:53:47 2022] GET /identity/v3/projects/185b02aab0664605b27f84cdf7b357d8 => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:53:47.204021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.205610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:47.301519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651fee8-4ff7-461c-ba07-4a061289bc87 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.308634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.309529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.309927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.310300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.322198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.324324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.340983 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1271/2572] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:53:47.596022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b912-8cb8-4a46-82f9-195948c24860 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.596301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b912-8cb8-4a46-82f9-195948c24860 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.596574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b912-8cb8-4a46-82f9-195948c24860 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.597925 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1302/2573] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:47.602846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:53:47.615702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.625274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebb6a-b7bc-4089-a9df-c6adb4e6f423 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.629885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.630507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.630786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.631057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects/185b02aab0664605b27f84cdf7b357d8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.632186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:get_project(project_id=185b02aab0664605b27f84cdf7b357d8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.634253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.635907 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1272/2574] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:53:47 2022] GET /identity/v3/projects/185b02aab0664605b27f84cdf7b357d8 => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:47.688790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b912-8cb8-4a46-82f9-195948c24860 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.703393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b912-8cb8-4a46-82f9-195948c24860 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.718355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.719073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.719425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.719770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.720428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:47.720763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.722401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.740264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1303/2575] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:47.742085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.753239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680197-84d0-4c7c-b91a-6902e1199c9b tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.759903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.760516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.760797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.761787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.762455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.765253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da4bf-5792-4fa1-9e60-3bdb26bd4c10 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.793227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1273/2576] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:47 2022] POST /identity/v3/users => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:53:47.797860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:47.811757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49344dd-a39b-434c-a324-f24328107fcb tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:47.817420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:47.818154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:47.818598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:47.818888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:47.819613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:47.819994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:47.822426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:47.836952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1304/2577] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:48.008402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924740-0413-457a-9134-4759db03612b None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.008717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924740-0413-457a-9134-4759db03612b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.009025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924740-0413-457a-9134-4759db03612b None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.010423 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1274/2578] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:48.015762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:53:48.029209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:48.037884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79693-28f4-4d04-a1f7-aadc776a3f90 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:48.042580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:48.043195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.043477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.043752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects/185b02aab0664605b27f84cdf7b357d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.044879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:get_project(project_id=185b02aab0664605b27f84cdf7b357d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:48.047204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:48.048812 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1305/2579] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:53:48 2022] GET /identity/v3/projects/185b02aab0664605b27f84cdf7b357d8 => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:48.365561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cda5-35c8-49b9-a481-2186eed7bcad None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.365949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cda5-35c8-49b9-a481-2186eed7bcad None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.366298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cda5-35c8-49b9-a481-2186eed7bcad None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.367838 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1275/2580] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:48.373178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:53:48.387416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:48.397780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09094e-4c1c-486e-9954-3c2cca7b441d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:48.402635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:48.403267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.403548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.403820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects/185b02aab0664605b27f84cdf7b357d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.404965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:get_project(project_id=185b02aab0664605b27f84cdf7b357d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:48.407039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:48.408681 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1306/2581] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:53:48 2022] GET /identity/v3/projects/185b02aab0664605b27f84cdf7b357d8 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:48.438866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8cda5-35c8-49b9-a481-2186eed7bcad None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:48.452025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8cda5-35c8-49b9-a481-2186eed7bcad None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:48.456635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:48.457300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.457582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.457861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/users/59224bcfc2f642eab39e59216fc0e682` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.473805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=59224bcfc2f642eab39e59216fc0e682)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:48.475782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:48.528081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59224bcfc2f642eab39e59216fc0e682'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.528688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59224bcfc2f642eab39e59216fc0e682'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.529343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59224bcfc2f642eab39e59216fc0e682'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.537869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59224bcfc2f642eab39e59216fc0e682'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.539262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:48.548576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59224bcfc2f642eab39e59216fc0e682'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.570135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1276/2582] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:48 2022] DELETE /identity/v3/users/59224bcfc2f642eab39e59216fc0e682 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:53:48.574706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:48.577856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:48.592631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114254e-4d0c-4a67-bbc0-009d0d965f5d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:48.656199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a4ad557d1d842c6a5b063b398a13a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2014ddc9c6e949318fb7307634d5fd36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:48.656851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.657162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.657434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] PATH_INFO: `/v3/projects/185b02aab0664605b27f84cdf7b357d8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.658614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=185b02aab0664605b27f84cdf7b357d8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:48.660727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:48.714855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185b02aab0664605b27f84cdf7b357d8', 'request_id': 'req-babfc312-09cb-465c-a136-fedcd0da8161'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.723103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185b02aab0664605b27f84cdf7b357d8', 'request_id': 'req-babfc312-09cb-465c-a136-fedcd0da8161'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.736199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185b02aab0664605b27f84cdf7b357d8', 'request_id': 'req-babfc312-09cb-465c-a136-fedcd0da8161'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.754169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:48.760554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] The token cache is being invalidate because project 185b02aab0664605b27f84cdf7b357d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:48.761290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.762837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-babfc312-09cb-465c-a136-fedcd0da8161 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.764803 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1307/2583] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:48 2022] DELETE /identity/v3/projects/185b02aab0664605b27f84cdf7b357d8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:48.771347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:48.772934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:48.840584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fabd-a89a-4af3-b4c1-7d824665eab0 tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:48.898322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:48.898941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.899366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.899462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] PATH_INFO: `/v3/users/0e13fad6a01d458ca587da1818138abf` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:48.900609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e13fad6a01d458ca587da1818138abf)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:48.903110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:48.954432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e13fad6a01d458ca587da1818138abf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.955084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e13fad6a01d458ca587da1818138abf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.955694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e13fad6a01d458ca587da1818138abf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.963044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e13fad6a01d458ca587da1818138abf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.971290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e13fad6a01d458ca587da1818138abf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:48.986278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:48.995473 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1277/2584] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:48 2022] DELETE /identity/v3/users/0e13fad6a01d458ca587da1818138abf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:48.997779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84f188-b2a5-47b8-9e8b-75f8d6483c8e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:48.998136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84f188-b2a5-47b8-9e8b-75f8d6483c8e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:48.998478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84f188-b2a5-47b8-9e8b-75f8d6483c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.019465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8d84f188-b2a5-47b8-9e8b-75f8d6483c8e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:49.020657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8d84f188-b2a5-47b8-9e8b-75f8d6483c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:49.089923 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1308/2585] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:49.097872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:49.099350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:49.168678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37283a90-61c3-49a9-b2ae-8e93213924be admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:49.173611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:49.174256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:49.174533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:49.174804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.194501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:49.196215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:49.206822 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1278/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:49.342761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c053d5-5120-4471-be81-083b0865954d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:49.343158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c053d5-5120-4471-be81-083b0865954d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:49.343639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c053d5-5120-4471-be81-083b0865954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.379613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-33c053d5-5120-4471-be81-083b0865954d None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:49.380676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33c053d5-5120-4471-be81-083b0865954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:49.442261 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1309/2587] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:53:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:49.455282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:49.456699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:49.534246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429d6c-776a-4284-939c-d82db3b51c43 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:49.542658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:49.543406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:49.543760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:49.544099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.558979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:49.560937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:49.578748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1279/2588] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:49.590192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c053d5-5120-4471-be81-083b0865954d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:49.595385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33c053d5-5120-4471-be81-083b0865954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:49.611506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c053d5-5120-4471-be81-083b0865954d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:49.623055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:49.623963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:49.623963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:49.624181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] PATH_INFO: `/v3/projects/3a2f103bd54042fda441f92422cc0ee9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.626641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2f103bd54042fda441f92422cc0ee9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:49.629300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:49.703425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2f103bd54042fda441f92422cc0ee9', 'request_id': 'req-dfb4239e-247e-4f51-9609-8d8002d48b12'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.714232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2f103bd54042fda441f92422cc0ee9', 'request_id': 'req-dfb4239e-247e-4f51-9609-8d8002d48b12'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.726929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2f103bd54042fda441f92422cc0ee9', 'request_id': 'req-dfb4239e-247e-4f51-9609-8d8002d48b12'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.747211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] The token cache is being invalidate because project 3a2f103bd54042fda441f92422cc0ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:49.747583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.749446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.751543 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1310/2589] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:49 2022] DELETE /identity/v3/projects/3a2f103bd54042fda441f92422cc0ee9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:49.756035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:49.786996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaa09d-7dac-496a-955b-45af394c2c44 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:49.870365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:49.871722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:49.872084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:49.872419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] PATH_INFO: `/v3/users/8a4ad557d1d842c6a5b063b398a13a6b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:49.873777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4ad557d1d842c6a5b063b398a13a6b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:49.875804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:49.931486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:49.948626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4ad557d1d842c6a5b063b398a13a6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.950232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4ad557d1d842c6a5b063b398a13a6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.950950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4ad557d1d842c6a5b063b398a13a6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.960390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4ad557d1d842c6a5b063b398a13a6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.969059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3653d23-f334-4614-9de7-3a092c98815a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4ad557d1d842c6a5b063b398a13a6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:49.993474 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1280/2590] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:53:49 2022] DELETE /identity/v3/users/8a4ad557d1d842c6a5b063b398a13a6b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:50.569249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:50.571754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:50.588710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4239e-247e-4f51-9609-8d8002d48b12 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:50.659917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:50.716619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:50.717826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:50.718397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:50.718941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] PATH_INFO: `/v3/projects/2014ddc9c6e949318fb7307634d5fd36` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:50.720942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2014ddc9c6e949318fb7307634d5fd36)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:50.724722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:50.822321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2014ddc9c6e949318fb7307634d5fd36', 'request_id': 'req-8d5ae56c-700b-410f-92b2-4d55b1551748'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:50.829616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2014ddc9c6e949318fb7307634d5fd36', 'request_id': 'req-8d5ae56c-700b-410f-92b2-4d55b1551748'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:50.839858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2014ddc9c6e949318fb7307634d5fd36', 'request_id': 'req-8d5ae56c-700b-410f-92b2-4d55b1551748'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:50.860088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] The token cache is being invalidate because project 2014ddc9c6e949318fb7307634d5fd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:53:50.860525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:50.861377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8d5ae56c-700b-410f-92b2-4d55b1551748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:53:50.863463 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1311/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:50 2022] DELETE /identity/v3/projects/2014ddc9c6e949318fb7307634d5fd36 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:50.882884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:50.883396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:50.883505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:50.910758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:50.912016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:50.996472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1281/2592] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:51.005426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.005426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.006057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.028737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:51.030024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:51.042644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1312/2593] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:51.047857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.059761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2840-d0ef-40fb-a633-c73ba0bdaab5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.067575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.068410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.068758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.069126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.069855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:53:51.070227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.077201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.097552 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1282/2594] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:53:51.098733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.111619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c4b7d-efa3-41a8-aef7-b7f413821307 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.117349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.118126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.118879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.119162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.119818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.123188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.172973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.177183 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1313/2595] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:53:51 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:53:51.190474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49949a0e-fdf3-4568-a813-d7811efc89b9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.321655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.325446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.325899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.326195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.328839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.331041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.415534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.416048 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1283/2596] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:53:51 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:53:51.428431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadf02-4800-4d1b-9c18-9fe9bfad0382 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.446034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.446842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.447243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.447948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.449356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.451171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.470737 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1314/2597] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:53:51.471590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.487328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cd92-a3d5-41bb-9508-e1a92ee04f30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.494268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.494995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.495540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.495828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.496496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.499552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67cb87-e975-4ab2-a0d6-7c3022041281 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.511783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1284/2598] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:53:51.516318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.530436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ae4-bfba-43b1-95b0-852e1575d9be admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.539224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.540179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.540460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.540734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] PATH_INFO: `/v3/projects/70725194c6a84c4a991a8acc16a8bf68/users/a0a8b4be16e0439dbacf9d3c6cfeb527/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.577388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70725194c6a84c4a991a8acc16a8bf68, user_id=a0a8b4be16e0439dbacf9d3c6cfeb527, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.585116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86531-10da-4f7b-8ff9-3fcbfa064d1f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.600776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.601069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.601467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.609774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1315/2599] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:53:51 2022] PUT /identity/v3/projects/70725194c6a84c4a991a8acc16a8bf68/users/a0a8b4be16e0439dbacf9d3c6cfeb527/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:53:51.615021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.615305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.615613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.631106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:51.632315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:51.644815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:51.655928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:51.658264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:51.730373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1285/2600] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:51.749641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:51.755918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.758649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:51.771356 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1316/2601] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:51.783848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:51.787167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:51.914660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba1952-0ff9-4ec2-99f7-9928a05e9625 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.919948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee232-549d-4e8f-b55e-dad30511c3b3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:51.923132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.924470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.925158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.925631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.927722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:51.928400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:51.928738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:51.929107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:51.941661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.943805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c41b7-d0ef-4e25-a18c-3cf6c043fde7 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.950689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:51.953069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6261c-28ad-4ff9-99f4-2ad9e8be5b50 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:51.956065 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1286/2602] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:53:51.972472 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1317/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:52.769658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:52.770115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:52.770495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:52.793777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] MFA Rules not processed for user `dbd28dab6bef44c28e487a58cc99cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:52.795437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:52.906054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1287/2604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:53.610643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca776-8792-4683-967f-b23dfd89dab4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:53.611541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca776-8792-4683-967f-b23dfd89dab4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:53.612077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca776-8792-4683-967f-b23dfd89dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:53.691578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c30ca776-8792-4683-967f-b23dfd89dab4 None None] MFA Rules not processed for user `dbd28dab6bef44c28e487a58cc99cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:53.696285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c30ca776-8792-4683-967f-b23dfd89dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:53.739453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1318/2605] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:00.742690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:00.744618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:00.778122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40f0db-fb7e-4687-afea-efe0155ddc09 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:00.798100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:00.798100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:00.798100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:00.798100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] PATH_INFO: `/v3/users/a7e06c8681bd48ce9422147f306cd27c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:00.801964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e06c8681bd48ce9422147f306cd27c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:00.804191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:00.922948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e06c8681bd48ce9422147f306cd27c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:00.923998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e06c8681bd48ce9422147f306cd27c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:00.924832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e06c8681bd48ce9422147f306cd27c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:00.930469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:00.944287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e06c8681bd48ce9422147f306cd27c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:00.961494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e06c8681bd48ce9422147f306cd27c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:01.016459 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1288/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:00 2022] DELETE /identity/v3/users/a7e06c8681bd48ce9422147f306cd27c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:02.327032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b5b0-8678-49d3-9296-43b05f9f67a0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:02.328180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b5b0-8678-49d3-9296-43b05f9f67a0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:02.328683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b5b0-8678-49d3-9296-43b05f9f67a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:02.362982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4e29b5b0-8678-49d3-9296-43b05f9f67a0 None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:02.365136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4e29b5b0-8678-49d3-9296-43b05f9f67a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:02.496949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:02.498175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1319/2607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:54:02.499316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:02.636935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f93-2ea1-4a86-9bc2-e149f2eadb5a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:02.636935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:02.641334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:02.641334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:02.641334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] PATH_INFO: `/v3/projects/28e5a1214de9496d87b690d38ba80ea4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:02.641684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e5a1214de9496d87b690d38ba80ea4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:02.643709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:02.751748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e5a1214de9496d87b690d38ba80ea4', 'request_id': 'req-793a0617-150d-4c59-8c48-d0bf6795780c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:02.760158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e5a1214de9496d87b690d38ba80ea4', 'request_id': 'req-793a0617-150d-4c59-8c48-d0bf6795780c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:02.774868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e5a1214de9496d87b690d38ba80ea4', 'request_id': 'req-793a0617-150d-4c59-8c48-d0bf6795780c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:02.791197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] The token cache is being invalidate because project 28e5a1214de9496d87b690d38ba80ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:02.792392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:02.793313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-793a0617-150d-4c59-8c48-d0bf6795780c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:02.795456 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1289/2608] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:02 2022] DELETE /identity/v3/projects/28e5a1214de9496d87b690d38ba80ea4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:02.801136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:02.801544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:02.801857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:02.825656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:02.827114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:03.035029 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1320/2609] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:03.044294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.048137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.048664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.096825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:03.102374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:03.129497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1290/2610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:03.130319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.154574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e88a2-b79f-4478-9a9b-3913b9291188 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.173075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.174122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.174648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.175179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.176086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:03.176654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.178627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.207785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1321/2611] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:03.212219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.225504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983404e-2f13-427d-a7b4-e7b7623656a7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.255616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.257992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.258278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.258551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.259241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.261292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.362934 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1291/2612] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:03 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:03.367311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.383186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c131f-db93-42f5-aff0-e4e8c6d9c799 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.440333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:03.551946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.552626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.553126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.553582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.554650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.557029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.617741 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1322/2613] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:03 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:03.620292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.635280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e092dd-3b26-4880-bbd7-6f6746e1e9fa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.640843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.641572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.641856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.642170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.642995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.645734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.662634 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1292/2614] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:03.668078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.685563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110b13-f758-42de-9cad-c7ab41724724 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.702367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.703007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.703375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.703667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.705383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.707450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fed6e-ecdf-48a5-b508-992f3ca35b3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.743953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1323/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:03.746468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:03.767832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2138-d4c4-4653-8394-513bba308fa8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:03.780279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028df239-2834-4680-83e4-e44518648640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:03.781028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028df239-2834-4680-83e4-e44518648640 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.781305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028df239-2834-4680-83e4-e44518648640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.781640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028df239-2834-4680-83e4-e44518648640 admin admin] PATH_INFO: `/v3/projects/57eeba8f69124206b8e6a8c8eb875c6f/users/a21c5e160ca7460d892ce593d4644240/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.823054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028df239-2834-4680-83e4-e44518648640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57eeba8f69124206b8e6a8c8eb875c6f, user_id=a21c5e160ca7460d892ce593d4644240, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:03.826598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028df239-2834-4680-83e4-e44518648640 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:03.830259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:03.854265 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1293/2616] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:03 2022] PUT /identity/v3/projects/57eeba8f69124206b8e6a8c8eb875c6f/users/a21c5e160ca7460d892ce593d4644240/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:03.859886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccad7-7b2d-4956-8035-15901bbbe241 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:03.860071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccad7-7b2d-4956-8035-15901bbbe241 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:03.860343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccad7-7b2d-4956-8035-15901bbbe241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:03.890494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-056ccad7-7b2d-4956-8035-15901bbbe241 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:03.892801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-056ccad7-7b2d-4956-8035-15901bbbe241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:04.101480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1324/2617] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:04.141535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028df239-2834-4680-83e4-e44518648640 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:04.143959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-028df239-2834-4680-83e4-e44518648640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:04.303029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028df239-2834-4680-83e4-e44518648640 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:04.310910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:04.314081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:04.314081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:04.314081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:04.339026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:04.342545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:04.370122 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1294/2618] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:54:06.875335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:06.875956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:06.876173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:06.946266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] MFA Rules not processed for user `a0a8b4be16e0439dbacf9d3c6cfeb527`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:06.949903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:07.259048 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1325/2619] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:07.273590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:07.273590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:07.303141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfabedf-cfed-4c1b-8ec8-b3c18d4915b5 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:07.319780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:07.324584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:07.325339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:07.328526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:07.330264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:07.336502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:07.465931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:07.466162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1295/2620] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:07 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:07.505359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e33c-fd38-4ab7-8b66-6325fd14b03f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:07.572574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:07.633047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:07.633994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:07.634417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:07.634836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:07.635604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:07.638750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:07.678553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1326/2621] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:07 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:07.682437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:07.700735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc712e-be29-4934-8370-534b65ddac7d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:07.711033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:07.712028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:07.712947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:07.712947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:07.713911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:07.717194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:07.734248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1296/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:07.738528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:07.751679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99ea5b-8428-4414-befa-64abc636b35b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:07.759029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:07.759982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:07.760362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:07.760736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] PATH_INFO: `/v3/projects/7b48241597284848959e20d2a6515720/users/473dc363f4c94692a800b039a9ee9304/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:07.785506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b48241597284848959e20d2a6515720, user_id=473dc363f4c94692a800b039a9ee9304, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:07.789291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:07.822716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1327/2623] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:07 2022] PUT /identity/v3/projects/7b48241597284848959e20d2a6515720/users/473dc363f4c94692a800b039a9ee9304/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:07.826683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:07.842422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deecca-451b-4fe2-84e1-23b66861303d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:07.960414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:07.961656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:07.962075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:07.962422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:07.963202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:07.965751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048d5a-a0ce-4eb1-b6e5-bde4611f4e04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:07.990101 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1297/2624] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:07.991145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:08.003633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd5e9-2bc2-4dca-829b-e5f9b0f1f08c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:08.016168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:08.018311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:08.018798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:08.019324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] PATH_INFO: `/v3/projects/7b48241597284848959e20d2a6515720/users/473dc363f4c94692a800b039a9ee9304/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:08.021939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b48241597284848959e20d2a6515720, user_id=473dc363f4c94692a800b039a9ee9304, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:08.031603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70cbec-8e94-4bdb-8104-1ec10abc3d30 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:08.057054 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1328/2625] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:07 2022] PUT /identity/v3/projects/7b48241597284848959e20d2a6515720/users/473dc363f4c94692a800b039a9ee9304/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:54:09.249118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203891-3933-48ab-93f9-5a6e1d1853ea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:09.253058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203891-3933-48ab-93f9-5a6e1d1853ea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:09.253880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203891-3933-48ab-93f9-5a6e1d1853ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:09.316497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3e203891-3933-48ab-93f9-5a6e1d1853ea None None] MFA Rules not processed for user `a21c5e160ca7460d892ce593d4644240`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:09.318654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e203891-3933-48ab-93f9-5a6e1d1853ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:09.413536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:09.466479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1298/2626] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:09.480227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:09.480857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:09.481826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:09.515017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] MFA Rules not processed for user `a21c5e160ca7460d892ce593d4644240`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:09.516263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:09.540964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1329/2627] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:09.561281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1d2ac-0cdd-4df6-95d4-2beeba3ae4eb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:09.562128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1d2ac-0cdd-4df6-95d4-2beeba3ae4eb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:09.562687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1d2ac-0cdd-4df6-95d4-2beeba3ae4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:09.665779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c2b1d2ac-0cdd-4df6-95d4-2beeba3ae4eb None None] MFA Rules not processed for user `a21c5e160ca7460d892ce593d4644240`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:09.671721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c2b1d2ac-0cdd-4df6-95d4-2beeba3ae4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:09.706363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1299/2628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:09.885707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:09.888205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:10.063061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7faf-90f0-4bf0-a641-1097ef18488b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:10.088492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:10.089948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:10.090334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:10.090701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:10.104068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:10.109491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10587-ee1f-4548-a751-bbb93bb805ee service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:10.153043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1330/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:11.765722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019f73-9005-4784-97c5-f3d8d6133c84 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:11.766207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019f73-9005-4784-97c5-f3d8d6133c84 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:11.766207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019f73-9005-4784-97c5-f3d8d6133c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:11.834356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c9019f73-9005-4784-97c5-f3d8d6133c84 None None] MFA Rules not processed for user `a21c5e160ca7460d892ce593d4644240`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:11.835770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9019f73-9005-4784-97c5-f3d8d6133c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:11.873372 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1300/2630] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:14.110542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208601b-b44b-4599-a2fa-afb490bf04a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:14.112275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208601b-b44b-4599-a2fa-afb490bf04a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:14.113487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208601b-b44b-4599-a2fa-afb490bf04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:14.218031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6208601b-b44b-4599-a2fa-afb490bf04a1 None None] MFA Rules not processed for user `a21c5e160ca7460d892ce593d4644240`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:14.220350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6208601b-b44b-4599-a2fa-afb490bf04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:14.243256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1331/2631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:16.430040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:16.431183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:16.431824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:16.461405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] MFA Rules not processed for user `52e08cff441e4fb0b01886d81a7b5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:16.463747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:16.570763 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1301/2632] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:24.170351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:26.553736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=36 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:26.881228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c912-6c7d-457d-9389-60d4924c283e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:26.881683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c912-6c7d-457d-9389-60d4924c283e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:26.881797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8c912-6c7d-457d-9389-60d4924c283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:26.945493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-99c8c912-6c7d-457d-9389-60d4924c283e None None] MFA Rules not processed for user `473dc363f4c94692a800b039a9ee9304`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:26.947262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-99c8c912-6c7d-457d-9389-60d4924c283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:27.077411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1332/2633] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:27.085680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:27.087698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:27.180043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a47468-36ec-4b46-b502-c96d9afbf011 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:27.186768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:27.187764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:27.188259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:27.188964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:27.207530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:27.209637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae3eb8-16e0-48bb-b349-b8c86b81690b service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:27.237373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1302/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:54:37.069320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=34 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:37.220560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=26 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:40.522532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.523746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.524800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.563343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] MFA Rules not processed for user `d76e0eb51a9b418bb28e81b5ac1520f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.565025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.691017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1333/2635] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.805601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0590da-6fbd-4457-8ac0-96ea95807397 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.807403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0590da-6fbd-4457-8ac0-96ea95807397 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.808421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0590da-6fbd-4457-8ac0-96ea95807397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.830950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5b0590da-6fbd-4457-8ac0-96ea95807397 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.832460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b0590da-6fbd-4457-8ac0-96ea95807397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.898967 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1303/2636] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.912632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.914372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.986614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb366-7f0c-49b6-bde4-31c69e9f3d3c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.997678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.998413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.998793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.999723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.010187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.012066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.022213 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1334/2637] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:45.905967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440856-23b5-480a-8707-59fde9d04fbb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.906544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440856-23b5-480a-8707-59fde9d04fbb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.906988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440856-23b5-480a-8707-59fde9d04fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:46.088117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6a440856-23b5-480a-8707-59fde9d04fbb None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:46.090568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6a440856-23b5-480a-8707-59fde9d04fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:46.117287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1304/2638] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:46.296120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:46.310945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aef6d-a1da-42f2-8688-3b4d72b1ef53 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:46.326472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:46.329529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:46.330104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:46.330597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:46.359453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:46.363070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21db6c-f0e4-4071-8ecb-e7d532da7b93 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:46.383749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1335/2639] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:50.880147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.883472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.884027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.982158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] MFA Rules not processed for user `9dc12014773b4f9fb34ff214c07d7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:50.983910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:51.200051 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1305/2640] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:53.004802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:53.006015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:53.006451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:53.090207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] MFA Rules not processed for user `863b399a02b24f68acfbf4575cc3d257`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:53.091595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:53.304395 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1336/2641] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:53.701549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:53.703081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:53.914958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c7d25-395c-4ecd-aefb-bdb78da65747 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:53.941684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:53.944541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:53.945296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:53.946265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] PATH_INFO: `/v3/users/a60610c78b5844f78f3ac3a7d421df53` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:53.949890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60610c78b5844f78f3ac3a7d421df53)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:53.955239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.083246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:54.091631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60610c78b5844f78f3ac3a7d421df53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.092760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60610c78b5844f78f3ac3a7d421df53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.097050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60610c78b5844f78f3ac3a7d421df53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.118433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60610c78b5844f78f3ac3a7d421df53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.135720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60610c78b5844f78f3ac3a7d421df53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.214559 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1306/2642] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:53 2022] DELETE /identity/v3/users/a60610c78b5844f78f3ac3a7d421df53 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:54.717260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.744099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79d08-7077-475e-81fd-07866a6fb04c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.829710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:54.905828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.906930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.910661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.910661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] PATH_INFO: `/v3/projects/2f4dca7afa40438cba45411cead48103` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.911945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4dca7afa40438cba45411cead48103)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.915205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.071628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4dca7afa40438cba45411cead48103', 'request_id': 'req-dd3aa284-caef-4c53-bea0-3e9a29b1397f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.093586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4dca7afa40438cba45411cead48103', 'request_id': 'req-dd3aa284-caef-4c53-bea0-3e9a29b1397f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.112816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4dca7afa40438cba45411cead48103', 'request_id': 'req-dd3aa284-caef-4c53-bea0-3e9a29b1397f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.160173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] The token cache is being invalidate because project 2f4dca7afa40438cba45411cead48103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:55.162054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.163609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.171002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1337/2643] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:54 2022] DELETE /identity/v3/projects/2f4dca7afa40438cba45411cead48103 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:54:55.173567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.175387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:55.213373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6c7e1-2b94-467a-9aa7-fee8f4eb44b2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.380028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.380507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.381012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.381404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] PATH_INFO: `/v3/users/166235c454c143b3981b9ca4e44e5581` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.386374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=166235c454c143b3981b9ca4e44e5581)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.388556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.490052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166235c454c143b3981b9ca4e44e5581'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.491079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166235c454c143b3981b9ca4e44e5581'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.491806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166235c454c143b3981b9ca4e44e5581'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.507917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166235c454c143b3981b9ca4e44e5581'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.523504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7215193-06b5-4b54-a87d-1aff2a2efb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166235c454c143b3981b9ca4e44e5581'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:55.569669 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1307/2644] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:55 2022] DELETE /identity/v3/users/166235c454c143b3981b9ca4e44e5581 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:55.982844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.004214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:56.054694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa284-caef-4c53-bea0-3e9a29b1397f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.194230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.195958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.196500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.196969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] PATH_INFO: `/v3/projects/847a112052f840a89538a8284ec4d0c3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.198677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847a112052f840a89538a8284ec4d0c3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.203312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:56.319195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847a112052f840a89538a8284ec4d0c3', 'request_id': 'req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:56.335973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847a112052f840a89538a8284ec4d0c3', 'request_id': 'req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:56.339830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:56.366433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847a112052f840a89538a8284ec4d0c3', 'request_id': 'req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:56.395269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] The token cache is being invalidate because project 847a112052f840a89538a8284ec4d0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:56.395661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:56.396458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1858694f-a6b9-4aeb-aa47-15fc65dcccf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:56.402831 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1338/2645] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:55 2022] DELETE /identity/v3/projects/847a112052f840a89538a8284ec4d0c3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:54:56.404387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.404872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.405022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.431555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:56.434802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:56.516215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:56.583861 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1308/2646] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:54:56.586069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.586651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.587137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.908475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:56.911960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:56.929750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1339/2647] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:56.932109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.961101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c40a2-ddb3-4adc-a273-cb57ae06beaa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.970105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.971795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.972355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.972808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.974304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:56.975530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.978323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.009715 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1309/2648] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:57.011856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.041678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaabc0-9042-46d2-b442-2e546f856d55 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.072305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.073935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.073935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.073935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.074575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.088296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.177374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1340/2649] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:57 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:57.185966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.205629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790ce98-9ee0-4355-bf00-afb3a0c7c31b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.356081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.357592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.358013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.358463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.359229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.367836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.415705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1310/2650] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:57 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:54:57.420970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.441375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa40a0-28e3-484c-87e1-149d53f2cf6e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.452112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.455689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.459345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.461461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.466626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.474653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.499365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1341/2651] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.500932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.520865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabc5b-6afd-426d-9f9e-c9f7c95c4172 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.531359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.533373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.534372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.535164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.536580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.540326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b5ba5-ecbf-490b-b6aa-25d205085506 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.571241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.582634 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1311/2652] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.600285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179062e-ff04-4dd0-ab35-9e6b5d62c4fa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.610585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.612365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.613215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.614322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] PATH_INFO: `/v3/projects/cd2c6115cdf2430fa42def1053e4b3e0/users/f16c5123d4c441c4af00413afd47d1c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.649392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2c6115cdf2430fa42def1053e4b3e0, user_id=f16c5123d4c441c4af00413afd47d1c1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.658648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.714241 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1342/2653] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:57 2022] PUT /identity/v3/projects/cd2c6115cdf2430fa42def1053e4b3e0/users/f16c5123d4c441c4af00413afd47d1c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:57.740844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.742387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.743194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.864671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] MFA Rules not processed for user `f16c5123d4c441c4af00413afd47d1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:57.868680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:58.112956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1312/2654] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:58.119319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.275361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f20e5a-907b-40b3-97d3-40bddaf23bdc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.303392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.304573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.305131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.305642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.306531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.310048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.386494 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1343/2655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:58 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:58.392590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.414428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7150c5-95d7-4ab3-85ca-2f22f0e93f83 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.549397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:58.645297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.646181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.646600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.647021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.647930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.662223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.715978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1313/2656] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:58 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:58.718062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.738138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8f9-8fd3-47ac-aac4-987c17885d67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.749842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.750490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.750769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.751040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.751737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.753459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.785955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1344/2657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:58.788094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.834801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f247-1458-44dd-a0d4-8cf82dc87d3f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.857078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.858643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.860074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.866318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] PATH_INFO: `/v3/projects/f0236d09efc544b4a292e3315538604f/users/36635e84d65144c09233387208474103/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.915378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0236d09efc544b4a292e3315538604f, user_id=36635e84d65144c09233387208474103, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.920811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.969803 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1314/2658] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:58 2022] PUT /identity/v3/projects/f0236d09efc544b4a292e3315538604f/users/36635e84d65144c09233387208474103/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:58.973903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.996884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5374a0-cba2-406c-8615-d06f4d372337 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:59.113360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:59.131736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:59.137235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:59.137557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:59.137951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:59.138562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:59.140246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc92e9b-d527-4034-946c-bf27dcd752df admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:59.160521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1345/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:54:59.162550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:59.180948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeac29-f2c9-48ed-84a9-acb92366342b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:59.190495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:59.192593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:59.193013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:59.193229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] PATH_INFO: `/v3/projects/f0236d09efc544b4a292e3315538604f/users/36635e84d65144c09233387208474103/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:59.196688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0236d09efc544b4a292e3315538604f, user_id=36635e84d65144c09233387208474103, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:59.199899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:59.215013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1315/2660] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:59 2022] PUT /identity/v3/projects/f0236d09efc544b4a292e3315538604f/users/36635e84d65144c09233387208474103/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:59.228658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:59.229021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:59.229962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:59.276564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] MFA Rules not processed for user `36635e84d65144c09233387208474103`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:59.278173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:59.413793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1346/2661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:54:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:01.279804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.287805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:01.500432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee6047-b01e-47d4-bcb0-095207429c5a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.512623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.513540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.513885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.514095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.534200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.536281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.572278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1316/2662] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:01.618235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.642743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e764a-729e-4a82-a871-874449108e59 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.649387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.650038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.650317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.650584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.657255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:01.775580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.777302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0817c3-5d81-47dc-8548-f66e96009c17 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.788351 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1347/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:03.868505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:03.892580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9a70-9127-4254-81f5-25e1658527a1 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:03.903144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:03.905230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.905984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.906887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:04.041007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:04.043758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76191fd-1792-4468-8876-6d84e659275b service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:04.058227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1317/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:04.463022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:04.464072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:04.464530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:04.488399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] MFA Rules not processed for user `a0a8b4be16e0439dbacf9d3c6cfeb527`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:04.491383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:04.502842 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1348/2665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:09.261338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:09.262231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:09.262675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:09.288719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:09.290392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:09.302125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:09.391922 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1318/2666] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:09.408036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:09.409731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:09.454114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:09.455629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:09.473281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09150e-fb23-47e3-bd51-e2f823ae222a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:09.481222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:09.481996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:09.482508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:09.483034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:09.485492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:09.517135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1eba0-8615-4616-97cd-11698bfbe94c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:09.524014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:09.524804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:09.525202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:09.525565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:09.544275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:09.546464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:09.553124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:09.559614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1349/2667] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:09.593591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:09.596810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:09.621246 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1319/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:11.558087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.560632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.758359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b53557-2932-497f-8c12-d624ec56ab75 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.763932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.768210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.768597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.769008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.778656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.806615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.808628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.834331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1350/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:14.073403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:14.075505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:14.095870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d35-c5e2-48e1-9c24-e09d7606049c service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:14.111797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:14.112738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:14.113210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:14.113644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:14.115683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:14.148850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:14.150598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7f6f-f449-4371-8cef-b138f709e5cd service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:14.165313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1320/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:15.810514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:15.891781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d567d-db4f-4a26-9d8a-440cd4f57b5e service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:15.897491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:15.898408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:15.899236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:15.900007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] PATH_INFO: `/v3/users/f16c5123d4c441c4af00413afd47d1c1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:15.902454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16c5123d4c441c4af00413afd47d1c1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:15.904643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:15.981891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16c5123d4c441c4af00413afd47d1c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:15.982587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16c5123d4c441c4af00413afd47d1c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:15.994495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16c5123d4c441c4af00413afd47d1c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.011731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16c5123d4c441c4af00413afd47d1c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.012536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16c5123d4c441c4af00413afd47d1c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.039415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1351/2671] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:15 2022] DELETE /identity/v3/users/f16c5123d4c441c4af00413afd47d1c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:16.044374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.045029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.045029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.095426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:16.096886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:16.178480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1321/2672] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:16.189175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:16.191056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:16.218835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:16.254212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106f1c-4771-404d-a892-6aafb5d4651d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:16.258384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:16.259003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.259282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.259549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.269840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:16.271300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:16.281763 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1352/2673] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:16.548898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:16.550477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:16.564843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6708c-f9a5-4ae1-ac16-ad27d3fa8975 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:16.577466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:16.578188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.578520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.579222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] PATH_INFO: `/v3/projects/cd2c6115cdf2430fa42def1053e4b3e0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.580494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2c6115cdf2430fa42def1053e4b3e0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:16.582937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:16.651177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:16.664280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2c6115cdf2430fa42def1053e4b3e0', 'request_id': 'req-4528622b-747c-433a-a320-34dab04ceffb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.670187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2c6115cdf2430fa42def1053e4b3e0', 'request_id': 'req-4528622b-747c-433a-a320-34dab04ceffb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.678259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2c6115cdf2430fa42def1053e4b3e0', 'request_id': 'req-4528622b-747c-433a-a320-34dab04ceffb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.690928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] The token cache is being invalidate because project cd2c6115cdf2430fa42def1053e4b3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:16.691329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.692069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.693614 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1322/2674] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:16 2022] DELETE /identity/v3/projects/cd2c6115cdf2430fa42def1053e4b3e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:16.697934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:16.708740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9466-bb55-4baf-a192-e3c4b7a35e35 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:16.772199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:16.772928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.773387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.773655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] PATH_INFO: `/v3/users/36635e84d65144c09233387208474103` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.774828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36635e84d65144c09233387208474103)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:16.776795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:16.824308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36635e84d65144c09233387208474103'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.824964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36635e84d65144c09233387208474103'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.833417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36635e84d65144c09233387208474103'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.840928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36635e84d65144c09233387208474103'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.841697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05ef1624-3d49-419f-bccb-08f8209a40f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36635e84d65144c09233387208474103'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.860210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1353/2675] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:16 2022] DELETE /identity/v3/users/36635e84d65144c09233387208474103 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:17.206220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.207666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:17.222650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528622b-747c-433a-a320-34dab04ceffb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.305251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.306002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.306288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.306559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] PATH_INFO: `/v3/projects/f0236d09efc544b4a292e3315538604f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.308531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0236d09efc544b4a292e3315538604f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.310815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.406710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0236d09efc544b4a292e3315538604f', 'request_id': 'req-3264c895-be85-4de3-a0ef-ef9943cbbd53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.413581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0236d09efc544b4a292e3315538604f', 'request_id': 'req-3264c895-be85-4de3-a0ef-ef9943cbbd53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.427974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0236d09efc544b4a292e3315538604f', 'request_id': 'req-3264c895-be85-4de3-a0ef-ef9943cbbd53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.447202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] The token cache is being invalidate because project f0236d09efc544b4a292e3315538604f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:17.447629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.448195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3264c895-be85-4de3-a0ef-ef9943cbbd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.451254 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1323/2676] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:17 2022] DELETE /identity/v3/projects/f0236d09efc544b4a292e3315538604f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:17.456137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.456540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.457052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.489216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:17.490467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:17.574363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:17.601142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1354/2677] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:17.609752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.609992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.610267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.631519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:17.632747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:17.641123 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1324/2678] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:17.645416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.658687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ac13f-d941-420a-bc17-923c1ca38654 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.666167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.667371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.667648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.667913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.668567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:17.668999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.671016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.687015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1355/2679] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:17.691707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.701490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a715c-3eb4-4323-9821-79c5e86404aa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.707244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.707862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.708132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.708397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.709099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.711004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.747992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1325/2680] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:17 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:17.749494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.764362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c0b02-8909-45bb-8745-0b829cdef171 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.840646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.841359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.841584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.841854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.842481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.844405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.868669 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1356/2681] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:17 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:17.873737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.884139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781227a-f45f-43bd-82f0-89e1e2ab4111 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.889073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.889676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.889939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.890207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.892471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.892471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.906064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1326/2682] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:17.907273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.918069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a649-65dc-40ca-8103-247d9eb2b84a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.924090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.924711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.925031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.925304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.925981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.927691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcd064-6b8e-4a27-aa89-f07ad2db8fae admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.939788 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1357/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:17.944149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.954187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362685-337c-489f-82af-ebd4400db600 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.959725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.960456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.960801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.961164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] PATH_INFO: `/v3/projects/9e979bc5c2a54784beaadf19c870546d/users/85a9346bd12e40b98131b3b62f6a05c7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.976493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e979bc5c2a54784beaadf19c870546d, user_id=85a9346bd12e40b98131b3b62f6a05c7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.980100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.982325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:17.994623 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1327/2684] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:17 2022] PUT /identity/v3/projects/9e979bc5c2a54784beaadf19c870546d/users/85a9346bd12e40b98131b3b62f6a05c7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:18.007046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.007322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.007650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.035023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] MFA Rules not processed for user `85a9346bd12e40b98131b3b62f6a05c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:18.036232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:18.101953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1358/2685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:18.107098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.168730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34ca81-ab39-4eae-b6a1-c5d4b58c8755 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.173816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.174413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.174692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.174971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.175678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.177586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.204836 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1328/2686] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:18 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:18.209462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.221154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c292008-fb2b-4872-b0fe-1f4de1317685 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.261708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:18.283810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.284441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.284719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.285095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.285765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.287760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.313904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1359/2687] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:18 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:18.318160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.328946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76076f-8dd9-4561-b8b2-630d1c6c728f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.334008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.334790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.335076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.336014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.336853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.339039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.351501 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1329/2688] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:18.357236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.369422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920c11-2952-4924-ad28-a41867c1b1ac admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.374503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.375307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.375585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.375851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] PATH_INFO: `/v3/projects/33945a1dda1047649dd0c3b78fda25e9/users/19d56d284c15480a8611126a18045b62/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.404352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33945a1dda1047649dd0c3b78fda25e9, user_id=19d56d284c15480a8611126a18045b62, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.411476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.448257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1360/2689] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:18 2022] PUT /identity/v3/projects/33945a1dda1047649dd0c3b78fda25e9/users/19d56d284c15480a8611126a18045b62/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:18.449562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.469588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a64-ffed-43e2-92f8-1edc895e503c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.569003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.569772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.570116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.570453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.572421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.575090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c3c96-8620-4f7d-be3a-130aca4f124c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.601858 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1330/2690] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:18.603028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.621791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ee78-f8ce-4643-8422-5d276d0440d7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:18.627410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:18.628085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.628360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.628610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] PATH_INFO: `/v3/projects/33945a1dda1047649dd0c3b78fda25e9/users/19d56d284c15480a8611126a18045b62/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.630616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33945a1dda1047649dd0c3b78fda25e9, user_id=19d56d284c15480a8611126a18045b62, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:18.633292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:18.647798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1361/2691] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:18 2022] PUT /identity/v3/projects/33945a1dda1047649dd0c3b78fda25e9/users/19d56d284c15480a8611126a18045b62/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:18.658602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:18.658889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:18.659165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:18.715596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] MFA Rules not processed for user `19d56d284c15480a8611126a18045b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:18.716919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:18.804594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:18.837133 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1331/2692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:18.914877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.916809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.077090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f884-2541-43f2-8db7-2298e2741d5d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.086388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.086388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.086388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.086388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.095239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.097198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.108114 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1362/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:19.176896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.197283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd86c7-2c81-44cf-ab4f-476cb9a0481f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.204249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.204959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.205242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.205517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.302697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.304419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c8c7-73cf-49ad-927b-3deac03722d3 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.315547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1332/2694] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:19.554394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.633802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fd848-cd1e-4fff-81c8-26334ada791f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.638763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.639308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.639579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.639851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] PATH_INFO: `/v3/users/85a9346bd12e40b98131b3b62f6a05c7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.641066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a9346bd12e40b98131b3b62f6a05c7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.643017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.669678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:19.714933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a9346bd12e40b98131b3b62f6a05c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.715656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a9346bd12e40b98131b3b62f6a05c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.728547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a9346bd12e40b98131b3b62f6a05c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.744604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a9346bd12e40b98131b3b62f6a05c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.745457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a9346bd12e40b98131b3b62f6a05c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.768959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1363/2695] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:19 2022] DELETE /identity/v3/users/85a9346bd12e40b98131b3b62f6a05c7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:19.772391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.773105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.773238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.807615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:19.809147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.951425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1333/2696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:19.961644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.963131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:20.082818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232ad00-5a11-4596-b294-9e4e519cd6c6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.093957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.095598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.096103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.096584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.114073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.116518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.136700 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1364/2697] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:20.634782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.637204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:20.650680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e70f-8989-483c-8e5e-574b0cff6a96 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.655979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.656612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.656897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.657197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] PATH_INFO: `/v3/projects/9e979bc5c2a54784beaadf19c870546d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.658687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e979bc5c2a54784beaadf19c870546d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.660256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.710909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e979bc5c2a54784beaadf19c870546d', 'request_id': 'req-94c04557-5fd4-4536-9273-71db94204554'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.717056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e979bc5c2a54784beaadf19c870546d', 'request_id': 'req-94c04557-5fd4-4536-9273-71db94204554'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.726100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e979bc5c2a54784beaadf19c870546d', 'request_id': 'req-94c04557-5fd4-4536-9273-71db94204554'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.738920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] The token cache is being invalidate because project 9e979bc5c2a54784beaadf19c870546d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:20.739297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.740013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.741761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1334/2698] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:20 2022] DELETE /identity/v3/projects/9e979bc5c2a54784beaadf19c870546d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:20.746675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.756948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fa42f-2ce1-46e4-a3de-a57ce5d6c8bb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.817600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.818417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.818694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.818983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] PATH_INFO: `/v3/users/19d56d284c15480a8611126a18045b62` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.820522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d56d284c15480a8611126a18045b62)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.822501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.867709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:20.879632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d56d284c15480a8611126a18045b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.881796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d56d284c15480a8611126a18045b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.891556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d56d284c15480a8611126a18045b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.904783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d56d284c15480a8611126a18045b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.905685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a08e7bb-24fc-448a-8d4c-3d95f5b7b01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d56d284c15480a8611126a18045b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:20.935326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1365/2699] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:20 2022] DELETE /identity/v3/users/19d56d284c15480a8611126a18045b62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:21.497066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.502834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:21.530678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c04557-5fd4-4536-9273-71db94204554 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.541453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:21.644964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.645650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.646118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.646570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] PATH_INFO: `/v3/projects/33945a1dda1047649dd0c3b78fda25e9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.647779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33945a1dda1047649dd0c3b78fda25e9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.653797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.728953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33945a1dda1047649dd0c3b78fda25e9', 'request_id': 'req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:21.737699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33945a1dda1047649dd0c3b78fda25e9', 'request_id': 'req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:21.801355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33945a1dda1047649dd0c3b78fda25e9', 'request_id': 'req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:21.849832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] The token cache is being invalidate because project 33945a1dda1047649dd0c3b78fda25e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:21.850129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:21.850804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7ed2b32-6bcf-4916-8c13-12a4ee533f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:21.853029 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1335/2700] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:21 2022] DELETE /identity/v3/projects/33945a1dda1047649dd0c3b78fda25e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:21.864080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.864080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.864080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.910182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:21.911790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.071663 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1366/2701] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:22.083510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.083775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.084047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.116736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:22.117913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.126652 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1336/2702] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:22.132234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.145966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946ea40-bbfe-4035-bcef-2f65868b062d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.158815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.159897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.160277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.160822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.161709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:22.162182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.164105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.185279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1367/2703] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:22.186011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.208529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c2c7-6bad-4759-bf2d-4a95e3a4ccba None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.215386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.216011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.216292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.216580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.217400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.219725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.296087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.302121 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1337/2704] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:22.315056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83c1e-0e24-456e-8e01-8f73c71613d5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.492136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.492838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.493190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.493415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.494054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.496113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.536009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1368/2705] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:22.540037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.570715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56a6d-797f-47d8-9c57-27ac1e598739 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.593574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.594514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.594948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.595989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.596832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.598769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.624997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1338/2706] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:22.628659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.644966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28643fe-ec2f-4fb1-b0c0-2caf8f6f1856 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.662020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.663277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.667923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.668672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.669311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.670987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22838710-b9dd-497a-a42d-47645662b8ce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.691879 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1369/2707] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:22.695943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.710309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518817d-5427-4eab-8098-adf99d725929 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.716427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.717152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.717431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.717701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] PATH_INFO: `/v3/projects/15bbd559abee4c0ebf98c18efad2303d/users/f13e3b839db9487899daf9bc5c4de493/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.733770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bbd559abee4c0ebf98c18efad2303d, user_id=f13e3b839db9487899daf9bc5c4de493, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.736441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.755069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1339/2708] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:22 2022] PUT /identity/v3/projects/15bbd559abee4c0ebf98c18efad2303d/users/f13e3b839db9487899daf9bc5c4de493/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:22.770706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.770989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.771259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.821173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] MFA Rules not processed for user `f13e3b839db9487899daf9bc5c4de493`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:22.824781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.853096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:22.948965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1370/2709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:22.953539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.010288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:23.051140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ce56-e808-411e-bad2-80f7309646e5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.064160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.065022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.065518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.065827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.068322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.071536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.136290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1340/2710] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/projects => generated 407 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:23.140341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.156382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da777b02-10ec-40cf-a9e0-007b7b01cae9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.303380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.303983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.304286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.304557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.305273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.307968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.331998 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1371/2711] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:23 2022] POST /identity/v3/users => generated 310 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:23.336157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.351237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc061-bedd-4b76-a03d-3b9c2d22b2e2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.357753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.358548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.358921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.359294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.360048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.361886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.378113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1341/2712] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:23.379196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.390058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb41d-8c42-43d1-9eef-74808a6bec51 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.397142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.397815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.398092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.398363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] PATH_INFO: `/v3/projects/e18825598b2344c194fa88dd58c1bfe6/users/1b1ee166d69a4280a0787e34e81c1ae3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.417580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18825598b2344c194fa88dd58c1bfe6, user_id=1b1ee166d69a4280a0787e34e81c1ae3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.420300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.437041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1372/2713] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:23 2022] PUT /identity/v3/projects/e18825598b2344c194fa88dd58c1bfe6/users/1b1ee166d69a4280a0787e34e81c1ae3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:23.442113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.461835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef56cc-b223-4eb1-bd5c-9dfa05dcce19 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.554961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.556022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.556022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.556345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.557081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.559008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a30e1c-4512-4757-956d-28c9dc16bf5c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.579383 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1342/2714] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:23.585800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.599444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca028fc-f0c3-4957-839f-d87faada639e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.612749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.613960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.613960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.614191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] PATH_INFO: `/v3/projects/e18825598b2344c194fa88dd58c1bfe6/users/1b1ee166d69a4280a0787e34e81c1ae3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.619171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18825598b2344c194fa88dd58c1bfe6, user_id=1b1ee166d69a4280a0787e34e81c1ae3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.623989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.646347 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1373/2715] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:23 2022] PUT /identity/v3/projects/e18825598b2344c194fa88dd58c1bfe6/users/1b1ee166d69a4280a0787e34e81c1ae3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:23.648196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.648485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.648763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.691050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] MFA Rules not processed for user `1b1ee166d69a4280a0787e34e81c1ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:23.692354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:23.788816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1343/2716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:23.800889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.802906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:23.946824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:23.953588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808467-a292-4577-8bc9-b0ecaf9754b7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.962763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.963500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.964297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.964516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.974460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.976374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.989796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1374/2717] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:24.077407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:24.091577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0c5d8-bb7c-4f47-a9f9-d988d5c6f124 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:24.097128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:24.097753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.098029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.098299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.138871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:24.180121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:24.181838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8f289-23b2-40dc-9306-86a352e8d786 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:24.195484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1344/2718] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:24 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:24.390409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:24.473395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f172620-35b0-4f3e-80f5-1f63be66d9ae service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:24.478149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:24.478800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.479579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.479851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] PATH_INFO: `/v3/users/f13e3b839db9487899daf9bc5c4de493` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.481051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13e3b839db9487899daf9bc5c4de493)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:24.482989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:24.544531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13e3b839db9487899daf9bc5c4de493'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.545137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13e3b839db9487899daf9bc5c4de493'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.554742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13e3b839db9487899daf9bc5c4de493'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.564690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13e3b839db9487899daf9bc5c4de493'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.565517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13e3b839db9487899daf9bc5c4de493'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.586635 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1375/2719] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:24 2022] DELETE /identity/v3/users/f13e3b839db9487899daf9bc5c4de493 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:24.590967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.591494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.591661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.613213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:24.614527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:24.679595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1345/2720] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:24.690422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:24.691866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:24.756422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c92-e611-4912-b7d2-afa0f106f17c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:24.761947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:24.762843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.763456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.763820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.774831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:24.776314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:24.789235 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1376/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:25.137306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:25.138905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:25.151962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af86a00-00d6-4414-893f-51d20a549715 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:25.170769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:25.171477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:25.171979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:25.171979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] PATH_INFO: `/v3/projects/15bbd559abee4c0ebf98c18efad2303d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:25.173484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15bbd559abee4c0ebf98c18efad2303d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:25.175374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:25.236373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bbd559abee4c0ebf98c18efad2303d', 'request_id': 'req-77731282-bbea-4c6a-8a60-7c2ec84c2576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.242350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bbd559abee4c0ebf98c18efad2303d', 'request_id': 'req-77731282-bbea-4c6a-8a60-7c2ec84c2576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.254971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bbd559abee4c0ebf98c18efad2303d', 'request_id': 'req-77731282-bbea-4c6a-8a60-7c2ec84c2576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.271645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] The token cache is being invalidate because project 15bbd559abee4c0ebf98c18efad2303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:25.271941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.272723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.274545 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1346/2722] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:25 2022] DELETE /identity/v3/projects/15bbd559abee4c0ebf98c18efad2303d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:25.284345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:25.291325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b91ca-7637-45d2-baca-2c018cc9aa28 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:25.306445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:25.364071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:25.364710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:25.365196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:25.365368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] PATH_INFO: `/v3/users/1b1ee166d69a4280a0787e34e81c1ae3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:25.366382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1ee166d69a4280a0787e34e81c1ae3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:25.368385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:25.433491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1ee166d69a4280a0787e34e81c1ae3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.434276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1ee166d69a4280a0787e34e81c1ae3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.444596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1ee166d69a4280a0787e34e81c1ae3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.455705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1ee166d69a4280a0787e34e81c1ae3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.456467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4ed5a076-1819-4db0-977a-597373f7342f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1ee166d69a4280a0787e34e81c1ae3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.479567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1377/2723] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:25 2022] DELETE /identity/v3/users/1b1ee166d69a4280a0787e34e81c1ae3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:25.912171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:25.914340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:25.938843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731282-bbea-4c6a-8a60-7c2ec84c2576 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:25.996478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:26.008392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.009059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.009343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.009619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] PATH_INFO: `/v3/projects/e18825598b2344c194fa88dd58c1bfe6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.010798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18825598b2344c194fa88dd58c1bfe6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.012719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.071700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18825598b2344c194fa88dd58c1bfe6', 'request_id': 'req-33fa235d-edcb-4333-84d4-1c338fa6ff37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:26.080137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18825598b2344c194fa88dd58c1bfe6', 'request_id': 'req-33fa235d-edcb-4333-84d4-1c338fa6ff37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:26.089574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18825598b2344c194fa88dd58c1bfe6', 'request_id': 'req-33fa235d-edcb-4333-84d4-1c338fa6ff37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:26.106798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] The token cache is being invalidate because project e18825598b2344c194fa88dd58c1bfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:26.107104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:26.107757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33fa235d-edcb-4333-84d4-1c338fa6ff37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:26.109532 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1347/2724] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:25 2022] DELETE /identity/v3/projects/e18825598b2344c194fa88dd58c1bfe6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:26.115208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.115494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.115768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.142567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:26.142567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:26.227305 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1378/2725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:26.236210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.236547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.236738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.261081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:26.262247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:26.270862 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1348/2726] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:26.275170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.290176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ceb5f-267e-46a5-8683-c95e6d966619 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.299403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.300450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.300986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.301467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.302645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:26.303012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.305143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.324349 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1379/2727] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:26.330241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.340616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9cce-5e71-4d4a-913d-cdd509788486 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.345595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.346216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.346494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.346784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.347560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.350274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.384248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1349/2728] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:26.387803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.399021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907bb49-03b4-476b-b700-ea4c9fa93940 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.421998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:26.472624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.473162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.473574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.473843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.474517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.476446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.504785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1380/2729] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:26.508717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.519393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57ea1-2856-48f3-93f3-69d5250a42d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.524288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.524894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.525204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.525472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.526685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.528277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.539079 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1350/2730] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:26.544025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.554363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864baa8f-5410-4530-a7a3-2da64fd0e77e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.559210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.559830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.560099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.560365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.561075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.562683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b09b3-7ae4-4bef-9c0e-2fe58d989ee5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.574617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1381/2731] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:26.579034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.591064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c1b6e-cb15-499c-b7dc-f58af858e6e9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.596223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.596972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.597230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.597500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] PATH_INFO: `/v3/projects/7e421f272cf84d0a93bf9caa6f67e4e5/users/b4a37a981593459d998fb81d2537f136/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.614359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e421f272cf84d0a93bf9caa6f67e4e5, user_id=b4a37a981593459d998fb81d2537f136, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.617055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.631975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1351/2732] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:26 2022] PUT /identity/v3/projects/7e421f272cf84d0a93bf9caa6f67e4e5/users/b4a37a981593459d998fb81d2537f136/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:26.643658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.643962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.644364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.674410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] MFA Rules not processed for user `b4a37a981593459d998fb81d2537f136`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:26.675598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:26.746721 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1382/2733] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:26.751439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.840403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dceba-5cbc-43b4-a9a6-0edba759a943 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.847324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.847706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.847706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.847957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.848659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.850661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:26.883182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1352/2734] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:26.889097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:26.905970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d705eb-0b02-4a03-beda-3260ffbc7cd8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:26.978617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:26.979264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:26.979607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:26.979887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:26.980553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:26.982578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.012595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1383/2735] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:26 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:27.016637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.028333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb2f3-9576-4a4c-a574-cc518d306672 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.033150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.033760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.034037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.034304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.034947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.036544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.038017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:27.051028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1353/2736] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:27.054565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.065245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be8a6-edd4-40d1-a128-9fd68b2878c2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.070077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.070753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.071028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.071301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] PATH_INFO: `/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a/users/add9cc52198f4345aa1b582040ed6eb5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.089244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ca6b326ade4f83bdc697cf0b70e30a, user_id=add9cc52198f4345aa1b582040ed6eb5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.092099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.094575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:27.109436 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1384/2737] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:27 2022] PUT /identity/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a/users/add9cc52198f4345aa1b582040ed6eb5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:27.114076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.125664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93282-ce2a-4b9c-b562-9ae000bb1271 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.194230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.194864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.195249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.195587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.196606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.198988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26f54-b1e3-4d81-81ce-51af058b4d89 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.212847 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1354/2738] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:27.217752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.231680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5eb13-390b-49a5-83cb-db2fddd8a990 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.237809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.238609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.238990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.239462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] PATH_INFO: `/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a/users/add9cc52198f4345aa1b582040ed6eb5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.241653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ca6b326ade4f83bdc697cf0b70e30a, user_id=add9cc52198f4345aa1b582040ed6eb5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.245351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.258373 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1385/2739] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:27 2022] PUT /identity/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a/users/add9cc52198f4345aa1b582040ed6eb5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:27.269926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.270212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.270482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.300539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] MFA Rules not processed for user `add9cc52198f4345aa1b582040ed6eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:27.301796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:27.388066 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1355/2740] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:27.399948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.401739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:27.481674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646e137-4ae6-4cd3-b7c8-4748eaabbde9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.491925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.492451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.492739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.493045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.505774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.507561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff2c3-3844-42b4-b8a7-c73d1e512663 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.523726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1386/2741] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:27.997347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:28.080699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f1289-e5cd-46b1-a83c-fe4d748b0c47 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:28.087731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:28.089309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:28.089769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:28.090214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] PATH_INFO: `/v3/users/b4a37a981593459d998fb81d2537f136` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:28.091967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a37a981593459d998fb81d2537f136)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:28.095334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:28.118611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:28.154022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a37a981593459d998fb81d2537f136'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.154708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a37a981593459d998fb81d2537f136'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.155308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a37a981593459d998fb81d2537f136'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.163127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a37a981593459d998fb81d2537f136'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.171721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a37a981593459d998fb81d2537f136'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.194326 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1356/2742] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:27 2022] DELETE /identity/v3/users/b4a37a981593459d998fb81d2537f136 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:28.199195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:28.199484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:28.199775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:28.221989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:28.223216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:28.291019 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1387/2743] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:28.301180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:28.302606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:28.362904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd1d34-a0d7-4711-8f31-a2dbce6e46ee admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:28.367888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:28.368490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:28.368767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:28.369070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:28.378095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:28.379575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:28.390867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1357/2744] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:28.821584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:28.823824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:28.854922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e836-d50a-4dd5-9b1d-104620350bbb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:28.859672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:28.860440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:28.860826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:28.861312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] PATH_INFO: `/v3/projects/7e421f272cf84d0a93bf9caa6f67e4e5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:28.862476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e421f272cf84d0a93bf9caa6f67e4e5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:28.864446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:28.930213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e421f272cf84d0a93bf9caa6f67e4e5', 'request_id': 'req-7f9f6657-771a-43cf-81c4-250028564157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.936529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e421f272cf84d0a93bf9caa6f67e4e5', 'request_id': 'req-7f9f6657-771a-43cf-81c4-250028564157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.939105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:28.950010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e421f272cf84d0a93bf9caa6f67e4e5', 'request_id': 'req-7f9f6657-771a-43cf-81c4-250028564157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.970288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] The token cache is being invalidate because project 7e421f272cf84d0a93bf9caa6f67e4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:28.970288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.970991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:28.976325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1388/2745] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:28 2022] DELETE /identity/v3/projects/7e421f272cf84d0a93bf9caa6f67e4e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:28.977566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:28.987572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1203-7562-4e72-b426-89909d6db82a service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.052433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.053672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.053672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.053672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] PATH_INFO: `/v3/users/add9cc52198f4345aa1b582040ed6eb5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.054982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=add9cc52198f4345aa1b582040ed6eb5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.057005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.105009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:29.112502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add9cc52198f4345aa1b582040ed6eb5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.113515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add9cc52198f4345aa1b582040ed6eb5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.114481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add9cc52198f4345aa1b582040ed6eb5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.123321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add9cc52198f4345aa1b582040ed6eb5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.131639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f18ed0c3-787c-4cf8-bf38-1a1e6de1dbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add9cc52198f4345aa1b582040ed6eb5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.154723 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1358/2746] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:28 2022] DELETE /identity/v3/users/add9cc52198f4345aa1b582040ed6eb5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:29.465451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:29.467002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.484247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6657-771a-43cf-81c4-250028564157 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.546907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.548406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.548680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.548972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] PATH_INFO: `/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.550149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ca6b326ade4f83bdc697cf0b70e30a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.552094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.614982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ca6b326ade4f83bdc697cf0b70e30a', 'request_id': 'req-93b9dfa7-6cac-4541-b62e-69116abc4c74'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.621056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ca6b326ade4f83bdc697cf0b70e30a', 'request_id': 'req-93b9dfa7-6cac-4541-b62e-69116abc4c74'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.629369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ca6b326ade4f83bdc697cf0b70e30a', 'request_id': 'req-93b9dfa7-6cac-4541-b62e-69116abc4c74'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.641602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] The token cache is being invalidate because project 71ca6b326ade4f83bdc697cf0b70e30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:29.641891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.642624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93b9dfa7-6cac-4541-b62e-69116abc4c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:29.645179 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1389/2747] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:29 2022] DELETE /identity/v3/projects/71ca6b326ade4f83bdc697cf0b70e30a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:29.652009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.652280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.652642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.674672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:29.675864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.746356 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1359/2748] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:29.754049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.754401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.755444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.773821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:29.775254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.783419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:29.784648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.810865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1390/2749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:29.811563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:29.814076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.870929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c99795-423f-4693-8ba5-e4c4aced544a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.875631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.876250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.877163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.877591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.880670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.893290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.894786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.905269 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1360/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:29.906293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:29.922152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dc37f-f330-490c-81e5-05f7de0237a0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.926715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.927867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.927867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.928132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.937003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.938669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.939143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc68f-498d-40e8-9a4b-bfec01d93e90 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.951367 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1391/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:29.952775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:29.953981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:29.956474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.957678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.958025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.958289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.958949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:29.959252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.967808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.968783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d863e-50b0-4a4a-aef1-5c0aee109a9b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:29.973924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:29.974845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:29.975247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:29.975613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:29.986137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:29.989802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:29.996632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1361/2752] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:30.002633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.007110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1392/2753] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:30.024420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ace6-4aaa-4587-a044-9ac7b86811b2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.038724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.039367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.041791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.042136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.042984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.047159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.105140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.105566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1362/2754] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:30 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:30.106017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:30.110920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874018cc-27b8-4f2c-a31a-cc3d3d64d2fc service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.195112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.196231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.196551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.196771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.197450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.200038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.224324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1393/2755] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:30 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:30.228509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.240752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9196f18-64a7-4670-976b-aace9d7a1ef4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.246153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.247019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.247302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.256998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.258283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.260972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.291439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1363/2756] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:30.295042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.309188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c477e6-96d7-448e-9e5f-7b44672c9d42 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.314702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.315398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.315744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.316077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.316793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.318485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5514ee-e19f-4ad4-af09-ed02841813c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.330569 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1394/2757] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:30.335865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.348521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4144b-2f8c-4292-965a-3849f6f39f7d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.354870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.355691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.356205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.356548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] PATH_INFO: `/v3/projects/eb664e3d10d64386a14f43c48082a287/users/9c9fefb8ca1148599eb61250f20994c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.373185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:30.377477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb664e3d10d64386a14f43c48082a287, user_id=9c9fefb8ca1148599eb61250f20994c1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.380534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.403629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1364/2758] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:30 2022] PUT /identity/v3/projects/eb664e3d10d64386a14f43c48082a287/users/9c9fefb8ca1148599eb61250f20994c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:30.421037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.421445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.421733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.480733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] MFA Rules not processed for user `9c9fefb8ca1148599eb61250f20994c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:30.482044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:30.577911 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1395/2759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:30.586021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.663493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed777-257b-4ce7-807f-522f8cc479ae admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.670034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.676431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.676431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.676431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.676431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.676431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.711276 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1365/2760] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:30 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:30.711928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.724037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5b5a8-22fb-40c9-a740-e3d9e371a107 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.797835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.798689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.798966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.799233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.799867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.801836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.820378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:30.829330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1396/2761] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:30 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:30.830797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.842307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e888-1971-43e2-b74f-9971ea8f1901 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.847125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.847907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.848190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.848459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.849130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.850779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.862754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1366/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:30.866943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.878903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68bd6-5b4f-43a5-8ec8-a92dda415661 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.883945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.884625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.884931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.885271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] PATH_INFO: `/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd/users/2cab0bda11bf41378f7e9de157e5e10f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.901753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfd4ea839ff40c2ad55011a215e3abd, user_id=2cab0bda11bf41378f7e9de157e5e10f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.904404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:30.919189 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1397/2763] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:30 2022] PUT /identity/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd/users/2cab0bda11bf41378f7e9de157e5e10f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:30.924050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.934519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cff93-d08b-44a2-9d9c-0ae6ba39192e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.997860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.998711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.998972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.999286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.000063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.001778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c468-07ff-4536-88fc-128217ee9f2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.015987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1367/2764] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:31.017251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.028497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3788d-c910-460f-8d30-c49ea7686f99 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.033532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.034546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.034893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.035251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] PATH_INFO: `/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd/users/2cab0bda11bf41378f7e9de157e5e10f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.037301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfd4ea839ff40c2ad55011a215e3abd, user_id=2cab0bda11bf41378f7e9de157e5e10f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.040173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.052084 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1398/2765] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:31 2022] PUT /identity/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd/users/2cab0bda11bf41378f7e9de157e5e10f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:31.064002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.064002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.064002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.091673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] MFA Rules not processed for user `2cab0bda11bf41378f7e9de157e5e10f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:31.092860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:31.143032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:31.165957 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1368/2766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:31.173714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.184656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1f73-593d-479e-a65f-dbe6095188fb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.192276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.193474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.193973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.194352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.195444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:31.195857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.198664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.223760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1399/2767] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:55:31.225269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.242458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8566-a843-462c-b9b2-aeb1559d59de None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.251521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.252154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.252435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.252701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.253376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.255327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.296538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1369/2768] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:31 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:31.298775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.311165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc29255-de01-4d2d-b0a8-90774db63ed6 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.405746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.406364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.406646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.406918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.407563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:31.407869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.409527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f3369-9471-4333-9847-f05e2795c5b2 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.421016 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1400/2769] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:55:31.431002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.432898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:31.539633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341b98-36d0-4638-b780-03bcd1d7556a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.545533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.546140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.546421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.546736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.563165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.564821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.586196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1370/2770] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:31.599630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445d4ee-2287-4111-b846-3cc39f1b2139 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.600005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445d4ee-2287-4111-b846-3cc39f1b2139 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.600345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445d4ee-2287-4111-b846-3cc39f1b2139 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.602722 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1401/2771] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:31.608046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:55:31.620351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.629078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ee190-4fc0-443b-a405-74480027ae5f service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.633908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.634630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.635020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.636079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.637458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:get_project(project_id=95f79b33c5a74aa39aa4ed45e52586b0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.639858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.642597 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1371/2772] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0 => generated 369 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:31.776123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55d89-facd-40e1-a50b-af3b8d2c0a13 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.776490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55d89-facd-40e1-a50b-af3b8d2c0a13 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.776831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55d89-facd-40e1-a50b-af3b8d2c0a13 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.778233 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1402/2773] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:31.783016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:55:31.784772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:31.801181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.810739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424b76-fea7-45bb-9052-0936ea8662fd tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.815742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.816376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.816661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.816950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.818092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:get_project(project_id=95f79b33c5a74aa39aa4ed45e52586b0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.820146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.821903 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1372/2774] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0 => generated 369 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:31.867011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55d89-facd-40e1-a50b-af3b8d2c0a13 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.882338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55d89-facd-40e1-a50b-af3b8d2c0a13 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.888565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.889337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.889464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.889746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.890399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:31.890703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.892299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.912560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1403/2775] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:31.917708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.928723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f040ec-2c98-4efb-86ab-fb1df45798f8 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.934274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.935109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.935363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.935708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.936419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.938550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64c61b-5607-4257-af8c-ce1fd813bf4a tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.967852 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1373/2776] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:31 2022] POST /identity/v3/users => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:31.969180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.980670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7184f8d-6a0b-432f-a3b3-7fd355cf3ff1 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.985955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.986438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.986716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.986991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.988549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:31.988839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.990492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.008271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1404/2777] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:32.040063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630001e2-e9a7-44aa-a181-707cf348ba13 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.040484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630001e2-e9a7-44aa-a181-707cf348ba13 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.042302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630001e2-e9a7-44aa-a181-707cf348ba13 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.044460 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1374/2778] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:32.050261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:55:32.065754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.078541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e9252-deb0-46f1-b1ba-b332834b1807 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.083182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.083860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.084142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.084417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.085567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:get_project(project_id=95f79b33c5a74aa39aa4ed45e52586b0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.087653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.089418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1405/2779] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:55:32 2022] GET /identity/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0 => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:32.269696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9183cc-810b-4074-a99b-c64725e921b1 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.270455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9183cc-810b-4074-a99b-c64725e921b1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.270455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9183cc-810b-4074-a99b-c64725e921b1 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.271666 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1375/2780] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 09:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:55:32.277077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 09:55:32.290514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.300846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc2697-5628-48b7-8bcd-d8e7093b7684 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.305769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.306596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.307131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.308100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.309255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:get_project(project_id=95f79b33c5a74aa39aa4ed45e52586b0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.311322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.313166 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1406/2781] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 09:55:32 2022] GET /identity/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0 => generated 369 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:32.349188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9183cc-810b-4074-a99b-c64725e921b1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.365611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9183cc-810b-4074-a99b-c64725e921b1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.370287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.371247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.371798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.372102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/users/574939b9f36e4a3aaa4622c69df3ad7b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.394551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:delete_user(user_id=574939b9f36e4a3aaa4622c69df3ad7b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.394551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.447678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574939b9f36e4a3aaa4622c69df3ad7b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.448455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574939b9f36e4a3aaa4622c69df3ad7b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.449518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574939b9f36e4a3aaa4622c69df3ad7b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.460400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574939b9f36e4a3aaa4622c69df3ad7b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.472352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:32.477436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574939b9f36e4a3aaa4622c69df3ad7b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.502081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1376/2782] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:32 2022] DELETE /identity/v3/users/574939b9f36e4a3aaa4622c69df3ad7b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:32.506331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.508814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:32.534254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9b8f-8729-442f-abcd-83092a6a9f25 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.622885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cab0bda11bf41378f7e9de157e5e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7dfd4ea839ff40c2ad55011a215e3abd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.623541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.623815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.624084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] PATH_INFO: `/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.625297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorizing `identity:delete_project(project_id=95f79b33c5a74aa39aa4ed45e52586b0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.627239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.629018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:32.686010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f79b33c5a74aa39aa4ed45e52586b0', 'request_id': 'req-1a9373fb-750f-496d-a43f-fc0038d7c0bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.692531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f79b33c5a74aa39aa4ed45e52586b0', 'request_id': 'req-1a9373fb-750f-496d-a43f-fc0038d7c0bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.701366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f79b33c5a74aa39aa4ed45e52586b0', 'request_id': 'req-1a9373fb-750f-496d-a43f-fc0038d7c0bf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.714650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] The token cache is being invalidate because project 95f79b33c5a74aa39aa4ed45e52586b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:32.714931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.715585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a9373fb-750f-496d-a43f-fc0038d7c0bf tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.717225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1407/2783] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:32 2022] DELETE /identity/v3/projects/95f79b33c5a74aa39aa4ed45e52586b0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:32.723214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.724722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:32.797163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8665-1bc3-45b7-801a-d761b01a07b0 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.861393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.862035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.862315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.862584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] PATH_INFO: `/v3/users/9c9fefb8ca1148599eb61250f20994c1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.863759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9fefb8ca1148599eb61250f20994c1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.865696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.928219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9fefb8ca1148599eb61250f20994c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.928949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9fefb8ca1148599eb61250f20994c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.929656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9fefb8ca1148599eb61250f20994c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.945514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9fefb8ca1148599eb61250f20994c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.955743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9fefb8ca1148599eb61250f20994c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.986032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1377/2784] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:32 2022] DELETE /identity/v3/users/9c9fefb8ca1148599eb61250f20994c1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:32.990561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.990852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.991123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:33.011545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:33.013008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:33.099681 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1408/2785] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:33.110093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:33.111602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:33.117122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:33.186619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5764eb-37af-4236-9031-003b9ed390e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:33.192147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:33.193102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:33.193349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:33.193770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:33.218147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:33.219806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:33.230983 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1378/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:33.546747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:33.548452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:33.565513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbaf9e-7cb4-4ffb-bb08-5d50f64d3bd9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:33.571290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:33.571952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:33.572263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:33.572493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] PATH_INFO: `/v3/projects/eb664e3d10d64386a14f43c48082a287` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:33.573716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb664e3d10d64386a14f43c48082a287)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:33.575687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:33.655281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb664e3d10d64386a14f43c48082a287', 'request_id': 'req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.667416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb664e3d10d64386a14f43c48082a287', 'request_id': 'req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.679944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb664e3d10d64386a14f43c48082a287', 'request_id': 'req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.696519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] The token cache is being invalidate because project eb664e3d10d64386a14f43c48082a287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:33.696790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.697454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.699336 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1409/2787] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:33 2022] DELETE /identity/v3/projects/eb664e3d10d64386a14f43c48082a287 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:33.703299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:33.720929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585858d-513a-459b-8424-05cb6214f518 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:33.786882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:33.787515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:33.787792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:33.788058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] PATH_INFO: `/v3/users/2cab0bda11bf41378f7e9de157e5e10f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:33.789210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cab0bda11bf41378f7e9de157e5e10f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:33.791125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:33.838882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cab0bda11bf41378f7e9de157e5e10f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.839610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cab0bda11bf41378f7e9de157e5e10f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.840230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cab0bda11bf41378f7e9de157e5e10f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.848706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cab0bda11bf41378f7e9de157e5e10f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.857020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6731bfaf-cca1-4b67-9da4-3f8bccf0a9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cab0bda11bf41378f7e9de157e5e10f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.873942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1379/2788] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:33 2022] DELETE /identity/v3/users/2cab0bda11bf41378f7e9de157e5e10f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:34.429455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:34.430969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:34.446002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9330b4-9a7a-4e57-9507-5b4831ec50ad admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:34.469633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:34.591356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:34.592080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:34.592380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:34.592603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] PATH_INFO: `/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:34.595013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfd4ea839ff40c2ad55011a215e3abd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:34.597096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:34.661615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfd4ea839ff40c2ad55011a215e3abd', 'request_id': 'req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:34.669092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfd4ea839ff40c2ad55011a215e3abd', 'request_id': 'req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:34.681584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfd4ea839ff40c2ad55011a215e3abd', 'request_id': 'req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:34.699823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] The token cache is being invalidate because project 7dfd4ea839ff40c2ad55011a215e3abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:34.700412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:34.701199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-900b5b4e-aaa5-45f0-a505-0cfa9b5f323c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:34.703187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1410/2789] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:34 2022] DELETE /identity/v3/projects/7dfd4ea839ff40c2ad55011a215e3abd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:34.709841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99716-651f-46b2-9c35-19109153491a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:34.710454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99716-651f-46b2-9c35-19109153491a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:34.710454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99716-651f-46b2-9c35-19109153491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:34.733198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8fa99716-651f-46b2-9c35-19109153491a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:34.734856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8fa99716-651f-46b2-9c35-19109153491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:34.769839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:34.838704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1380/2790] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:34.848218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:34.848820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:34.850221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:34.896638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:34.900149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:34.928424 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1411/2791] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:34.931244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99716-651f-46b2-9c35-19109153491a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:34.952646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99716-651f-46b2-9c35-19109153491a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:34.967841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:34.969076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:34.969363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:34.973352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:34.975761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:34.977706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:34.983011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.028047 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1381/2792] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:35.030403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.049249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2ff10-ec6b-4793-9802-73c4352c0ebf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.059677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.061112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.061811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.062393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.064179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.067004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.110384 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1412/2793] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:35.114881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.129563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a080058-da1e-49d9-ae25-494b1c1a6d57 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.208597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.209308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.209593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.209865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.210708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.213137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.260456 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1382/2794] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:35.264829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.282424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d2b-01b1-440d-9af4-4b8e76df3fb6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.288468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.289788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.290143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.290487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.291216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.293820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.314763 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1413/2795] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:35.316136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.334748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232d030-7651-47e5-bb75-50acea238990 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.341694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.342455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.343898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.344276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.345033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.347913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7b40-14a0-4156-82a4-a161012cf065 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.363878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1383/2796] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:35.368242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.380154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae28181-ef8f-4da2-9d17-02b7e0003a70 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.387873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.389212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.389800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.390317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] PATH_INFO: `/v3/projects/7d2636214d0b430d929ef27e9592488d/users/feb7e91603d6463e9428e71c31efb6b3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.410833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2636214d0b430d929ef27e9592488d, user_id=feb7e91603d6463e9428e71c31efb6b3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.413665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.438609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1414/2797] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:35 2022] PUT /identity/v3/projects/7d2636214d0b430d929ef27e9592488d/users/feb7e91603d6463e9428e71c31efb6b3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:35.450550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.451087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.452188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.499816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] MFA Rules not processed for user `feb7e91603d6463e9428e71c31efb6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:35.501614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:35.630339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1384/2798] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:35.631236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.705194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:35.793507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536a11-b30f-4e54-bcfb-f05c77e65266 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.807079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.807915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.808520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.810144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.810934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.820331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.874334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.877321 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1415/2799] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:35.903035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2666-7d73-4a0b-86e7-11816bae86d5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.922300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:35.971723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.972344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.972621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.972881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.973562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.975553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.002589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1385/2800] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:36.009402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.020894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6becdf3-63dd-410d-bd9b-260f3b0b53fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.025724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.026956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.027141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.027410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.028047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.029729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.040326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1416/2801] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:36.044699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.055282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7f02-b76d-4c88-bda8-dd65d026e6cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.060074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.060723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.061033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.061916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] PATH_INFO: `/v3/projects/310e5f4299b44b4bae3fc3886133251d/users/86693bf0264c4ffaba154dcc9f29673e/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.076524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e5f4299b44b4bae3fc3886133251d, user_id=86693bf0264c4ffaba154dcc9f29673e, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.079242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.092465 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1386/2802] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:36 2022] PUT /identity/v3/projects/310e5f4299b44b4bae3fc3886133251d/users/86693bf0264c4ffaba154dcc9f29673e/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:36.096646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.106524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faee3ba-fbfd-4ab5-80b7-2f7f231fc017 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.162137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.162741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.163019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.163287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.163916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.165565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084abba-8f95-4070-844c-fddca968f538 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.175398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1417/2803] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:36.179548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.191252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab909c-d6c0-4c49-9470-f2c09ed1bae1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.195482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.196121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.196398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.196669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] PATH_INFO: `/v3/projects/310e5f4299b44b4bae3fc3886133251d/users/86693bf0264c4ffaba154dcc9f29673e/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.199219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e5f4299b44b4bae3fc3886133251d, user_id=86693bf0264c4ffaba154dcc9f29673e, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.201886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76985676-0284-410d-a16c-0ea497c4725a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.212068 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1387/2804] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:36 2022] PUT /identity/v3/projects/310e5f4299b44b4bae3fc3886133251d/users/86693bf0264c4ffaba154dcc9f29673e/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:36.222280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.222593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.222927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.250913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] MFA Rules not processed for user `86693bf0264c4ffaba154dcc9f29673e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:36.252126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:36.326988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1418/2805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:36.398616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db75-f479-40f6-8b8c-b03a363af759 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.398902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db75-f479-40f6-8b8c-b03a363af759 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.399204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db75-f479-40f6-8b8c-b03a363af759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.420865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e4e6db75-f479-40f6-8b8c-b03a363af759 None None] MFA Rules not processed for user `feb7e91603d6463e9428e71c31efb6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:36.422276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4e6db75-f479-40f6-8b8c-b03a363af759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:36.488063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1388/2806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:36.500096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.501601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:36.543448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:36.580873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eab71-9301-4748-a3be-2235c05a87dc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.590265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.590880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.591158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.591427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.600193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.601751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.611590 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1419/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:36.991760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.992347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.992347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:37.021142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] MFA Rules not processed for user `feb7e91603d6463e9428e71c31efb6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:37.022672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:37.031477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:37.033813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:37.035848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1389/2808] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:37.158339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d677-9ea1-4947-a039-c047b49aace8 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:37.175133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:37.175970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:37.176252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:37.176526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:37.179286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:37.193382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:37.195160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf6ff-cc38-403e-9823-c29bff666477 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:37.212782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1420/2809] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:40.660509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:40.663894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:40.771440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cfad6-3e4a-4df7-b13b-d6ad361df413 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:40.778008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:40.779000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:40.779477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:40.779954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:40.783174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:40.799566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:40.801253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:40.821116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1390/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:42.397095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:42.397643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:42.398156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:42.399819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:42.430623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e931df-15da-4695-9e02-aacac6dcbcac service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:42.441447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:42.442809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:42.443308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:42.443661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:42.443943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:42.444360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:42.446606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:42.463452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:42.465448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:42.474499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:42.484875 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1391/2811] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:42.553954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1421/2812] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:42.563109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:42.564770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:42.737644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b0de-5962-4343-9134-70c3c53e35ee service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:42.743251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:42.744174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:42.744475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:42.744974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:42.754855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:42.756474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:42.767539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1392/2813] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:55:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:43.130059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:43.159266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b768-3469-40bf-95e0-7f89530fde61 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:43.168536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:43.169574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:43.170145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:43.170640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:43.174673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:43.205103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:43.211951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1ad46-140b-41be-a681-f8396734b476 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:43.243001 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1422/2814] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:43.742381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:43.744776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:43.788883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755265eb-9a1f-4811-a8e6-832e5a717cec service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:43.800963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:43.801571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:43.802039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:43.802500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:43.806804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:43.840409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:43.843512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:43.872161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1393/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:49.933717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ced474-a995-43f8-b616-d79ccc4cfd5c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:49.934295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ced474-a995-43f8-b616-d79ccc4cfd5c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:49.934295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ced474-a995-43f8-b616-d79ccc4cfd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:49.958757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-06ced474-a995-43f8-b616-d79ccc4cfd5c None None] MFA Rules not processed for user `52e08cff441e4fb0b01886d81a7b5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:49.960423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-06ced474-a995-43f8-b616-d79ccc4cfd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:50.049081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:50.093641 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1423/2816] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:55:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:52.052248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:52.072262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c515c8-2552-4b2f-b18b-ee6a329e3339 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:52.086187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:52.087628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:52.088837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:52.089324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:52.091990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:52.118183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:52.122994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:52.143101 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1394/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:00.076085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:02.133697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=44 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:04.360937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:04.364222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:04.366872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:04.421376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] MFA Rules not processed for user `feb7e91603d6463e9428e71c31efb6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:04.423048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:04.446779 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1424/2818] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:14.399389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:15.370245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:15.378000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:15.457504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a89ca-0de3-4fc8-9b0b-0afa0f03be20 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:15.462019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:15.462657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:15.462935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:15.462935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] PATH_INFO: `/v3/users/a21c5e160ca7460d892ce593d4644240` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:15.464874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21c5e160ca7460d892ce593d4644240)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:15.466837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:15.523434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21c5e160ca7460d892ce593d4644240'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.524503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21c5e160ca7460d892ce593d4644240'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.525311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21c5e160ca7460d892ce593d4644240'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.536485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21c5e160ca7460d892ce593d4644240'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.544034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43e9a60a-db5b-4a1a-a7f8-f1878abc6a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21c5e160ca7460d892ce593d4644240'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.563960 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1395/2819] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:15 2022] DELETE /identity/v3/users/a21c5e160ca7460d892ce593d4644240 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:15.754207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:15.769333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb52af-f057-4c12-82dc-d45df330c1f0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:15.846216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:15.846847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:15.847355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:15.847832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] PATH_INFO: `/v3/projects/57eeba8f69124206b8e6a8c8eb875c6f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:15.849262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57eeba8f69124206b8e6a8c8eb875c6f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:15.851393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:15.900223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57eeba8f69124206b8e6a8c8eb875c6f', 'request_id': 'req-616f2acb-a8cf-4b35-a13b-a6c14df2a868'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.905976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57eeba8f69124206b8e6a8c8eb875c6f', 'request_id': 'req-616f2acb-a8cf-4b35-a13b-a6c14df2a868'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.914246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57eeba8f69124206b8e6a8c8eb875c6f', 'request_id': 'req-616f2acb-a8cf-4b35-a13b-a6c14df2a868'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.928054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] The token cache is being invalidate because project 57eeba8f69124206b8e6a8c8eb875c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:15.928354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.929052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-616f2acb-a8cf-4b35-a13b-a6c14df2a868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:15.930557 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1425/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:15 2022] DELETE /identity/v3/projects/57eeba8f69124206b8e6a8c8eb875c6f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:15.936751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:15.937098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:15.937448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:15.959824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:15.961157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:16.023930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1396/2821] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:56:16.032471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.032837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.033153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.053805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:16.055028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:16.063602 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1426/2822] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:16.067944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.078715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4025b-a2b3-4425-b402-f3e849413930 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.083497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.084115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.084387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.084655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.085341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:16.085642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.087256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.099955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1397/2823] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:56:16.104583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.114155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56970ce-aa39-4109-8e90-f1f240ff4575 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.118795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.119937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.120208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.120467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.121113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.123004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.158956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1427/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:16 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:16.163697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.176015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6aeb9-129f-4ec2-a3a4-1f0771c34c9e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.180579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:16.283034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.283907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.284309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.284690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.285467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.287807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.322937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1398/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:16 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:16.325069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.351099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def72-7b7f-47a0-8d0b-cb4bd713798a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.363067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.364080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.364550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.365093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.366259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.372440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.393394 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1428/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:16.394127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.405941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8b4fe-0f7d-4457-a57a-299ff596b91a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.418899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.419674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.420163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.420538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.421730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.424852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d6baf-102e-435a-9291-394daadb2250 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.451016 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1399/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:16.456390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.505512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02bd78-9bc3-41ab-bb9b-6d17da6469d0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.513065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.514344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.515652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.516809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] PATH_INFO: `/v3/projects/dea2fc789d4f4d47a08d92bfe8660de4/users/aa6e855b62b646e7b7545432aa62afc8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.567394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea2fc789d4f4d47a08d92bfe8660de4, user_id=aa6e855b62b646e7b7545432aa62afc8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:16.570857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:16.639177 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1429/2828] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:16 2022] PUT /identity/v3/projects/dea2fc789d4f4d47a08d92bfe8660de4/users/aa6e855b62b646e7b7545432aa62afc8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:16.644802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb948-27e1-4c30-9f1a-585b86b955cc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.645448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb948-27e1-4c30-9f1a-585b86b955cc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.646117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb948-27e1-4c30-9f1a-585b86b955cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:16.689069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7c2eb948-27e1-4c30-9f1a-585b86b955cc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:16.692477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7c2eb948-27e1-4c30-9f1a-585b86b955cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:16.837158 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1400/2829] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:16.848972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:16.850755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:16.920136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:16.982534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38bd5-a6a0-4bf5-bac6-7471c120d15f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:16.988866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:16.990021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:16.990449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:16.991043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:17.003561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:17.005864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:17.024398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1430/2830] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:17.181093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:17.181372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:17.181645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:17.207205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:17.208828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:17.277428 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1401/2831] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:56:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:17.298824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:17.301016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:17.451647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b25ca-3a54-4610-8b21-1095e9bf121c service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:17.460619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:17.461912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:17.462328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:17.462639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:17.473889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:17.477510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f9c4-ba29-40a6-be7f-d38d13698d0c service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:17.489955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1431/2832] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:18.748827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:18.751291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:18.829535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:18.919772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a563b6-c842-4a83-9d49-2766011ce228 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:18.937384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:18.937790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:18.938078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:18.938352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:18.942455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:18.968854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:18.970571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:18.994617 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1402/2833] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:20.391438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:20.392026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:20.392026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:20.452535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:20.461456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:20.708833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1432/2834] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 09:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:20.748430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:20.760964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47d92-d5d9-481c-96f8-d741c7625878 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:20.768441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:20.769541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:20.770471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:20.771368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:20.801457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:20.803569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:20.833844 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1403/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:21.006822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:21.023307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51e849-e9bd-488d-a1c2-4a14f4bd03af None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:21.038506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:21.039316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:21.042811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:21.043800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:21.049035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:21.090380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:21.098682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:21.134632 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1433/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:27.727679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:27.727679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:27.734302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:27.735300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:27.751440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e66a-cb4c-4f0d-a348-2023d1685442 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:27.753555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ef76-b421-4550-aece-48f308ba0ccd service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:27.757076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:27.757955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:27.758448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:27.758919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] PATH_INFO: `/v3/users/863b399a02b24f68acfbf4575cc3d257` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:27.760328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=863b399a02b24f68acfbf4575cc3d257)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:27.761066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:27.761688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:27.761969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:27.762245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:27.764401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:27.765022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:27.860932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:27.902423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863b399a02b24f68acfbf4575cc3d257'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.906146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863b399a02b24f68acfbf4575cc3d257'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.909140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863b399a02b24f68acfbf4575cc3d257'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.932325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:27.934389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8937af-8ef3-43ba-bc3c-a6e2f642d0f6 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:27.943753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863b399a02b24f68acfbf4575cc3d257'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.962405 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1434/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:56:27.974554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a9e70cc-7941-4c81-bf4c-96cbe6c10f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863b399a02b24f68acfbf4575cc3d257'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.052208 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1404/2838] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:27 2022] DELETE /identity/v3/users/863b399a02b24f68acfbf4575cc3d257 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:28.054070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.054290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.054567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.100401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:28.101864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.264478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada710-2207-4b71-abc1-706a632c44e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.264775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada710-2207-4b71-abc1-706a632c44e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.265174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada710-2207-4b71-abc1-706a632c44e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.327153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8fada710-2207-4b71-abc1-706a632c44e6 None None] MFA Rules not processed for user `aa6e855b62b646e7b7545432aa62afc8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:28.328603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8fada710-2207-4b71-abc1-706a632c44e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.335443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1435/2839] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:28.345562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.348796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.511215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6095b-4ffe-4b3b-a464-37b6dee055ad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.522708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.523341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.523619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.523890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.573856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1405/2840] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:28.575403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.575688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.575961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.580120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.581620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:28.623035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1436/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:28.636304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] MFA Rules not processed for user `aa6e855b62b646e7b7545432aa62afc8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:28.639223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.658328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1406/2842] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:29.038002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:29.039715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:29.064269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79335-0367-497f-a952-8e7713fcef57 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:29.076382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:29.077206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:29.077520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:29.077798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] PATH_INFO: `/v3/projects/3ce2480a829d442c8b55476ffa5d3ba3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:29.079946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce2480a829d442c8b55476ffa5d3ba3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:29.092223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:29.157487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:29.159821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:29.166972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:29.225013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce2480a829d442c8b55476ffa5d3ba3', 'request_id': 'req-0c303726-6fb0-4985-b16e-b40c1dcb574b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.243513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce2480a829d442c8b55476ffa5d3ba3', 'request_id': 'req-0c303726-6fb0-4985-b16e-b40c1dcb574b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.259146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce2480a829d442c8b55476ffa5d3ba3', 'request_id': 'req-0c303726-6fb0-4985-b16e-b40c1dcb574b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.272184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:29.285483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] The token cache is being invalidate because project 3ce2480a829d442c8b55476ffa5d3ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:29.285757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.288331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.291092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1437/2843] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:29 2022] DELETE /identity/v3/projects/3ce2480a829d442c8b55476ffa5d3ba3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:29.295767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:29.297366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:29.327649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1041-d84d-464a-a36a-5a15cc41ed33 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:29.452302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c303726-6fb0-4985-b16e-b40c1dcb574b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:29.463904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:29.464563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:29.464836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:29.465134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] PATH_INFO: `/v3/users/55168691c9ff4d8c92294a3eaf1f3160` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:29.467562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55168691c9ff4d8c92294a3eaf1f3160)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:29.470572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:29.502833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:29.505595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:29.509318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:29.511547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:29.514568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:29.641106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55168691c9ff4d8c92294a3eaf1f3160'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.642116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55168691c9ff4d8c92294a3eaf1f3160'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.657086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55168691c9ff4d8c92294a3eaf1f3160'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.667516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55168691c9ff4d8c92294a3eaf1f3160'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.668802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55168691c9ff4d8c92294a3eaf1f3160'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.703957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1438/2844] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:29 2022] DELETE /identity/v3/users/55168691c9ff4d8c92294a3eaf1f3160 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:29.731432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:29.733222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:29.756997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1407/2845] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:30.323258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:30.324868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:30.503177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33baf1-0788-474b-930c-1d9c3a7d3c37 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:30.512423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:30.513342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:30.513724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:30.514680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:30.522511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:30.542197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:30.590417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad9791-966b-4e08-8327-bd91d36889bf service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:30.604670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:30.610762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b50fd-ad0e-4042-8e65-219ff0e77a89 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:30.626702 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1439/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:30.691876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:30.758923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:30.760937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:30.761332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:30.761719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] PATH_INFO: `/v3/projects/482e40829f6e48d198f53d0033dd3bfa` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:30.763742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482e40829f6e48d198f53d0033dd3bfa)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:30.767978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:30.935115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482e40829f6e48d198f53d0033dd3bfa', 'request_id': 'req-a719e4b0-781c-4e09-9a76-9b0fc0350f12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:30.957364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482e40829f6e48d198f53d0033dd3bfa', 'request_id': 'req-a719e4b0-781c-4e09-9a76-9b0fc0350f12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.006447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482e40829f6e48d198f53d0033dd3bfa', 'request_id': 'req-a719e4b0-781c-4e09-9a76-9b0fc0350f12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.050441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] The token cache is being invalidate because project 482e40829f6e48d198f53d0033dd3bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:31.050972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.051829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a719e4b0-781c-4e09-9a76-9b0fc0350f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.061322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1408/2847] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:30 2022] DELETE /identity/v3/projects/482e40829f6e48d198f53d0033dd3bfa => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:31.062049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.062490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.062868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.120000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:31.122755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:31.209886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:31.327700 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1440/2848] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:31.338876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.339148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.339406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.404482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:31.405854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:31.455014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.459673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1409/2849] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:31.471433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a9e76-f744-41f2-b7cc-9ef59e82120a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:31.485701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:31.488205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.488811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.489657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.492815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:31.494703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:31.498202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:31.516896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1441/2850] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:56:31.521282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.538528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026ec4-768e-4c2d-8bde-ffb9895e13a8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:31.548967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:31.551063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.551534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.551963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.552790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:31.555223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:31.630348 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1410/2851] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:31 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:31.633611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.654797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd763-56ee-4f3a-a998-9ff0dc9107e3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:31.857595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:31.858278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.858561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.858836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.865034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:31.877916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:31.940421 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1442/2852] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:31 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:31.941928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.960889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0351e-2e6d-454d-a531-61046cf6ed46 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:31.972716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:31.981017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.981482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.981769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.982704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:31.984749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:32.023219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1411/2853] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:32.026145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:32.047424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398943-c73a-4360-b801-8f677963cd01 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:32.065493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:32.068760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:32.069037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:32.069318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:32.069988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:32.083439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591258e5-4750-49d5-81fb-4fae4e50fc2d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:32.126197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1443/2854] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:32.127545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:32.216003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10598cd2-7ec1-4ea8-8eec-c978ce486480 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:32.284514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:32.285802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:32.286087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:32.286369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] PATH_INFO: `/v3/projects/aa7146c7cb464ce99ad2f6593f0ebb0b/users/b2706dd9c4f24a41a1e990c0517b792e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:32.419394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7146c7cb464ce99ad2f6593f0ebb0b, user_id=b2706dd9c4f24a41a1e990c0517b792e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:32.428258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:32.453099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1412/2855] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:32 2022] PUT /identity/v3/projects/aa7146c7cb464ce99ad2f6593f0ebb0b/users/b2706dd9c4f24a41a1e990c0517b792e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:32.455966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b273d6-6ad0-4396-b96b-263f8b2add8b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:32.456508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b273d6-6ad0-4396-b96b-263f8b2add8b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:32.456508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b273d6-6ad0-4396-b96b-263f8b2add8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:32.508261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-33b273d6-6ad0-4396-b96b-263f8b2add8b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:32.512291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33b273d6-6ad0-4396-b96b-263f8b2add8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:32.691440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1444/2856] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:32.698378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:32.702334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:32.837355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1691-8ff0-4637-b9f4-ea97ba63ea58 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:32.850535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:32.851359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:32.854403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:32.854817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:32.882674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:32.884358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:32.916789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1413/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:56:42.678290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:42.891843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:43.302158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.302700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.303198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.343771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] MFA Rules not processed for user `b2706dd9c4f24a41a1e990c0517b792e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:43.346369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:43.434883 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1445/2858] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:43.439503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.449600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cceb1-3e8a-4bc8-bf8f-a8c8104a749f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.455157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.456064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.456538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.457051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.457916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.460284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.493754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1414/2859] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:43 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:43.497481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.508977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7630e-394b-4db8-a681-02a470375f30 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.593432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.600111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.600329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.600678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.601500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.604220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.635362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1446/2860] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:43 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:43.636933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.647880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b60cd-1ba5-4aca-a0e8-fec2bd74a849 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.656053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.656865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.658091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.658768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.659927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.661850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.679669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.680657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1415/2861] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:43.692401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e21e-3d37-4d2c-9cc7-00112b686436 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.698333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.699165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.699446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.699720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] PATH_INFO: `/v3/projects/4847dbc2755946869b6206a5c04666a9/users/b6de9b26fccd4f22b745eba7f04dd157/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.721190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4847dbc2755946869b6206a5c04666a9, user_id=b6de9b26fccd4f22b745eba7f04dd157, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.724051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.739819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1447/2862] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:43 2022] PUT /identity/v3/projects/4847dbc2755946869b6206a5c04666a9/users/b6de9b26fccd4f22b745eba7f04dd157/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:56:43.744039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.754994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664d87-7a9d-4760-acf8-e6e22ab60db4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.821414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.822032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.822961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.823240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.823885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.825508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.837058 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1416/2863] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:43.841866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:43.854393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b89-f473-4194-ac01-2f4ba54851f3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:43.859220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:43.859957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:43.860295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:43.860627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] PATH_INFO: `/v3/projects/4847dbc2755946869b6206a5c04666a9/users/b6de9b26fccd4f22b745eba7f04dd157/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:43.862668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4847dbc2755946869b6206a5c04666a9, user_id=b6de9b26fccd4f22b745eba7f04dd157, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:43.865395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20166-7bfd-42da-b476-5ce082c73270 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:43.876447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1448/2864] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:43 2022] PUT /identity/v3/projects/4847dbc2755946869b6206a5c04666a9/users/b6de9b26fccd4f22b745eba7f04dd157/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:46.490671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:46.493061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:46.628084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbfcf-28a7-434f-a624-ac5054d770b2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:46.776182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:46.807403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:46.807637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:46.807764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:46.807987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:46.814853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:47.011817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:47.015835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:47.035737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1417/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:56:50.052822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340176-5353-47f9-b6e4-427f4cd5b036 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:50.053375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340176-5353-47f9-b6e4-427f4cd5b036 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:50.053717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340176-5353-47f9-b6e4-427f4cd5b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:50.077613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-05340176-5353-47f9-b6e4-427f4cd5b036 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:50.078996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-05340176-5353-47f9-b6e4-427f4cd5b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:50.123160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:50.147052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1449/2866] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:56:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:50.162437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:50.164015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:50.259553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e315-18f3-4354-a504-bbb059c920de service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:50.268834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:50.270315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:50.270765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:50.271229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:50.284256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:50.286872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:50.302682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1418/2867] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:56:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:51.035173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285f26-1289-4fa1-beee-0ab78c9e0ecf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.035546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285f26-1289-4fa1-beee-0ab78c9e0ecf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.035726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285f26-1289-4fa1-beee-0ab78c9e0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.096163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-46285f26-1289-4fa1-beee-0ab78c9e0ecf None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:51.100130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-46285f26-1289-4fa1-beee-0ab78c9e0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:51.120364 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1450/2868] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:51.132813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:51.152335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306aef5-746e-45ea-b3b6-58332b229824 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:51.182171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:51.182841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.183128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.183398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.193964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:51.198789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:51.226597 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1419/2869] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:51.817456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94a68-13da-427d-b308-2a46d15b4f15 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.817752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94a68-13da-427d-b308-2a46d15b4f15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.818305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea94a68-13da-427d-b308-2a46d15b4f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.848232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3ea94a68-13da-427d-b308-2a46d15b4f15 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:51.849659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ea94a68-13da-427d-b308-2a46d15b4f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:51.867026 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1451/2870] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:56:51.895635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:51.910628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dba3e-ae49-4aeb-b159-051d6000d08d service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:51.924066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:51.925095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.925504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.926041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.929668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c4dfd-9ce9-4605-8a7f-0646c228a78f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.930146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c4dfd-9ce9-4605-8a7f-0646c228a78f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.930422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c4dfd-9ce9-4605-8a7f-0646c228a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.952650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:51.954355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:51.975139 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1420/2871] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:51.979719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae2c4dfd-9ce9-4605-8a7f-0646c228a78f None None] MFA Rules not processed for user `b6de9b26fccd4f22b745eba7f04dd157`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:51.981222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae2c4dfd-9ce9-4605-8a7f-0646c228a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:52.101477 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1452/2872] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:52.260896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:52.262946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:52.280522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970b76-1e8e-4c86-aadb-28322f75944f service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:52.287714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:52.288499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:52.289025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:52.289504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:52.370684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:52.375511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:52.377217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:52.387601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1421/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:55.076568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fc94-84e7-4eef-8104-39c00a3e2885 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.077082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fc94-84e7-4eef-8104-39c00a3e2885 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.077250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fc94-84e7-4eef-8104-39c00a3e2885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.105307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2a61fc94-84e7-4eef-8104-39c00a3e2885 None None] MFA Rules not processed for user `b2706dd9c4f24a41a1e990c0517b792e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:55.106933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2a61fc94-84e7-4eef-8104-39c00a3e2885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:55.115627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1453/2874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:56.403388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.499949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb861-5856-41f2-a7df-73b22a3e2f10 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.507603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.508565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.509272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.509741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.513835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.538881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.540348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.559726 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1422/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:05.098708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=49 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:06.157791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2164c2-855c-46cf-b545-fe475ca862da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.158496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2164c2-855c-46cf-b545-fe475ca862da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.159250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2164c2-855c-46cf-b545-fe475ca862da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.204772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2c2164c2-855c-46cf-b545-fe475ca862da None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:06.206487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c2164c2-855c-46cf-b545-fe475ca862da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:06.215617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1454/2876] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:06.229740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:06.254763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468f8-e68b-4a84-b045-9a92fb9ba9f2 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:06.267586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:06.269292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.269592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.269910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.287458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:06.289662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:06.302734 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1423/2877] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:06.507530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22939d-19a4-4b2b-82ae-cebe525db48c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.507985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22939d-19a4-4b2b-82ae-cebe525db48c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.508373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22939d-19a4-4b2b-82ae-cebe525db48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.530564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae22939d-19a4-4b2b-82ae-cebe525db48c None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:06.531935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae22939d-19a4-4b2b-82ae-cebe525db48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:06.539678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1455/2878] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:06.553248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:06.564669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f51e-7810-45cd-818f-ddadd40fb751 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:06.570204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:06.570818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.571275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.571553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.591037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:06.592456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:06.613896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1424/2879] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:06.789744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.789744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.790171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.812532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:06.813832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:06.821444 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1456/2880] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:06.843584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:06.854938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a610ed-66d3-4015-ae43-c8da8147581e service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:06.860721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:06.861478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:06.861853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:06.862198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:06.875168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:06.878434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48746-e196-469b-8aff-84f15a4a79ba service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:06.896595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1425/2881] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:07.047274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:07.049117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:07.211476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0191-3747-428e-8bca-67bd36ec9656 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:07.218261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:07.219216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:07.219550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:07.219829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] PATH_INFO: `/v3/users/dbd28dab6bef44c28e487a58cc99cb5c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:07.221133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd28dab6bef44c28e487a58cc99cb5c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:07.223998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:07.312410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd28dab6bef44c28e487a58cc99cb5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:07.313702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd28dab6bef44c28e487a58cc99cb5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:07.329058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd28dab6bef44c28e487a58cc99cb5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:07.362594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd28dab6bef44c28e487a58cc99cb5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:07.367446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd28dab6bef44c28e487a58cc99cb5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:07.428531 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1457/2882] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:07 2022] DELETE /identity/v3/users/dbd28dab6bef44c28e487a58cc99cb5c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:07.433562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:07.434363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:07.434363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:07.470361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:07.481076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:07.656135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1426/2883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:07.666332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:07.667917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:07.748703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff764-f649-49c1-9027-34ae6ebad4e5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:07.755338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:07.756402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:07.756850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:07.757431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:07.769574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:07.771618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7666-608f-4f74-9fd7-b08149090c36 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:07.789365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1458/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:08.140002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:08.142003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:08.169022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ecd36-48f5-466b-8686-368616668786 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:08.174573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:08.175645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.175944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.176220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] PATH_INFO: `/v3/projects/f80fef68c5b24dc8b5340141bc1f837d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.177515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80fef68c5b24dc8b5340141bc1f837d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:08.179506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:08.264878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80fef68c5b24dc8b5340141bc1f837d', 'request_id': 'req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:08.273099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:08.282589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80fef68c5b24dc8b5340141bc1f837d', 'request_id': 'req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:08.296102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80fef68c5b24dc8b5340141bc1f837d', 'request_id': 'req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:08.323066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] The token cache is being invalidate because project f80fef68c5b24dc8b5340141bc1f837d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:08.323663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:08.325725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42591b5-fd1a-4da6-a4f6-4f988c1b78ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:08.335030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.335608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.335608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.336516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1427/2885] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:08 2022] DELETE /identity/v3/projects/f80fef68c5b24dc8b5340141bc1f837d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:08.344017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:08.360784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:08.362540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:08.452451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1459/2886] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:08.456015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.456015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.456015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.486737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:08.488119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:08.512219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1428/2887] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:08.517245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:08.532790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964700-6c81-41d7-ae3e-d602ed5cccc9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:08.544062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:08.545014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.545462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.545923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.546773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:08.547258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:08.549238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:08.617522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:08.618342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1460/2888] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:08.641721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74989-21ce-4f49-8c15-fe274de29ec1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:08.651968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:08.653200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.653756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.654250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.655341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:08.660691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:08.737261 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1429/2889] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:08 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:08.742068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:08.766272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1024d1-055a-4d5a-be9c-634a57232c11 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:08.910189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:08.911443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.911938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.912407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.913355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:08.916129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:08.947034 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1461/2890] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:08 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:08.951109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:08.961417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115bf7-1e59-4964-a904-f1943d39ab4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:08.967514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:08.968353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:08.968789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:08.969237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:08.970035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:08.971905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:08.983804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1430/2891] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:08.988163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:09.003100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105a391-e20a-449a-9325-b6ae18d42dfb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:09.009776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:09.010701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.011305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.012304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.013193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:09.015865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:09.033985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1462/2892] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:09.036814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:09.054694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced9f-961a-4fb7-9ca2-521136f0093f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:09.064111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:09.065705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.066247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.066809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] PATH_INFO: `/v3/projects/6b5ffac1f62746ffb526bff5c8014845/users/3baf83b12a8b4554b02e42bf41edcb8f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.092591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5ffac1f62746ffb526bff5c8014845, user_id=3baf83b12a8b4554b02e42bf41edcb8f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:09.097654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a062734-6cdc-4a8f-954c-414613d69bd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:09.100283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:09.110899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.116970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1431/2893] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:09 2022] PUT /identity/v3/projects/6b5ffac1f62746ffb526bff5c8014845/users/3baf83b12a8b4554b02e42bf41edcb8f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:09.143917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.144729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.145234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.191712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5d63-2eec-492d-a761-86f9b7b06cd2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:09.244444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] MFA Rules not processed for user `3baf83b12a8b4554b02e42bf41edcb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:09.249832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.340466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:09.346593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.347205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.347583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] PATH_INFO: `/v3/users/9dc12014773b4f9fb34ff214c07d7f61` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.352257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc12014773b4f9fb34ff214c07d7f61)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:09.358910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:09.384184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:09.429326 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1432/2894] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:09.441884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:09.444339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.479646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc12014773b4f9fb34ff214c07d7f61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:09.481326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc12014773b4f9fb34ff214c07d7f61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:09.496455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc12014773b4f9fb34ff214c07d7f61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:09.509327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc12014773b4f9fb34ff214c07d7f61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:09.511901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-968bd81e-96c1-4421-9599-4f27b135f823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc12014773b4f9fb34ff214c07d7f61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:09.568839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1463/2895] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:09 2022] DELETE /identity/v3/users/9dc12014773b4f9fb34ff214c07d7f61 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:09.574649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.575130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.575633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.651433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:09.654115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.670958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0c1e-9f74-4387-b471-b39bb4bc8bf2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:09.685575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:09.793477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:09.794266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.794639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.795032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:09.797977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.841328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1464/2896] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:09.843083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:09.854153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:09.915181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:09.917741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:09.932972 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1433/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:09.970705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879235b8-09af-483d-820f-d48e45db3d1e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:09.978000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:09.980814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:09.981620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:09.982089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:10.001692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:10.003744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:10.038759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1465/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:10.512687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:10.514439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:10.558370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23e15-1763-4460-bd97-8f981c47082d service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:10.578128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:10.580946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:10.593605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:10.595019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:10.595457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:10.596011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] PATH_INFO: `/v3/projects/386a18c232b949b793bf7ec70ed3b6c9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:10.598640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386a18c232b949b793bf7ec70ed3b6c9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:10.603229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:10.624137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd3718-7e02-40e5-aeda-b182f73725d3 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:10.632832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:10.633802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:10.635368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:10.645922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] PATH_INFO: `/v3/users/3baf83b12a8b4554b02e42bf41edcb8f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:10.648879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3baf83b12a8b4554b02e42bf41edcb8f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:10.655567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:10.714105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386a18c232b949b793bf7ec70ed3b6c9', 'request_id': 'req-32e7014f-b0a7-4071-b98c-0f442f01a767'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.729542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386a18c232b949b793bf7ec70ed3b6c9', 'request_id': 'req-32e7014f-b0a7-4071-b98c-0f442f01a767'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.747609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386a18c232b949b793bf7ec70ed3b6c9', 'request_id': 'req-32e7014f-b0a7-4071-b98c-0f442f01a767'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.764821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] The token cache is being invalidate because project 386a18c232b949b793bf7ec70ed3b6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:10.765676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.767044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.778445 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1434/2899] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:10 2022] DELETE /identity/v3/projects/386a18c232b949b793bf7ec70ed3b6c9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:10.779727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:10.785496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:10.788357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:10.816545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3baf83b12a8b4554b02e42bf41edcb8f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.817584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3baf83b12a8b4554b02e42bf41edcb8f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.829263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3baf83b12a8b4554b02e42bf41edcb8f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.847495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3baf83b12a8b4554b02e42bf41edcb8f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.848630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3baf83b12a8b4554b02e42bf41edcb8f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:10.873678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1466/2900] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:10 2022] DELETE /identity/v3/users/3baf83b12a8b4554b02e42bf41edcb8f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:10.877255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:10.879510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:10.890117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:10.947267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7014f-b0a7-4071-b98c-0f442f01a767 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.015019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5b4f-a3e9-40de-b610-8463961265fd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.026202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.026831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.027108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.027381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.029320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.042412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.043319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.043786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.044094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] PATH_INFO: `/v3/users/8f6e3fb8d6584717b71970da75f27541` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.044611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.045610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6e3fb8d6584717b71970da75f27541)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.046270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41b611-683c-4818-829f-b3fb522a25c1 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.047992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.061342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1467/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:11.063067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.063463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.063855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.093924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:11.095506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.106499 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1468/2902] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:11.107310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:11.109659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.137219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cd1b2-6239-4a1d-8c1d-f8d1ccc7ff18 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.143982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.145035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.145650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.146152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] PATH_INFO: `/v3/users/aa6e855b62b646e7b7545432aa62afc8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.148741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6e855b62b646e7b7545432aa62afc8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.151829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.178252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6e3fb8d6584717b71970da75f27541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.179881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6e3fb8d6584717b71970da75f27541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.180566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6e3fb8d6584717b71970da75f27541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.197439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6e3fb8d6584717b71970da75f27541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.218505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6e3fb8d6584717b71970da75f27541'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.232808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6e855b62b646e7b7545432aa62afc8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.233673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6e855b62b646e7b7545432aa62afc8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.246165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6e855b62b646e7b7545432aa62afc8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.250713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1435/2903] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:10 2022] DELETE /identity/v3/users/8f6e3fb8d6584717b71970da75f27541 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:11.252006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:11.255204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6e855b62b646e7b7545432aa62afc8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.255851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.255985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6e855b62b646e7b7545432aa62afc8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.277894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:11.292726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1469/2904] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:11 2022] DELETE /identity/v3/users/aa6e855b62b646e7b7545432aa62afc8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:11.354095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc876aa-6667-4520-bce9-a0bb97a8d2a6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.361312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:11.443760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.444771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.445146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.446896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.454879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.560155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.562333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.573981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1436/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:11.694450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:11.696324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.711448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6cfe8-6d1a-43c1-9c48-e9202180902b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.727946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.741428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.741720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.741997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] PATH_INFO: `/v3/projects/dea2fc789d4f4d47a08d92bfe8660de4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.747509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea2fc789d4f4d47a08d92bfe8660de4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.748331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.752375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:11.755036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.780118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68d-2ef0-4ff9-bf6e-f1be21ba0754 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:11.785705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:11.786470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.786851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.787224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] PATH_INFO: `/v3/projects/0844f17c02294217954ad90f41b9e2fd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.788492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0844f17c02294217954ad90f41b9e2fd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:11.791835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:11.865315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea2fc789d4f4d47a08d92bfe8660de4', 'request_id': 'req-2d60eef9-c619-4bcc-af15-9f218497747d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.873803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea2fc789d4f4d47a08d92bfe8660de4', 'request_id': 'req-2d60eef9-c619-4bcc-af15-9f218497747d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.884330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea2fc789d4f4d47a08d92bfe8660de4', 'request_id': 'req-2d60eef9-c619-4bcc-af15-9f218497747d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.889079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0844f17c02294217954ad90f41b9e2fd', 'request_id': 'req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.898850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0844f17c02294217954ad90f41b9e2fd', 'request_id': 'req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.905452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] The token cache is being invalidate because project dea2fc789d4f4d47a08d92bfe8660de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:11.906148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.907113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d60eef9-c619-4bcc-af15-9f218497747d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.909607 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1470/2906] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:11 2022] DELETE /identity/v3/projects/dea2fc789d4f4d47a08d92bfe8660de4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:11.911582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0844f17c02294217954ad90f41b9e2fd', 'request_id': 'req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.916564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e780a2-a84e-457c-96ec-a51fb2222225 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.916854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e780a2-a84e-457c-96ec-a51fb2222225 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.917230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e780a2-a84e-457c-96ec-a51fb2222225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.933626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] The token cache is being invalidate because project 0844f17c02294217954ad90f41b9e2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:11.934028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.935037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96a1a1f9-5cc1-4b9a-b951-a5f14b5459d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:11.937844 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1437/2907] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:11 2022] DELETE /identity/v3/projects/0844f17c02294217954ad90f41b9e2fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:11.943881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:11.944307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:11.944878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:11.951133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-84e780a2-a84e-457c-96ec-a51fb2222225 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:11.953453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-84e780a2-a84e-457c-96ec-a51fb2222225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:11.974807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:11.976330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.031700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:12.075859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1438/2908] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.076767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.078132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.078360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1471/2909] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.084335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccce-705a-4ac8-a7b3-b7930ace6eef None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.084895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccce-705a-4ac8-a7b3-b7930ace6eef None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.085287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccce-705a-4ac8-a7b3-b7930ace6eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.096283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbd035-76aa-4880-a6db-fbb0969271bc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.102417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.103072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.103386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.103671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] PATH_INFO: `/v3/projects/6b5ffac1f62746ffb526bff5c8014845` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.104809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5ffac1f62746ffb526bff5c8014845)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.107479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.114977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cfc4ccce-705a-4ac8-a7b3-b7930ace6eef None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:12.116202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cfc4ccce-705a-4ac8-a7b3-b7930ace6eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.127075 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1472/2910] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.129048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.129332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.129693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.157421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:12.158990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.171944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1473/2911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.176666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.184069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5ffac1f62746ffb526bff5c8014845', 'request_id': 'req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:12.189814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336d3da-4777-46a0-bfb3-aed1985514cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.205574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5ffac1f62746ffb526bff5c8014845', 'request_id': 'req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:12.217512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5ffac1f62746ffb526bff5c8014845', 'request_id': 'req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:12.232864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] The token cache is being invalidate because project 6b5ffac1f62746ffb526bff5c8014845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:12.233180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:12.233867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:12.238749 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1439/2912] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:12 2022] DELETE /identity/v3/projects/6b5ffac1f62746ffb526bff5c8014845 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:12.238749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.238749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.289618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.290248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.290524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.291699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.292723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:12.293737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.296711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f382e-a8ca-4ef3-82b2-a62a21543344 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.315801 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1474/2913] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:12.317194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.317475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.317750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.328806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:12.346827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e30d4-52c9-469e-9eff-db54a7f0fc27 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.352503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:12.356100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.366088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1475/2914] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.373898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.374065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.374815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.375100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.375369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.376619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:12.376619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.378669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.381719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10779-7f57-4121-95cb-31c9e5c1b4e8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.399102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b8bd7-83ff-441a-95ca-20133542576f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.407452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1440/2915] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:12.409008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.409298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.409572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.417820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.418512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.418777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.419046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.419710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.424202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.449255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:12.450718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:12.465667 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1441/2916] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:12.466908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.480224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c8b6-0a6d-40c1-abce-8d6e168ddf4f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.481296 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1476/2917] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.483045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.560672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:12.570628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f4944-42b0-4f8d-9762-4e5482cd1f24 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.573647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.574405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.574405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.574681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.575526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.578959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.580453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.581346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.581839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.582300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.584240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:12.584854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.589237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.606603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1477/2918] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:12.607915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.620962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7c9f7-4440-4968-8b75-44d6d7a8fc04 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.625976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.626595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.626866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.627139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.627763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.631376 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1442/2919] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.631546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.631663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.669830 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1478/2920] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/users => generated 280 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.671151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.705293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4658a-05f8-4d9d-bae2-b71c27abe747 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.713474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.714171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.714447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599588f-79cf-4e50-8c80-5af0d47ffbd6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.714581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.715033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.715696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.717987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.719596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.720313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.720685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.721049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.721748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.723828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.745451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1479/2921] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/users => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.746499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.758667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51692d37-1e6a-4eaf-ad96-b30c0fe91b16 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.759958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1443/2922] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.763855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.841327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.842212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.842657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.843117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.844123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.845928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d14be-7526-405c-a818-4114d7acc617 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.846100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.851284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.851930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.852207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.852477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.854220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.856121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.862226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1480/2923] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:12.862226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.870891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1444/2924] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:12.870891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.878143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634d46-e2b1-4294-b6ff-26b7a2ef652a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.891443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c2c35-5866-4e3d-95eb-5a25dd9eea98 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.891645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.891645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.891645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.891645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.892044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.892044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.898040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.898663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.898941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.899214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.899860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.902064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.913113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1445/2925] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:12.913993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.922306 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1481/2926] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:12 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:12.923795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.928261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b285-dc60-4845-896d-f1a2289a72e9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.933626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.934340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.934626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.934898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.935534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.935661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916f0a-0ec3-468f-9a6d-5ff9d9a1456f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.937577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.942081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.942849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.943830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.943975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] PATH_INFO: `/v3/projects/88fa05d1309f491e9cc74345be9a02cd/users/3ca33a411ff642718ef2e99cb0d4db02/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.951557 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1446/2927] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:12.951557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.957885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:12.962658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41618663-08fd-4532-b5b6-c7a3d8a096a2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:12.966568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fa05d1309f491e9cc74345be9a02cd, user_id=3ca33a411ff642718ef2e99cb0d4db02, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.968561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:12.969216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:12.969497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:12.969768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:12.970352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.970483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:12.971984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:12.985073 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1447/2928] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:12.986099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:12.998915 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1482/2929] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:12 2022] PUT /identity/v3/projects/88fa05d1309f491e9cc74345be9a02cd/users/3ca33a411ff642718ef2e99cb0d4db02/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:12.998915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.001127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea7146-3cb6-4eb0-924d-4b7329067c49 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.027630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:13.056751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999fab-f779-4ff4-b359-eb8174a98357 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.061800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.062432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.062847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.063124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.063822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.065754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a55e-ccc7-4b5e-bbc5-4cab444f5ffb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.069836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.070674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.070912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.071187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] PATH_INFO: `/v3/projects/0710c69d87dc4f7fa6999e314efc8022/users/f9ad41b36abd4eb8945f3ec85ce8f5a5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.083274 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1483/2930] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:13.083274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de9a3-ca67-4c95-9c0b-f85307409e84 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.083274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de9a3-ca67-4c95-9c0b-f85307409e84 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.083274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de9a3-ca67-4c95-9c0b-f85307409e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.087555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0710c69d87dc4f7fa6999e314efc8022, user_id=f9ad41b36abd4eb8945f3ec85ce8f5a5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.090867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.107318 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1448/2931] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:12 2022] PUT /identity/v3/projects/0710c69d87dc4f7fa6999e314efc8022/users/f9ad41b36abd4eb8945f3ec85ce8f5a5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:13.118132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.122368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c3de9a3-ca67-4c95-9c0b-f85307409e84 None None] MFA Rules not processed for user `3ca33a411ff642718ef2e99cb0d4db02`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.123961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c3de9a3-ca67-4c95-9c0b-f85307409e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.191187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e26fa-be48-4c09-8b92-dadd2bf7859b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.204302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.205080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.205362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.205635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] PATH_INFO: `/v3/projects/a9d95de022cd4769bbfe3e5f48958c88/users/9011f5f137dc4e9184519490d1b86409/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.223904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d95de022cd4769bbfe3e5f48958c88, user_id=9011f5f137dc4e9184519490d1b86409, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.224162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1484/2932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:13.225206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf2a1-a4cb-4cfb-a434-749a63ebebfc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.225490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf2a1-a4cb-4cfb-a434-749a63ebebfc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.225766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf2a1-a4cb-4cfb-a434-749a63ebebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.227563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.242634 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1449/2933] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:13 2022] PUT /identity/v3/projects/a9d95de022cd4769bbfe3e5f48958c88/users/9011f5f137dc4e9184519490d1b86409/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:13.244363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.258976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-deebf2a1-a4cb-4cfb-a434-749a63ebebfc None None] MFA Rules not processed for user `f9ad41b36abd4eb8945f3ec85ce8f5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.260819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-deebf2a1-a4cb-4cfb-a434-749a63ebebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.315403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699883-af9a-439b-9fdd-1d0f10e0489e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.320469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.321108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.321390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.321790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.322979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.324891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce4504-2f5b-429c-a038-749c16d37f47 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.344046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1485/2934] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:13.344046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.344046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.344046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.347073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:13.360331 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1450/2935] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/projects => generated 359 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:13.361574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.361862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.362270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.375051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] MFA Rules not processed for user `9011f5f137dc4e9184519490d1b86409`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.376274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.381816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] MFA Rules not processed for user `f9ad41b36abd4eb8945f3ec85ce8f5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.382993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.396464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:13.443200 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1451/2936] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:13.444057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.450138 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1486/2937] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:13.458509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.459999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.512275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f51a5-3058-4279-919a-b3ff4fa5da51 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.516856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.517494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.517775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.518069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.518718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.520637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.537369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200705e-1b6a-4fba-9185-58eadb338e6b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.542016 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1452/2938] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:13.542862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.543091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.543693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.543967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.544234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.546266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.553074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.554647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.563624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb458-f2d1-4544-81da-deb3eb8cf66f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.564723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1487/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:57:13.565650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.569920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.570687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.570922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.571221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.577228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347058-b65f-4353-adf2-b6d2be5fc139 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.585050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.585050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.587203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.587936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.588217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.588489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.589514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.591182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.595298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1453/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:13.614262 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1488/2941] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:13.619514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.631275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7553c-2207-439e-8881-e3a81e17eb99 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.637189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.637846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.638121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.638389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] PATH_INFO: `/v3/projects/a94e8e1556774067ad76525990147f6e/users/113050e29a0043b98d129c389da84b3c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.658073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94e8e1556774067ad76525990147f6e, user_id=113050e29a0043b98d129c389da84b3c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.662268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.678832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1454/2942] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:13 2022] PUT /identity/v3/projects/a94e8e1556774067ad76525990147f6e/users/113050e29a0043b98d129c389da84b3c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:13.683928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.695216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa682e-35b6-42e9-8ff6-aa3319a4a55e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.770093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.770840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.771116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.771442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.772221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.777508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63d171-9f5e-4024-96ce-20ff30dd0576 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.801228 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1489/2943] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:13.805337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.819388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc123c0-9ab0-478c-9754-b71010cf60df admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.826769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.834412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.834723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.835733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] PATH_INFO: `/v3/projects/a94e8e1556774067ad76525990147f6e/users/113050e29a0043b98d129c389da84b3c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.843190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94e8e1556774067ad76525990147f6e, user_id=113050e29a0043b98d129c389da84b3c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.845920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f6ed3-c908-4308-a84e-36efe5ed1807 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.870995 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1455/2944] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:13 2022] PUT /identity/v3/projects/a94e8e1556774067ad76525990147f6e/users/113050e29a0043b98d129c389da84b3c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:13.872702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.873164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.873445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.880768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:13.929361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] MFA Rules not processed for user `113050e29a0043b98d129c389da84b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.930635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.964028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.964496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.964793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:14.034821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] MFA Rules not processed for user `f9ad41b36abd4eb8945f3ec85ce8f5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:14.046346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:14.071530 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1490/2945] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:14.186556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1456/2946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:14.318448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:14.436070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353574-e984-426d-b48f-f45f52ea2ceb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:14.444530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:14.445802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:14.446096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:14.446475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:14.457930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:14.459690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb9b9-cb54-414d-b2fc-c4e1218531a3 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:14.475482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1491/2947] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:15.967974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:15.981621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.114245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53018-13cc-4d4c-9683-4f84cc1ed9af None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.122695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.125594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.126149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.126435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] PATH_INFO: `/v3/users/3ca33a411ff642718ef2e99cb0d4db02` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.127686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca33a411ff642718ef2e99cb0d4db02)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.129659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:16.190347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca33a411ff642718ef2e99cb0d4db02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.191932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca33a411ff642718ef2e99cb0d4db02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.193276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca33a411ff642718ef2e99cb0d4db02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.202567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca33a411ff642718ef2e99cb0d4db02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.212035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca33a411ff642718ef2e99cb0d4db02'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.237242 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1457/2948] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:15 2022] DELETE /identity/v3/users/3ca33a411ff642718ef2e99cb0d4db02 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:16.241869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.242348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.242441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.262908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:16.264114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.352723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1492/2949] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:16.364037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:16.365573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.433193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114f9d-90d3-4baf-922b-d28a55e3bc08 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.438088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.438960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.439565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.439565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.449578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.451052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b043ce-26d7-4b50-98be-1eda46d294d6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:16.463397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1458/2950] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:57:16.547330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:16.549534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.564143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721be6-0904-46e2-ae0a-7448068024c6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.569494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.570149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.570477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.570755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] PATH_INFO: `/v3/users/9011f5f137dc4e9184519490d1b86409` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.574072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9011f5f137dc4e9184519490d1b86409)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.576727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:16.590300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.658037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9011f5f137dc4e9184519490d1b86409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.658771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9011f5f137dc4e9184519490d1b86409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.670382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9011f5f137dc4e9184519490d1b86409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.680636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9011f5f137dc4e9184519490d1b86409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.681417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9011f5f137dc4e9184519490d1b86409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.702167 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1493/2951] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:16 2022] DELETE /identity/v3/users/9011f5f137dc4e9184519490d1b86409 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:16.708568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.708857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.709157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.729725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:16.730957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.764996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.831775 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1459/2952] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:16.846183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:16.847713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.923597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b199-f90f-4ae1-9cac-b92d24ca5c31 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.928822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.929944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.930131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.930697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.944049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.946427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:16.959092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1494/2953] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:17.004348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.005775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.026269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e533abf-819e-447a-a961-f8cd54652973 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.068242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.068824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.075873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.076212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] PATH_INFO: `/v3/projects/88fa05d1309f491e9cc74345be9a02cd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.089592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fa05d1309f491e9cc74345be9a02cd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:17.091537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:17.261387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fa05d1309f491e9cc74345be9a02cd', 'request_id': 'req-587f45ac-7d49-4ed1-a12d-15f44174d12e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.279178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fa05d1309f491e9cc74345be9a02cd', 'request_id': 'req-587f45ac-7d49-4ed1-a12d-15f44174d12e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.298615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fa05d1309f491e9cc74345be9a02cd', 'request_id': 'req-587f45ac-7d49-4ed1-a12d-15f44174d12e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.330994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] The token cache is being invalidate because project 88fa05d1309f491e9cc74345be9a02cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:17.331149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.332957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.344509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1460/2954] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:17 2022] DELETE /identity/v3/projects/88fa05d1309f491e9cc74345be9a02cd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:17.346437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.361841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e12cf-cac8-41e8-bddd-92171ba815be service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.460731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.461401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.461675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.462023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] PATH_INFO: `/v3/users/113050e29a0043b98d129c389da84b3c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.463291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113050e29a0043b98d129c389da84b3c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:17.477170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:17.508152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:17.534354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113050e29a0043b98d129c389da84b3c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.535087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113050e29a0043b98d129c389da84b3c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.544714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113050e29a0043b98d129c389da84b3c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.556359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113050e29a0043b98d129c389da84b3c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.557195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113050e29a0043b98d129c389da84b3c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.585824 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1495/2955] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:17 2022] DELETE /identity/v3/users/113050e29a0043b98d129c389da84b3c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:17.840033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.841563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.859946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f45ac-7d49-4ed1-a12d-15f44174d12e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.956452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.957337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.957715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.958087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] PATH_INFO: `/v3/projects/a9d95de022cd4769bbfe3e5f48958c88` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.959337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d95de022cd4769bbfe3e5f48958c88)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:17.962251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.047947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d95de022cd4769bbfe3e5f48958c88', 'request_id': 'req-848232cf-d0dc-48eb-a965-51fa50fa4bd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.061363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:18.064955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d95de022cd4769bbfe3e5f48958c88', 'request_id': 'req-848232cf-d0dc-48eb-a965-51fa50fa4bd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.084306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d95de022cd4769bbfe3e5f48958c88', 'request_id': 'req-848232cf-d0dc-48eb-a965-51fa50fa4bd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.102147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.103503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] The token cache is being invalidate because project a9d95de022cd4769bbfe3e5f48958c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:18.103656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.104090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.105092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-848232cf-d0dc-48eb-a965-51fa50fa4bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.107393 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1461/2956] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:17 2022] DELETE /identity/v3/projects/a9d95de022cd4769bbfe3e5f48958c88 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:18.117855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491436-d135-4add-ac65-34eb68d7e583 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.118167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491436-d135-4add-ac65-34eb68d7e583 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.118445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491436-d135-4add-ac65-34eb68d7e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.138813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68978051-3327-43e7-b6e1-d4b13433d793 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.165075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d0491436-d135-4add-ac65-34eb68d7e583 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:18.167147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d0491436-d135-4add-ac65-34eb68d7e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.221974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.222622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.222901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.223171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] PATH_INFO: `/v3/projects/a94e8e1556774067ad76525990147f6e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.224334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94e8e1556774067ad76525990147f6e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.226467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.254542 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1462/2957] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:18.262582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.262967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.263341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.288233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:18.289571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.303676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94e8e1556774067ad76525990147f6e', 'request_id': 'req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.320930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94e8e1556774067ad76525990147f6e', 'request_id': 'req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.344017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94e8e1556774067ad76525990147f6e', 'request_id': 'req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.361323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] The token cache is being invalidate because project a94e8e1556774067ad76525990147f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:18.362038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.363415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c30b828-5bbb-46fe-8b9d-fb8f4adce17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:18.369651 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1496/2958] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:18 2022] DELETE /identity/v3/projects/a94e8e1556774067ad76525990147f6e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:18.372579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b885-e1c1-46f8-af21-532a60494cf7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.372868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b885-e1c1-46f8-af21-532a60494cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.375613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b885-e1c1-46f8-af21-532a60494cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.404771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1463/2959] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:18.405931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.422175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9a23b885-e1c1-46f8-af21-532a60494cf7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:18.423407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a23b885-e1c1-46f8-af21-532a60494cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.436236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908658c5-eac8-4b95-b20d-2f82e25f2088 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.450758 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1497/2960] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:18.454764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.455606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.456084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.456364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.457507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:18.457507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.458676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.458958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.459158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.459270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.478751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1464/2961] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:18.480513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.496119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:18.496455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cef0-5047-483f-8143-ef7c3a87cb93 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.497426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.505147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.505836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.506965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.507250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.509927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.513590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.520819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1498/2962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:18.524486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.539430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56d55c-ea2f-4558-855b-81fdea631c99 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.553857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.554723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.554723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.555036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.556233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:18.556572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.566170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1465/2963] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/projects => generated 359 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:18.570161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.571409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.606620 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1499/2964] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:57:18.607803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.627713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ab37-6d25-4ec1-8bf0-b172f4efd9a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.647693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:18.687730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:18.725597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9579c-f646-46ac-8277-80a04072416c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.741164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.742436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.743617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.745243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.746107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.746389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.746863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.747203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.747535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.748230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.749674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.750346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.788157 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1466/2965] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/users => generated 280 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:18.792850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.795706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1500/2966] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:18.800939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.811091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af382c3-76fb-4523-85e5-8629a3d52aa4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.885461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6afe82-5b25-45b7-bcf7-0fe10d6bf273 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.888053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.888812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.889129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.889491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.890137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.890686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.891294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.891618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.891765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.892016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.892588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.894654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.904981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1467/2967] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:18.907701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.918214 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1501/2968] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:18.918711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa90006-72c4-4c04-ac9e-d08d7376f166 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.922202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.923611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.924209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.924488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.924760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.925798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.927397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.933188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2092c-d2b0-40e9-a086-682a7bca6125 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.939023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.939628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.939905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.940176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.940810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.944986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.945163 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1468/2969] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:18.946715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.953973 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1502/2970] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:18.957605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8516-29bb-4764-bb9c-afdb662f47b7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.957780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.962293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.963018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.963276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.963541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] PATH_INFO: `/v3/projects/08eef2a9da6049319fe68f8845f4b1f1/users/63eb853c303a48d4b54749f8c6f88076/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.967777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a707f-0ae5-4d7c-a993-c18fdd32ac3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.972547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.973173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.973570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.973848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.974480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.976138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.979297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eef2a9da6049319fe68f8845f4b1f1, user_id=63eb853c303a48d4b54749f8c6f88076, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.982095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11fa6a-150b-44e7-8062-4441c61321e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.988360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1503/2971] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:18.992651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.005023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1469/2972] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:18 2022] PUT /identity/v3/projects/08eef2a9da6049319fe68f8845f4b1f1/users/63eb853c303a48d4b54749f8c6f88076/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:19.006214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2607d-838a-40e3-907f-1d88d1bb45e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.006917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.007199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.007528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.036298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] MFA Rules not processed for user `63eb853c303a48d4b54749f8c6f88076`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:19.037540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.073316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.073985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.074264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.074537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] PATH_INFO: `/v3/projects/c79d5eccb916491fabe7614186e0d6a7/users/abf87926377c412abc765d5feeed63c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.083829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.092940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79d5eccb916491fabe7614186e0d6a7, user_id=abf87926377c412abc765d5feeed63c0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.099596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fa2e5-3f18-4dcf-9e91-7698e46cdd0e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.115542 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1504/2973] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:18 2022] PUT /identity/v3/projects/c79d5eccb916491fabe7614186e0d6a7/users/abf87926377c412abc765d5feeed63c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:19.119773 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1470/2974] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:19.126557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.126886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.127165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.132388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.133803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.187381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] MFA Rules not processed for user `abf87926377c412abc765d5feeed63c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:19.188688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.188882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.256575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a0381-8dc8-46cd-afca-137c09769df2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.304514 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1505/2975] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:19.305964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.351811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.352511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.352854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.353275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.394186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec91d6-04a5-4dc2-a7ff-6f18374362f7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.399889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca0097-da15-4775-950f-95808739789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.401060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0097-da15-4775-950f-95808739789d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.401375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0097-da15-4775-950f-95808739789d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.401650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca0097-da15-4775-950f-95808739789d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.402294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca0097-da15-4775-950f-95808739789d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.404230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca0097-da15-4775-950f-95808739789d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.420017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.421658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.434057 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1471/2976] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:57:19.436959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1506/2977] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:19.440688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.456489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b288-2f1d-460c-958d-fa312c620879 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.479527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca0097-da15-4775-950f-95808739789d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.551818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.552437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.553457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.553800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.554446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.557941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.571474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.595128 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1472/2978] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:19.605340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca0097-da15-4775-950f-95808739789d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.610835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.612069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.612576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.614080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] PATH_INFO: `/v3/users/63eb853c303a48d4b54749f8c6f88076` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.617628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=63eb853c303a48d4b54749f8c6f88076)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.617988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.620929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.623808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.633176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1c3ea-19fe-4367-9941-04622ea30586 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.640375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.641105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.641307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.641581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.642229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.643843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.655366 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1473/2979] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:19.659604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.675756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef61e5-e6f7-4d1e-a6bf-b5ea6b33e66b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.684211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.685327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.685733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.686013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] PATH_INFO: `/v3/projects/d822ec06cee1472d9abaf1c7809720ee/users/e7507b7fe6ed40b7973bc572e9ae2d1b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.707785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d822ec06cee1472d9abaf1c7809720ee, user_id=e7507b7fe6ed40b7973bc572e9ae2d1b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.708167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63eb853c303a48d4b54749f8c6f88076'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.709466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63eb853c303a48d4b54749f8c6f88076'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.710739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.718394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63eb853c303a48d4b54749f8c6f88076'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.727896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63eb853c303a48d4b54749f8c6f88076'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.729029 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1474/2980] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:19 2022] PUT /identity/v3/projects/d822ec06cee1472d9abaf1c7809720ee/users/e7507b7fe6ed40b7973bc572e9ae2d1b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:19.730062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05d8bb04-26be-48f4-8970-584a60f8f2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63eb853c303a48d4b54749f8c6f88076'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.730527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.733122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.757967 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1507/2981] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:19 2022] DELETE /identity/v3/users/63eb853c303a48d4b54749f8c6f88076 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:19.762590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.763017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.763501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.785466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:19.786763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.811464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e55ab-8bff-45ff-b759-9fe5b9fa786a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.864418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1508/2982] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:19.875352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.876792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.890926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.891549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.891825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.892085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.893183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.894792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.906072 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1475/2983] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:19.911923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.926588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b5d-dd0d-49c9-bd37-09afb7d42faa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.932004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.932697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.933016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.933326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] PATH_INFO: `/v3/projects/d822ec06cee1472d9abaf1c7809720ee/users/e7507b7fe6ed40b7973bc572e9ae2d1b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.935557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d822ec06cee1472d9abaf1c7809720ee, user_id=e7507b7fe6ed40b7973bc572e9ae2d1b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.938497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e0209-4d92-488b-81cd-1b91898b6edd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.950334 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1476/2984] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:19 2022] PUT /identity/v3/projects/d822ec06cee1472d9abaf1c7809720ee/users/e7507b7fe6ed40b7973bc572e9ae2d1b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:19.961923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.962307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.962704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.973605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592467d4-98bc-49ba-9124-24138b5733f6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.000536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] MFA Rules not processed for user `e7507b7fe6ed40b7973bc572e9ae2d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:20.001223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.014293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:20.039242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.039915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.040196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.040467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.049201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:20.091144 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1477/2985] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:20.106216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.107827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.117638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.119156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.135712 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1509/2986] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:20.209474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603500-cf3b-4b14-b8d2-98beb6fdf708 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.216735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.217401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.217673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.217982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.244819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.246506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.274704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1478/2987] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:20.489149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.491076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.505791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625628e-5cbd-4812-90b5-36041e4da1fd service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.522504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.523027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.523310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.523579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] PATH_INFO: `/v3/projects/08eef2a9da6049319fe68f8845f4b1f1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.524817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] RBAC: Authorizing `identity:delete_project(project_id=08eef2a9da6049319fe68f8845f4b1f1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.527636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.584312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.595339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eef2a9da6049319fe68f8845f4b1f1', 'request_id': 'req-298a619e-437c-4355-98e3-1df30b1d07af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.595520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e19d-9691-447e-8b82-9d8216a37c74 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.601755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eef2a9da6049319fe68f8845f4b1f1', 'request_id': 'req-298a619e-437c-4355-98e3-1df30b1d07af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.611516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eef2a9da6049319fe68f8845f4b1f1', 'request_id': 'req-298a619e-437c-4355-98e3-1df30b1d07af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.627654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] The token cache is being invalidate because project 08eef2a9da6049319fe68f8845f4b1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:20.629731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.630940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-298a619e-437c-4355-98e3-1df30b1d07af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.634251 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1510/2988] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:20 2022] DELETE /identity/v3/projects/08eef2a9da6049319fe68f8845f4b1f1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:20.640396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce118-9833-440b-ad43-c4b9251eba76 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.640683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce118-9833-440b-ad43-c4b9251eba76 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.641240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ce118-9833-440b-ad43-c4b9251eba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.664864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.665532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.665844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.666116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] PATH_INFO: `/v3/users/abf87926377c412abc765d5feeed63c0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.667280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf87926377c412abc765d5feeed63c0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.669226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.670502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d42ce118-9833-440b-ad43-c4b9251eba76 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:20.672706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d42ce118-9833-440b-ad43-c4b9251eba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.683775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1511/2989] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:20.693027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.693316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.693587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.730254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:20.733022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.738973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf87926377c412abc765d5feeed63c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.739788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf87926377c412abc765d5feeed63c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.740435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf87926377c412abc765d5feeed63c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.745667 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1512/2990] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:20.750831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.754262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf87926377c412abc765d5feeed63c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.766336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:20.769475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-205b58d0-997f-4a00-997d-e72ac219cefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf87926377c412abc765d5feeed63c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.772008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d6ca3-d38c-4313-9dba-a863fa304248 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.779903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.780810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.781410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.781956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.782943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:20.783449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.786813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.798546 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1479/2991] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:20 2022] DELETE /identity/v3/users/abf87926377c412abc765d5feeed63c0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:20.804657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.805099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.806153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.808938 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1513/2992] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:20.813087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.815024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.831684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef978-4be9-48fe-9647-28b79cf5d08c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:20.833007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:20.834499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.882795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:20.922156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:20.922156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:20.922156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:20.922156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:20.922662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:20.922662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:20.931086 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1480/2993] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:20.941641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:20.943147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:20.967639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1514/2994] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:20 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:20.968660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.045638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3357a8-c7fa-4c4b-95e3-650dd86724c9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.051014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be38d2-f9b4-42f2-a2db-68e036c8596c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.059812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.060423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.060870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.061157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.061851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.064036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.089815 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1515/2995] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:20 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:21.094230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.106547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6909b0-1fe5-47f7-909c-302356e4bf59 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.111491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.112101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.112377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.112706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.113408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.115280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.125497 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1516/2996] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:21.129636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.130660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.131605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.132074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.132546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.140244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209642-76b5-4e14-8789-4ea7f5116c2b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.144757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.145147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.145738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.146013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.146247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.146368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.146898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.148480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a8597-ee7e-424c-89e6-b0a663e7fbfd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.157787 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1481/2997] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:57:21.159513 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1517/2998] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:21.163987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.180495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981470-4ae8-4810-9612-7f6b4d6bd350 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.186755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.187431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.187720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.188421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] PATH_INFO: `/v3/projects/78fef6627ff6418c9b64f7f1535dfe75/users/be43920925d44c94ae226ee021925d73/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.204039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fef6627ff6418c9b64f7f1535dfe75, user_id=be43920925d44c94ae226ee021925d73, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.206813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.220889 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1482/2999] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:21 2022] PUT /identity/v3/projects/78fef6627ff6418c9b64f7f1535dfe75/users/be43920925d44c94ae226ee021925d73/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:21.227408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.228840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.229249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.251019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:21.252343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:21.321088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1518/3000] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:21.342069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.362387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:21.422078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ecc29-81eb-4dd3-ba51-73a77eec1737 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.427346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.428281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.428802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.429329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.441813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.443376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.454245 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1483/3001] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:21.542852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.544402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:21.569747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9ac90-8fb3-4654-9e99-d807bed239cf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.590273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.591188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.591188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.592177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] PATH_INFO: `/v3/projects/c79d5eccb916491fabe7614186e0d6a7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.599055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79d5eccb916491fabe7614186e0d6a7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.599640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.650794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:21.668800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79d5eccb916491fabe7614186e0d6a7', 'request_id': 'req-f9fe9505-36d7-44cb-a1f8-33c80a436b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.676489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79d5eccb916491fabe7614186e0d6a7', 'request_id': 'req-f9fe9505-36d7-44cb-a1f8-33c80a436b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.698463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79d5eccb916491fabe7614186e0d6a7', 'request_id': 'req-f9fe9505-36d7-44cb-a1f8-33c80a436b62'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.710948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] The token cache is being invalidate because project c79d5eccb916491fabe7614186e0d6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:21.711236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.711890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.716249 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1519/3002] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:21 2022] DELETE /identity/v3/projects/c79d5eccb916491fabe7614186e0d6a7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:21.718257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.728969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8b46-de82-4da5-9469-1a7a8cc3e2e7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:21.819712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:21.820603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:21.823359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:21.825217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] PATH_INFO: `/v3/users/e7507b7fe6ed40b7973bc572e9ae2d1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:21.827025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7507b7fe6ed40b7973bc572e9ae2d1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:21.829996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:21.953277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7507b7fe6ed40b7973bc572e9ae2d1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.956344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7507b7fe6ed40b7973bc572e9ae2d1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.959647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7507b7fe6ed40b7973bc572e9ae2d1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:21.989447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7507b7fe6ed40b7973bc572e9ae2d1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.005598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a98a2fa-721c-4bd7-a828-340bf31f8eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7507b7fe6ed40b7973bc572e9ae2d1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.039085 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1484/3003] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:21 2022] DELETE /identity/v3/users/e7507b7fe6ed40b7973bc572e9ae2d1b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:22.442037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:22.443489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:22.465871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9505-36d7-44cb-a1f8-33c80a436b62 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:22.592078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:22.592660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.592773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.593009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] PATH_INFO: `/v3/projects/d822ec06cee1472d9abaf1c7809720ee` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.600630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d822ec06cee1472d9abaf1c7809720ee)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:22.602630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:22.718670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd822ec06cee1472d9abaf1c7809720ee', 'request_id': 'req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.733051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd822ec06cee1472d9abaf1c7809720ee', 'request_id': 'req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.747787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd822ec06cee1472d9abaf1c7809720ee', 'request_id': 'req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.768860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] The token cache is being invalidate because project d822ec06cee1472d9abaf1c7809720ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:22.769241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.770011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e5a8ac31-ce9a-4a6a-8b40-50e315d67da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.772595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1520/3004] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:22 2022] DELETE /identity/v3/projects/d822ec06cee1472d9abaf1c7809720ee => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:22.777672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.778195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.778418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.829524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:22.830965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:22.879888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:22.926452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1485/3005] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:22.935237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.935630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.935970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.959802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:22.961097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:22.971048 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1521/3006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:22.975323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:22.986399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c51a-80c0-4780-91eb-6047ad020a7b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.009177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.009919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.010198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.010472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.011133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:23.011437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.013091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.039821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1486/3007] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:23.044582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.061130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ceb0-90aa-4abf-a2c6-a2fe51919482 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.073923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.075002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.075002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.075306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.075767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.077835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.140254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1522/3008] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:23.144626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.168053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869634d1-8991-4917-a64b-70b27f4d7ba6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.293045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.294531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.295072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.295594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.296949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.301934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.354235 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1487/3009] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:23.355441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.376630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4577ede-766c-4a95-8a85-6158cbe56dea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.391578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.392307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.392671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.393371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.395207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.398967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.429742 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1523/3010] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:23.431043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.445650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48a9a-9052-4dcf-b4c7-b02faf76038e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.465767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.466489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.466769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.467061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.467811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.469733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464b79-fa5c-41c7-a046-8e56421d1fc7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.494072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.496863 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1488/3011] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:23.509911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142f13-ba9b-4050-80b9-c40ecc36da93 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.519616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.520301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.520577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.520847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] PATH_INFO: `/v3/projects/7cc6c533cbae4341a2e0b678b75cf49c/users/2f86992e452c4ab9b95e9d8fe8126f87/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.541327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:23.556740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6c533cbae4341a2e0b678b75cf49c, user_id=2f86992e452c4ab9b95e9d8fe8126f87, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.560750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.585927 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1524/3012] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:23 2022] PUT /identity/v3/projects/7cc6c533cbae4341a2e0b678b75cf49c/users/2f86992e452c4ab9b95e9d8fe8126f87/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:23.600068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.601653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.601777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.663440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] MFA Rules not processed for user `2f86992e452c4ab9b95e9d8fe8126f87`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:23.665590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:23.845219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1489/3013] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:23.850847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.944842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1e8c7-8ab3-439e-a4f9-0a034a93aec6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.960200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.967688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.968273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.968601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.969427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.971892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.052447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1525/3014] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:24.058368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.078672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af0ac-d48f-4c54-b539-a134d231a2e4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.153135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:24.208324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.209992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.210500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.210932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.211948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.214267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.241451 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1490/3015] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:24 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:24.245986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.257691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705307-6827-4fa9-82ef-d286bb66e227 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.263243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.264042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.264451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.264831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.265638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.267381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.281506 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1526/3016] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:24.285859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.301771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094a69c-a50f-4c51-8e62-e73ba9feaa4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.310949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.312583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.313472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.314027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] PATH_INFO: `/v3/projects/efe79703be014b0daa2e27ed242910e0/users/a720a13cf5a644dd99d79a9877faa021/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.335442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe79703be014b0daa2e27ed242910e0, user_id=a720a13cf5a644dd99d79a9877faa021, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.346761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.374039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1491/3017] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:24 2022] PUT /identity/v3/projects/efe79703be014b0daa2e27ed242910e0/users/a720a13cf5a644dd99d79a9877faa021/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:24.379490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.405742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b6ca-146e-48d5-886d-e45da6613d30 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.488627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.489895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.491156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.491683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.493199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.496423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07741-bf6b-4ff0-b5ec-a154c4369412 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.519388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1527/3018] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:24.520549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.535322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccae03-31d6-4875-a824-be1c65b9ad8d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.543226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.544207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.544494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.544765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] PATH_INFO: `/v3/projects/efe79703be014b0daa2e27ed242910e0/users/a720a13cf5a644dd99d79a9877faa021/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.546737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe79703be014b0daa2e27ed242910e0, user_id=a720a13cf5a644dd99d79a9877faa021, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.549407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e56519-384b-4d40-836b-5020a774adde admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.564463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1492/3019] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:24 2022] PUT /identity/v3/projects/efe79703be014b0daa2e27ed242910e0/users/a720a13cf5a644dd99d79a9877faa021/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:24.576704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794aed-16f9-4d29-a316-22d584e0aabe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.577806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794aed-16f9-4d29-a316-22d584e0aabe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.578256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794aed-16f9-4d29-a316-22d584e0aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.644618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fa794aed-16f9-4d29-a316-22d584e0aabe None None] MFA Rules not processed for user `a720a13cf5a644dd99d79a9877faa021`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:24.648237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fa794aed-16f9-4d29-a316-22d584e0aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:24.736459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:24.805037 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1528/3020] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:24.813928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.814213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.814485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.873199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] MFA Rules not processed for user `2f86992e452c4ab9b95e9d8fe8126f87`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:24.880007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:24.961693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405133-01a7-453b-baff-2aad1cd01c34 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.962252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405133-01a7-453b-baff-2aad1cd01c34 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.962252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405133-01a7-453b-baff-2aad1cd01c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.976765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1493/3021] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:24.988826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e405133-01a7-453b-baff-2aad1cd01c34 None None] MFA Rules not processed for user `d76e0eb51a9b418bb28e81b5ac1520f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:24.990107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e405133-01a7-453b-baff-2aad1cd01c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:25.003536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:25.006330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:25.121644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1529/3022] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:25.156213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca4154-273b-4181-91ff-35750f6946e9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:25.165363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:25.166190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:25.166483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:25.166829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:25.177561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:25.178896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:25.194129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1494/3023] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:28.214969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4771-c0b9-4986-8b8f-e141b22f4454 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:28.215908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4771-c0b9-4986-8b8f-e141b22f4454 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:28.216383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4771-c0b9-4986-8b8f-e141b22f4454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:28.264930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-219b4771-c0b9-4986-8b8f-e141b22f4454 None None] MFA Rules not processed for user `be43920925d44c94ae226ee021925d73`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:28.266312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-219b4771-c0b9-4986-8b8f-e141b22f4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:28.362443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1530/3024] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:28.370985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:28.373246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:28.388731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8f2b-452c-425b-b8b3-3ded64ff9b7c service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:28.405050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:28.405679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:28.405966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:28.406240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:28.417271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:28.418805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:28.431082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:28.446976 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1495/3025] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:30.176009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.176673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.176846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.207172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] MFA Rules not processed for user `be43920925d44c94ae226ee021925d73`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:30.208708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:30.226371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1531/3026] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:34.591039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:34.592970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:34.714803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b503-ad40-4719-8365-50f1badbcf87 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:34.718889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:34.719771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:34.720059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:34.720333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:34.722504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:34.739400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:34.740873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10851-117e-4d70-92fc-abf3da03e4cc service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:34.785415 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1496/3027] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:40.195497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=68 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:44.750946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=35 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:55.450121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:55.451125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:55.537367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456b58b-0bf7-4339-a1f0-79eadccea3ab None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:55.545265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:55.545950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:55.546848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:55.547189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] PATH_INFO: `/v3/users/feb7e91603d6463e9428e71c31efb6b3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:55.548630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb7e91603d6463e9428e71c31efb6b3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:55.550606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:55.653228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb7e91603d6463e9428e71c31efb6b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:55.653228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb7e91603d6463e9428e71c31efb6b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:55.663733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb7e91603d6463e9428e71c31efb6b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:55.673356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb7e91603d6463e9428e71c31efb6b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:55.675388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb7e91603d6463e9428e71c31efb6b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:55.696331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1532/3028] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:55 2022] DELETE /identity/v3/users/feb7e91603d6463e9428e71c31efb6b3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:55.701380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:55.701911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:55.701911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:55.721758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:55.723221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:55.794244 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1497/3029] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:55.805056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:55.806468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:55.866604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d8021-a075-43ea-b94e-1e6f05173245 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:55.870253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:55.870861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:55.871134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:55.871397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:55.883957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:55.886049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:55.905120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1533/3030] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:56.161882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:56.163553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:56.183118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac9597-5b13-4e84-a0e9-1963d0ebbd74 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:56.188311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:56.189309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:56.189597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:56.190018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] PATH_INFO: `/v3/projects/7d2636214d0b430d929ef27e9592488d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:56.191484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2636214d0b430d929ef27e9592488d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:56.193604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:56.252518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2636214d0b430d929ef27e9592488d', 'request_id': 'req-b37ca9ce-1472-416f-b2b8-f006dd87de11'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.265781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2636214d0b430d929ef27e9592488d', 'request_id': 'req-b37ca9ce-1472-416f-b2b8-f006dd87de11'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.274505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2636214d0b430d929ef27e9592488d', 'request_id': 'req-b37ca9ce-1472-416f-b2b8-f006dd87de11'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.286873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] The token cache is being invalidate because project 7d2636214d0b430d929ef27e9592488d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:56.287159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.287819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.289509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1498/3031] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:56 2022] DELETE /identity/v3/projects/7d2636214d0b430d929ef27e9592488d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:56.294828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:56.304977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebc648-fd4c-458b-ac98-9ccf399bb1cc service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:56.324209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:56.371695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:56.372674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:56.373107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:56.373473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] PATH_INFO: `/v3/users/86693bf0264c4ffaba154dcc9f29673e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:56.374710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86693bf0264c4ffaba154dcc9f29673e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:56.377520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:56.447569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86693bf0264c4ffaba154dcc9f29673e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.448330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86693bf0264c4ffaba154dcc9f29673e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.459959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86693bf0264c4ffaba154dcc9f29673e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.471999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86693bf0264c4ffaba154dcc9f29673e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.472772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7d4f9ad8-f1d4-430a-a76c-d14d541fc93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86693bf0264c4ffaba154dcc9f29673e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.492894 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1534/3032] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:56 2022] DELETE /identity/v3/users/86693bf0264c4ffaba154dcc9f29673e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:56.696499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:56.698607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:56.724060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca9ce-1472-416f-b2b8-f006dd87de11 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:56.794147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:56.794904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:56.795266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:56.795604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] PATH_INFO: `/v3/projects/310e5f4299b44b4bae3fc3886133251d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:56.796828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310e5f4299b44b4bae3fc3886133251d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:56.799053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:56.842488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:56.863655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310e5f4299b44b4bae3fc3886133251d', 'request_id': 'req-2e8e7568-98c6-4a71-8a84-ee3748074b45'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.869973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310e5f4299b44b4bae3fc3886133251d', 'request_id': 'req-2e8e7568-98c6-4a71-8a84-ee3748074b45'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.877682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310e5f4299b44b4bae3fc3886133251d', 'request_id': 'req-2e8e7568-98c6-4a71-8a84-ee3748074b45'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.889968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] The token cache is being invalidate because project 310e5f4299b44b4bae3fc3886133251d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:56.890254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.890961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e8e7568-98c6-4a71-8a84-ee3748074b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:56.892510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1499/3033] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:56 2022] DELETE /identity/v3/projects/310e5f4299b44b4bae3fc3886133251d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:56.899094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:56.899450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:56.899772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:56.919482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:56.920664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:56.982706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1535/3034] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:56.991545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:56.991832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:56.992108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.013297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:57.014509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:57.022439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1500/3035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:57.027459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.037233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caf013-d703-4abe-906a-970c6efad2ad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.041962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.042556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.042863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.043132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.043796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:57.044096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.045761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.058261 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1536/3036] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:57.062533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.072380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15243-cd06-47d7-abc1-10f810accff4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.077096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.077692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.077974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.078247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.078881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.080950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.109009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1501/3037] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:57 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:57.113169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.123765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e930d-33ea-4398-8dbc-932a606676fa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.152267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:57.188138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.188752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.189059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.189326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.189979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.191902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.215564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1537/3038] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:57 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:57.219786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.231302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47708b0-62a4-48c7-baaf-bcd0d41a9334 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.235997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.236617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.236898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.237201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.237838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.239432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.250203 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1502/3039] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:57.254123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.264229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f2f8-26ff-4807-a11e-a0f7a66f2dae admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.268880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.269494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.269768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.270030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.270707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.272685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cda14-ec8f-4cce-ad7a-716a843b9536 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.289088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1538/3040] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:57.292012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.303802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd2ae-fc37-49b4-8c8c-a5618a98802a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.310530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.311523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.312064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.312411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] PATH_INFO: `/v3/projects/d46da14317314fe5ad7ee374b335891f/users/679fbb3562d24d04af630ab8d37d35ae/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.330105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46da14317314fe5ad7ee374b335891f, user_id=679fbb3562d24d04af630ab8d37d35ae, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.333118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.349808 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1503/3041] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:57 2022] PUT /identity/v3/projects/d46da14317314fe5ad7ee374b335891f/users/679fbb3562d24d04af630ab8d37d35ae/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:57.362024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.362310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.362586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.399675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] MFA Rules not processed for user `679fbb3562d24d04af630ab8d37d35ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:57.401354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:57.473487 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1539/3042] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:57.478691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.569981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54544a5-6baf-421f-aa67-19179a97aa70 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.588958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.588958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.588958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.588958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.589644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.593782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.662191 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1504/3043] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:57 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:57.664194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.679755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13bae-8426-4526-af2c-7aeb558bf453 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.785559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.786173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.786453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.786721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.787351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.789500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.819130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1540/3044] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:57 2022] POST /identity/v3/users => generated 302 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:57.822971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.838953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b6bd-764e-4613-9178-5dc01eb6fb74 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.845334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.846254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.846699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.847518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.848581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.851194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.866518 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1505/3045] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:57.870803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.881694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedf26e-b6e9-4dbf-96e9-c2324443d7cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:57.889161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:57.890011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:57.890291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:57.891732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] PATH_INFO: `/v3/projects/9c4a7edb9e1647c48eea24f76772c91d/users/734c6360de7f4411a371a9845a0b1bb1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:57.910766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4a7edb9e1647c48eea24f76772c91d, user_id=734c6360de7f4411a371a9845a0b1bb1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:57.914216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:57.933762 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1541/3046] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:57 2022] PUT /identity/v3/projects/9c4a7edb9e1647c48eea24f76772c91d/users/734c6360de7f4411a371a9845a0b1bb1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:57.939587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:57.963947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6c038-f5bb-4189-9191-88f849fc6dcc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:58.001187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:58.058130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:58.058947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:58.059467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:58.059951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:58.060974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:58.062945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9140647-4796-44b6-aa4f-2eb357e8be8d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:58.077272 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1506/3047] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:58.081093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:58.088861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:58.100885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831270-df53-43bc-a2d3-75c14f8ab1fa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:58.112626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:58.113398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:58.113720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:58.113924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] PATH_INFO: `/v3/projects/9c4a7edb9e1647c48eea24f76772c91d/users/734c6360de7f4411a371a9845a0b1bb1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:58.117960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4a7edb9e1647c48eea24f76772c91d, user_id=734c6360de7f4411a371a9845a0b1bb1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:58.126377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5f306-9714-4011-8479-3e17f387e11f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:58.152268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1542/3048] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:58 2022] PUT /identity/v3/projects/9c4a7edb9e1647c48eea24f76772c91d/users/734c6360de7f4411a371a9845a0b1bb1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:58.165145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:58.165570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:58.165940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:58.270762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] MFA Rules not processed for user `734c6360de7f4411a371a9845a0b1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:58.278566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:58.387493 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1507/3049] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:58.389273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a26b3-6773-490f-8faa-0f4f19b0123e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:58.389556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a26b3-6773-490f-8faa-0f4f19b0123e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:58.389825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a26b3-6773-490f-8faa-0f4f19b0123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:58.423613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6b3a26b3-6773-490f-8faa-0f4f19b0123e None None] MFA Rules not processed for user `679fbb3562d24d04af630ab8d37d35ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:58.425208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b3a26b3-6773-490f-8faa-0f4f19b0123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:58.505461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1543/3050] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:58.517345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:58.518913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:58.637597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac5d0-bd6c-4f16-bacd-c3a450db0518 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:58.644296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:58.644933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:58.646210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:58.646210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:58.658054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:58.659968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:58.677302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1508/3051] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:02.636204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:02.637288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:02.637899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:02.660009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:02.661487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:02.769019 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1544/3052] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:02.922350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:02.925115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:03.019572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:03.113235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa8309-03a1-4e09-a819-bf52d2bd7242 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:03.124954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:03.125850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:03.126506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:03.126944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:03.143444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:03.145115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:03.154835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1509/3053] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:04.388104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:04.444166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e62b6-1cf8-446d-ae7a-8b9957c578f3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:04.462961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:04.464442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:04.464834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:04.465241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:04.480945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:04.482990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:04.495408 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1545/3054] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:05.993386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:05.995158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:06.101630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3f771-07b4-4634-8195-a5e55c2b21d9 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:06.106144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:06.106816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:06.107101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:06.107376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:06.109205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:06.123517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:06.124989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:06.138375 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1510/3055] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:58:06.158329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:06.169315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4fb3-aa43-4937-918f-e15353c4a092 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:06.189114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:06.189749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:06.190027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:06.190298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:06.203768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:06.215670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:06.219046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b3627-8ee7-46b9-b3bb-adbded6fafd9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:06.231187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1546/3056] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:08.340031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.341155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:08.445166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e9a-4b52-41f1-9b77-afbdb9537d57 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.455567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.456316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.456767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.457239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] PATH_INFO: `/v3/users/f9ad41b36abd4eb8945f3ec85ce8f5a5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.458405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ad41b36abd4eb8945f3ec85ce8f5a5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.460327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.505175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:08.516066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ad41b36abd4eb8945f3ec85ce8f5a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:08.516705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ad41b36abd4eb8945f3ec85ce8f5a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:08.517296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ad41b36abd4eb8945f3ec85ce8f5a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:08.526602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ad41b36abd4eb8945f3ec85ce8f5a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:08.535731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ad41b36abd4eb8945f3ec85ce8f5a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:08.557602 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1511/3057] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:08 2022] DELETE /identity/v3/users/f9ad41b36abd4eb8945f3ec85ce8f5a5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:08.562268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.562845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.562845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.594383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:08.596328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:08.647592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:08.673489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1547/3058] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:08.684099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.685669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:08.749209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6736b7-0fcf-40d9-ac7d-8bc096a7e55d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.753073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.754448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.754830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.755107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.766573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.767956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fe6fe-938b-453e-a42f-ae73edc79d9b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.778773 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1512/3059] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:58:09.198835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:09.200403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:09.244012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151395-fd38-4149-aa92-e36ed04be232 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.259623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.260716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.261181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.261620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] PATH_INFO: `/v3/projects/0710c69d87dc4f7fa6999e314efc8022` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.271932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0710c69d87dc4f7fa6999e314efc8022)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.274162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.371722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0710c69d87dc4f7fa6999e314efc8022', 'request_id': 'req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:09.384346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0710c69d87dc4f7fa6999e314efc8022', 'request_id': 'req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:09.404576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0710c69d87dc4f7fa6999e314efc8022', 'request_id': 'req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:09.432425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] The token cache is being invalidate because project 0710c69d87dc4f7fa6999e314efc8022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:09.432716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:09.435645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84aeeb1d-2700-4acc-89c4-3b3f70118a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:09.439554 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1548/3060] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:09 2022] DELETE /identity/v3/projects/0710c69d87dc4f7fa6999e314efc8022 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:09.445780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.446308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.447298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.512856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:09.514180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:09.670870 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1513/3061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:09.679304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.679792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.679792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.705848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:09.707316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:09.718590 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1549/3062] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:09.723137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:09.735433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ebf3-b226-410f-9ccd-61f4336d22cf None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.741326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.741961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.742250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.742507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.743166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:09.743507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.745254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.760410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1514/3063] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:09.765160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:09.778646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee094-9980-4e4a-8421-84f613f63f6d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.783500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.784118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.784450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.784724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.785617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.787556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.829234 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1550/3064] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:09 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:58:09.833000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:09.845186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fc01-44ed-4278-b8ee-33ee6f974b33 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.886484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:09.923548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.924279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.924836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.925465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.926184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.928591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.956920 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1515/3065] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:09 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:58:09.961699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:09.973340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbca570-bcd2-4d52-b562-f8490df8bbf0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.978230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.978837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.979109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.979376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.980016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.981643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.997467 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1551/3066] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:10.000825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:10.014966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0e6c-7fff-4108-92a6-612ad8f4033c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:10.021124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:10.022038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:10.022327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:10.022672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:10.023441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:10.026033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365fffb-c1ae-45bb-b43f-3e4c0f55481b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:10.046123 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1516/3067] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:10.050943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:10.065246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1c85-af88-4767-b615-d08a511fab56 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:10.072759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:10.073522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:10.073806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:10.074499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] PATH_INFO: `/v3/projects/29e6b24965e64c719592efef32efdba9/users/8d4595e2228e472cbc19945e3d50466e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:10.093779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e6b24965e64c719592efef32efdba9, user_id=8d4595e2228e472cbc19945e3d50466e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:10.097153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:10.119226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:10.119553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:10.119934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:10.122960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1552/3068] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:10 2022] PUT /identity/v3/projects/29e6b24965e64c719592efef32efdba9/users/8d4595e2228e472cbc19945e3d50466e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:58:10.147548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:10.150873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:10.238925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1517/3069] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:10.239574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:10.241408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:10.317074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c4be-d1f8-4ead-b8d2-33e244f44b24 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:10.321370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:10.322576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:10.322857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:10.323133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:10.333830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:10.335375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:10.347818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1553/3070] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:58:12.112267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:12.114185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:12.309779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5198c-a297-4122-9006-d9988a9d54fb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:12.320566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:12.321352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:12.321698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:12.322109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:12.325564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:12.487568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:12.525647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:12.528176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:12.559529 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1518/3071] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:15.543663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:15.548069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:15.572679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:15.581243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23702a-964a-4d5c-84bf-5884e4c8ec42 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:15.596935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:15.598121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:15.598800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:15.599411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:15.605409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:15.765835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:15.772873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92878-0b3d-450c-a6a7-412ddb81a956 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:15.823915 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1554/3072] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:17.713790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:17.717552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:17.958403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ddf61-179d-44e5-939d-c66b2117fd82 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:17.965956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:17.968369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:17.968655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:17.969108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:17.971112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:17.987107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:17.989245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:18.012552 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1519/3073] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:20.249333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:20.249810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:20.249904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:20.335708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] MFA Rules not processed for user `8d4595e2228e472cbc19945e3d50466e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:20.345138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:20.510800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1555/3074] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:21.647229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:21.661233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1db401-3b52-4e01-90a7-28a2e8e929e8 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:21.668802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:21.669719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:21.670157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:21.670630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:21.672716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:21.760885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:21.762667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:21.790852 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1520/3075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:21.903964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:21.906159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:21.930224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9bc28-901b-49d1-8c22-1621145754b9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:21.942860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:21.943646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:21.944017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:21.944379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] PATH_INFO: `/v3/users/a0a8b4be16e0439dbacf9d3c6cfeb527` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:21.946321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a8b4be16e0439dbacf9d3c6cfeb527)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:21.950460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:22.065366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a8b4be16e0439dbacf9d3c6cfeb527'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.066350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a8b4be16e0439dbacf9d3c6cfeb527'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.082573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a8b4be16e0439dbacf9d3c6cfeb527'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.099663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a8b4be16e0439dbacf9d3c6cfeb527'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.103490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a8b4be16e0439dbacf9d3c6cfeb527'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.130729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:22.143363 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1556/3076] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:21 2022] DELETE /identity/v3/users/a0a8b4be16e0439dbacf9d3c6cfeb527 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:22.497184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:22.513628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff75a07-03ff-4c90-8e64-20fa35efe7d8 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:22.667002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:22.676587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:22.677903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:22.678698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:22.679164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] PATH_INFO: `/v3/projects/70725194c6a84c4a991a8acc16a8bf68` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:22.681276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70725194c6a84c4a991a8acc16a8bf68)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:22.684517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:22.756422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70725194c6a84c4a991a8acc16a8bf68', 'request_id': 'req-7683ae72-e4ad-4e97-a191-6f89da05f726'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.766295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70725194c6a84c4a991a8acc16a8bf68', 'request_id': 'req-7683ae72-e4ad-4e97-a191-6f89da05f726'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.786039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70725194c6a84c4a991a8acc16a8bf68', 'request_id': 'req-7683ae72-e4ad-4e97-a191-6f89da05f726'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.811803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] The token cache is being invalidate because project 70725194c6a84c4a991a8acc16a8bf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:22.812735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.813671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:22.826573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1521/3077] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:22 2022] DELETE /identity/v3/projects/70725194c6a84c4a991a8acc16a8bf68 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:22.831523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:22.833389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:22.848964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8eac2-5522-4068-8a72-afaabc8b06d2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:22.956481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:22.958028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:22.958548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:22.959050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] PATH_INFO: `/v3/users/473dc363f4c94692a800b039a9ee9304` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:22.960499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=473dc363f4c94692a800b039a9ee9304)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:22.964777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:23.041532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473dc363f4c94692a800b039a9ee9304'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:23.046031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473dc363f4c94692a800b039a9ee9304'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:23.060383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473dc363f4c94692a800b039a9ee9304'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:23.079530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473dc363f4c94692a800b039a9ee9304'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:23.080318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0f1687fa-9cc4-4e05-af3d-f2256b494b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473dc363f4c94692a800b039a9ee9304'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:23.116894 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1557/3078] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:22 2022] DELETE /identity/v3/users/473dc363f4c94692a800b039a9ee9304 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:23.705197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:23.706702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:23.744159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683ae72-e4ad-4e97-a191-6f89da05f726 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:23.890779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:23.891720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:23.892204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:23.893023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] PATH_INFO: `/v3/projects/7b48241597284848959e20d2a6515720` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:23.894450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b48241597284848959e20d2a6515720)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:23.896822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.007812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b48241597284848959e20d2a6515720', 'request_id': 'req-05ba1940-fadc-4d16-9421-88f3c13a8221'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:24.018239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b48241597284848959e20d2a6515720', 'request_id': 'req-05ba1940-fadc-4d16-9421-88f3c13a8221'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:24.042433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b48241597284848959e20d2a6515720', 'request_id': 'req-05ba1940-fadc-4d16-9421-88f3c13a8221'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:24.074598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] The token cache is being invalidate because project 7b48241597284848959e20d2a6515720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:24.075161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:24.076079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-05ba1940-fadc-4d16-9421-88f3c13a8221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:24.078405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1522/3079] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:23 2022] DELETE /identity/v3/projects/7b48241597284848959e20d2a6515720 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:24.084030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.085330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.085896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.111363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:24.116074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:24.304307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1558/3080] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:24.305125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.305422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.305699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.340098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:24.349972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:24.370586 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1523/3081] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:24.375262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.391350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf1cb-f39d-47cc-bd89-ba3e9b6a7af0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.409882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.410575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.411026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.411306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.412087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:24.412384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:24.414268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.435056 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1559/3082] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:24.439489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.450334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b70b-82e6-4c53-8c5d-8c9c73613630 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.457080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.457844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.458230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.458605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.459351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:24.463302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.469986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:24.502548 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1524/3083] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:24 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:58:24.506831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.523592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b447e90-2813-4cd1-9afe-8f033d7a5b87 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.532946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:24.672357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.673007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.673289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.675873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.676590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:24.688159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.742279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1560/3084] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:24 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:24.746331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.762581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa264-3cd3-4944-a791-d8af2547ddf6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.787791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.788924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.790670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.791200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.792917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:24.800564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.839423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.841225 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1525/3085] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:24.862304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17df37-91fc-44c8-9c45-72259a2c2b47 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.891393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.892990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.894384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.898070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.901697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:24.905988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e3489-733d-4c44-a78a-5adeda518c2f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:24.919615 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1561/3086] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:24.923585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:24.943915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1ab4-7591-4876-88ca-1275afaef8c2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:24.969190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:24.977067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:24.977294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:24.977478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] PATH_INFO: `/v3/projects/3fd10cfadbca4c68a0bbc2e3e5a7ccd8/users/0879ef2ee11848b99f8a2421b36a8628/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:24.998857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd10cfadbca4c68a0bbc2e3e5a7ccd8, user_id=0879ef2ee11848b99f8a2421b36a8628, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:25.002058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:25.022386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1526/3087] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:24 2022] PUT /identity/v3/projects/3fd10cfadbca4c68a0bbc2e3e5a7ccd8/users/0879ef2ee11848b99f8a2421b36a8628/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:58:25.028071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:25.028358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:25.028629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:25.062774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:25.064352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:25.168422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1562/3088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:25.205258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:25.208256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:25.366430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ba2b-9c86-4c3f-973b-10b7a65b3845 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:25.371157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:25.372400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:25.372746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:25.374428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:25.393348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:25.396182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:25.413106 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1527/3089] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:27.276744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:27.278936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:27.356361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb411c-f4ac-4933-96ff-6d59dd1b793c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:27.361929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:27.362586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:27.362864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:27.363132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] PATH_INFO: `/v3/users/8d4595e2228e472cbc19945e3d50466e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:27.365069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4595e2228e472cbc19945e3d50466e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:27.368454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:27.460084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4595e2228e472cbc19945e3d50466e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:27.461562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4595e2228e472cbc19945e3d50466e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:27.470388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:27.477811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4595e2228e472cbc19945e3d50466e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:27.492957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4595e2228e472cbc19945e3d50466e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:27.494313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-212f7c2b-4e4d-4c95-8b99-939abd3b4643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4595e2228e472cbc19945e3d50466e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:27.550599 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1563/3090] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:27 2022] DELETE /identity/v3/users/8d4595e2228e472cbc19945e3d50466e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:27.874684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:27.915099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3c621-fab6-4d19-ad3a-e9c2ad74a47a service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.012831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.013511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.013785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.014061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] PATH_INFO: `/v3/projects/29e6b24965e64c719592efef32efdba9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.015192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e6b24965e64c719592efef32efdba9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.017126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.105185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:28.107347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e6b24965e64c719592efef32efdba9', 'request_id': 'req-c83a67b0-ce8b-49e0-bf34-811cc086444b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.130628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e6b24965e64c719592efef32efdba9', 'request_id': 'req-c83a67b0-ce8b-49e0-bf34-811cc086444b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.141205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e6b24965e64c719592efef32efdba9', 'request_id': 'req-c83a67b0-ce8b-49e0-bf34-811cc086444b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.158218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] The token cache is being invalidate because project 29e6b24965e64c719592efef32efdba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:28.158542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.159552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c83a67b0-ce8b-49e0-bf34-811cc086444b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.163774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1528/3091] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:27 2022] DELETE /identity/v3/projects/29e6b24965e64c719592efef32efdba9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:28.170418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.170722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.170971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.303362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:28.305447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:28.405527 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1564/3092] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:28.408424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.408986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.409387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.484692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:28.486318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:28.502841 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1529/3093] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:58:28.504255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.534661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554995-d059-415b-a5b3-c39e8e549f12 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.543475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.544434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.544997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.545282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.545968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:28.546465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.548090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.598003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.609691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443ef0a-6981-4337-80da-636e5ecd6e28 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.610357 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1565/3094] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:28.620502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.621402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.621777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.622149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.623242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.627993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.704285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1530/3095] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:28.706505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.719785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66eb8-0881-4c2b-988b-56501bf8c2dd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.801277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.801814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.802552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.802970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.803625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.806611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.861060 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1566/3096] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:58:28.866257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.888542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6759-534e-48c3-b8fe-4f4cca9ad0d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.905450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.906422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.906891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.907324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.908310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.910105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.921629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1531/3097] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:28.925318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.942981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7813d-2f7f-4b39-805a-e82aad2fc477 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.951459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.953329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.953796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.954236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.955787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.958182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60140f9d-d61b-4f62-830c-3468b8bebab9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.973608 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1567/3098] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:58:28.978005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.999554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4339-6ee4-4683-8bfa-13a5eecfcfd7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.004773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.005491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.006116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.006396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] PATH_INFO: `/v3/projects/71a60b6f0d084d349f2cd19041175d4b/users/f864f72343c84ff4a54ef0467bf34c04/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.024433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a60b6f0d084d349f2cd19041175d4b, user_id=f864f72343c84ff4a54ef0467bf34c04, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.027145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.047156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1532/3099] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:28 2022] PUT /identity/v3/projects/71a60b6f0d084d349f2cd19041175d4b/users/f864f72343c84ff4a54ef0467bf34c04/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:58:29.052565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1339-47d6-4044-be64-c4b007686780 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.052781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1339-47d6-4044-be64-c4b007686780 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.053211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1339-47d6-4044-be64-c4b007686780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.081514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-271c1339-47d6-4044-be64-c4b007686780 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:29.082845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-271c1339-47d6-4044-be64-c4b007686780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:29.092422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:29.200798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1568/3100] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:58:29.211604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.213930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:29.417746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5daa90-11af-44a8-a233-5798951e1d93 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.437857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.438571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.438856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.439148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.473094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.485612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.515457 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1533/3101] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:33.950692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2fce-0993-4dc3-95dc-782ab0591fa5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:33.951171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2fce-0993-4dc3-95dc-782ab0591fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:33.951582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2fce-0993-4dc3-95dc-782ab0591fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:34.017203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-502b2fce-0993-4dc3-95dc-782ab0591fa5 None None] MFA Rules not processed for user `0879ef2ee11848b99f8a2421b36a8628`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:34.021570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-502b2fce-0993-4dc3-95dc-782ab0591fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:34.174755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1569/3102] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:34.188117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:34.191797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:34.300638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:34.374777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8181ea0-557d-4e5d-bebc-b7f4ffe930e8 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:34.383846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:34.385309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:34.385869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:34.386349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:34.412397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:34.419320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:34.449284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1534/3103] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:39.503725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da363-30f7-4223-b2dc-35c3256ae3be None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:39.504410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da363-30f7-4223-b2dc-35c3256ae3be None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:39.504410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da363-30f7-4223-b2dc-35c3256ae3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:39.656391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c50da363-30f7-4223-b2dc-35c3256ae3be None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:39.661601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c50da363-30f7-4223-b2dc-35c3256ae3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:39.949137 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1570/3104] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:39.954334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:39.955815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:40.297982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dd51-095d-478e-8bbf-aebbc3cac6d6 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:40.315552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:40.317841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:40.319386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:40.320834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:40.343744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:40.350690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:40.380394 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1535/3105] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:40.854380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12776e-1d2e-4fe4-860a-33e3d0317ba7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:40.854932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12776e-1d2e-4fe4-860a-33e3d0317ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:40.855115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12776e-1d2e-4fe4-860a-33e3d0317ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:41.054092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-db12776e-1d2e-4fe4-860a-33e3d0317ba7 None None] MFA Rules not processed for user `f864f72343c84ff4a54ef0467bf34c04`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:41.055613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db12776e-1d2e-4fe4-860a-33e3d0317ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:41.227886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:41.355445 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1571/3106] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:58:41.372427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:41.373962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:41.409294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c41e17-61bb-45da-be74-9f0dea2503d4 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:41.421846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:41.422856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:41.423342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:41.423876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:41.445634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:41.448966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:41.484441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1536/3107] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:45.645506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:45.646127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:45.646127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:45.682619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] MFA Rules not processed for user `f864f72343c84ff4a54ef0467bf34c04`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:45.683846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:45.703019 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1572/3108] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:46.273635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:46.275011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:46.314921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf39a-904d-4106-91a4-0c991d9fbaa7 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:46.333032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:46.333835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:46.334274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:46.334553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] PATH_INFO: `/v3/users/0879ef2ee11848b99f8a2421b36a8628` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:46.335761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0879ef2ee11848b99f8a2421b36a8628)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:46.337774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:46.434746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0879ef2ee11848b99f8a2421b36a8628'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:46.435792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0879ef2ee11848b99f8a2421b36a8628'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:46.436700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0879ef2ee11848b99f8a2421b36a8628'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:46.477585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0879ef2ee11848b99f8a2421b36a8628'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:46.507430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1736773-7b3e-44b6-acd2-b0a9802e3aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0879ef2ee11848b99f8a2421b36a8628'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:46.558470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1537/3109] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:46 2022] DELETE /identity/v3/users/0879ef2ee11848b99f8a2421b36a8628 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:47.084055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:47.108450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2dd32-92d8-4d9f-82ba-ee5ce9e0268a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:47.244401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:47.245614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:47.245858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:47.245980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] PATH_INFO: `/v3/projects/3fd10cfadbca4c68a0bbc2e3e5a7ccd8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:47.252454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd10cfadbca4c68a0bbc2e3e5a7ccd8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:47.254514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:47.451879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd10cfadbca4c68a0bbc2e3e5a7ccd8', 'request_id': 'req-877ce539-02d4-401a-994c-980574138bbe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:47.478295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd10cfadbca4c68a0bbc2e3e5a7ccd8', 'request_id': 'req-877ce539-02d4-401a-994c-980574138bbe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:47.505067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd10cfadbca4c68a0bbc2e3e5a7ccd8', 'request_id': 'req-877ce539-02d4-401a-994c-980574138bbe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:47.536050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] The token cache is being invalidate because project 3fd10cfadbca4c68a0bbc2e3e5a7ccd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:47.536387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:47.537278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-877ce539-02d4-401a-994c-980574138bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:47.544637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1573/3110] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:47 2022] DELETE /identity/v3/projects/3fd10cfadbca4c68a0bbc2e3e5a7ccd8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:47.549127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:47.549675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:47.549675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:47.658067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:47.659891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:47.711314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:47.800628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1538/3111] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:47.809558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:47.809910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:47.810189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:47.859751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:47.863792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:47.890992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1574/3112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:47.895663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:47.909801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aee23-20d5-4e15-8ac0-ae7a2cbe951f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:47.924099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:47.925841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:47.927474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:47.928014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:47.930098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:47.931833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:47.937277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:47.970341 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1539/3113] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:47.974758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:47.990443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b73a1-93d9-4bb5-ac20-78d7a050c327 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.004187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.006477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.006764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.007038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.007733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.012303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.086652 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1575/3114] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:47 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:48.091677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.111006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407287-97bc-4082-b7f8-5a95cae1516a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.315181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.315664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.315950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.316219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.319259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.325771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.372760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1540/3115] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:48 2022] POST /identity/v3/users => generated 301 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:48.374048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.392320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f913-7488-4f0a-8bb7-6a23d7cf6da4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.409361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.411257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.412674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.413048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.414443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.424559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.426754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:48.439356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.488230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1576/3116] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:58:48.489335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.516040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948eb2-6a52-4886-845a-b0ae150e54cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.530058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.530681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.530957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.531222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.531868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.537986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.563225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1577/3117] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:48.569725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.578389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:48.592472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b6030-6ca5-4547-8e34-e025aad4b623 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.613931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.614694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.615049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.615394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] PATH_INFO: `/v3/projects/8b56a1a5cb59465aa604e4e0b520e46e/users/a8c39a85c2fa406783a56a555bdea66a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.628434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea273c-f12a-4913-bd44-494b32fdade2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:48.633737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:48.634399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.634680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.634955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.648083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:48.663018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b56a1a5cb59465aa604e4e0b520e46e, user_id=a8c39a85c2fa406783a56a555bdea66a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.667058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:48.668887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.672682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39172de5-7b2f-4a91-986b-4771524761a5 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:48.694683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1541/3118] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:48.721544 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1578/3119] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:48 2022] PUT /identity/v3/projects/8b56a1a5cb59465aa604e4e0b520e46e/users/a8c39a85c2fa406783a56a555bdea66a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:48.727275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:48.727586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:48.728403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:48.767714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:48.773016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:48.844417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:48.904374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1542/3120] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:48.916872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:48.919989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:49.080459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c334d82-954d-428e-b8ac-74496d5ace55 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:49.092555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:49.093354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:49.093846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:49.094300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:49.106407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:49.107900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb4a96-2dba-478f-87e4-c9ac98389812 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:49.125105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1579/3121] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:56.378605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:56.380629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:56.397425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e03ab4-9760-47fd-bcae-91390e61cf94 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:56.405406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:56.406418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:56.406869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:56.407365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] PATH_INFO: `/v3/users/2f86992e452c4ab9b95e9d8fe8126f87` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:56.409172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f86992e452c4ab9b95e9d8fe8126f87)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:56.411330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:56.485810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f86992e452c4ab9b95e9d8fe8126f87'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:56.486959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f86992e452c4ab9b95e9d8fe8126f87'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:56.487768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f86992e452c4ab9b95e9d8fe8126f87'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:56.514134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f86992e452c4ab9b95e9d8fe8126f87'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:56.525866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f86992e452c4ab9b95e9d8fe8126f87'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:56.577373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1543/3122] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:56 2022] DELETE /identity/v3/users/2f86992e452c4ab9b95e9d8fe8126f87 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:56.582801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead15cd8-825d-4221-a7c9-825627156a8a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:56.583376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead15cd8-825d-4221-a7c9-825627156a8a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:56.583514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead15cd8-825d-4221-a7c9-825627156a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:56.619177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ead15cd8-825d-4221-a7c9-825627156a8a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:56.622923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ead15cd8-825d-4221-a7c9-825627156a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:56.793428 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1580/3123] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:56.824994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:56.826532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:56.943649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d01a4-354a-44b6-9d79-9c395177903f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:56.948763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:56.950206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:56.950593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:56.951334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:56.983700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:56.985598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:57.006294 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1544/3124] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:58.007143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:58.007722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:58.007981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:58.069454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] MFA Rules not processed for user `52e08cff441e4fb0b01886d81a7b5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:58.077555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:58.340722 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1581/3125] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:58.546411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:58.548315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:58.595642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bd73d-456c-4f99-8886-8d42d420993e service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:58.624633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:58.626342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:58.626631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:58.626908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] PATH_INFO: `/v3/projects/7cc6c533cbae4341a2e0b678b75cf49c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:58.637426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc6c533cbae4341a2e0b678b75cf49c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:58.642111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:58.741966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:58.755497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc6c533cbae4341a2e0b678b75cf49c', 'request_id': 'req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:58.765543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc6c533cbae4341a2e0b678b75cf49c', 'request_id': 'req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:58.780121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc6c533cbae4341a2e0b678b75cf49c', 'request_id': 'req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:58.807327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] The token cache is being invalidate because project 7cc6c533cbae4341a2e0b678b75cf49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:58.807695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:58.808604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bed8ed4f-83e2-4430-a58c-a1d28deb6d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:58.810756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1545/3126] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:58 2022] DELETE /identity/v3/projects/7cc6c533cbae4341a2e0b678b75cf49c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:58.814829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:58.854945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71f30-cc90-46b7-b54b-8a1abdc0d750 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:58.884415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:59.045958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:59.047200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:59.047482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:59.047745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] PATH_INFO: `/v3/users/a720a13cf5a644dd99d79a9877faa021` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:59.051645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a720a13cf5a644dd99d79a9877faa021)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:59.059006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:59.283647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a720a13cf5a644dd99d79a9877faa021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:59.293420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a720a13cf5a644dd99d79a9877faa021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:59.342231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a720a13cf5a644dd99d79a9877faa021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:59.445711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a720a13cf5a644dd99d79a9877faa021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:59.454791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a720a13cf5a644dd99d79a9877faa021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:59.587313 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1582/3127] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:58 2022] DELETE /identity/v3/users/a720a13cf5a644dd99d79a9877faa021 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:58:59.862452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:59.863494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:59.864015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:59.904510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] MFA Rules not processed for user `a8c39a85c2fa406783a56a555bdea66a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:59.906140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:00.085363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1546/3128] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:58:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:00.100034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:00.101639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:00.261647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f512-8153-4d78-b7f4-147b342c79fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:00.278580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:00.279284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:00.279880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:00.280325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:00.296010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:00.300075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80310107-4c13-4029-99f3-732b1b6d304f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:00.315513 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1583/3129] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:00.739312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:00.740829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:00.957572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb638-7776-4942-a371-ba0bc5e51ba5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:00.967210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:00.968441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:00.969009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:00.969521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] PATH_INFO: `/v3/projects/efe79703be014b0daa2e27ed242910e0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:00.970940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe79703be014b0daa2e27ed242910e0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:00.973138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.073002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe79703be014b0daa2e27ed242910e0', 'request_id': 'req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:01.091908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe79703be014b0daa2e27ed242910e0', 'request_id': 'req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:01.094022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:01.108854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe79703be014b0daa2e27ed242910e0', 'request_id': 'req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:01.129145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] The token cache is being invalidate because project efe79703be014b0daa2e27ed242910e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:01.129710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:01.131641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9805e1ca-3ca4-4112-9aa7-5fb431d6387c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:01.136126 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1547/3130] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:00 2022] DELETE /identity/v3/projects/efe79703be014b0daa2e27ed242910e0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:01.141607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.142907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.143603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.217714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:01.218960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:01.246779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:01.381134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.381817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.382431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.383102 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1584/3131] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:01.411739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:01.413972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:01.430978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.440449 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1548/3132] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:01.444797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacc8f0-103b-4825-b030-18600aa22cdd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.450246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.451229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.451720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.452249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.453148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:01.453675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:01.455558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.474737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.475806 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1585/3133] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:01.489404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50cf16-e473-44b8-b0e6-b784fc9d1937 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.495401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.496027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.496306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.496579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.497279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:01.500045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.552072 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1549/3134] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:01 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:01.552283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.566596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4d36a-8f8f-421a-b8e7-3d77dcb7fa6f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.718696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.727994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.728202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.728473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.729159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:01.731111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.787688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1586/3135] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:01 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:01.789921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.808241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e45ef-3adb-4204-b8a2-fc232865e7d6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.823898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.826436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.827656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.829043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.832762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:01.838519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.867970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.881720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4cc1-f5ab-4890-aefb-b1f95e15ade2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.883213 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1550/3136] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:01.900738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.901579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.903374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.904547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:01.906275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:01.910589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714573bb-49f4-4f4d-a498-d626ed818eca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:01.940726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:01.955094 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1587/3137] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:01.959047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776f0d-8e95-4991-856f-2b67cc9b8731 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:01.975788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:01.976791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:01.978034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:01.979246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] PATH_INFO: `/v3/projects/bec2cad7804348bfbd4610e37619c4b5/users/3e780b1741cd4d558a8cf39c3f352cc2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:02.008094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec2cad7804348bfbd4610e37619c4b5, user_id=3e780b1741cd4d558a8cf39c3f352cc2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:02.011535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:02.096628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1551/3138] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:01 2022] PUT /identity/v3/projects/bec2cad7804348bfbd4610e37619c4b5/users/3e780b1741cd4d558a8cf39c3f352cc2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:02.140605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:02.141010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:02.141229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:02.222809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] MFA Rules not processed for user `3e780b1741cd4d558a8cf39c3f352cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:02.226140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:02.501790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:02.503932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1588/3139] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:02.723423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5a33-6a39-425c-9024-9fc9ee878ad3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:02.740027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:02.742034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:02.742500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:02.743155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:02.744817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:02.747729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:02.813652 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1552/3140] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:02 2022] POST /identity/v3/projects => generated 393 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:02.818242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:02.856806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159bd4-f0f9-4959-9a99-bf4e88be77fd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:02.862430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:03.045473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:03.048373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.049243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.050952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.053561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:03.057820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:03.105055 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1589/3141] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:02 2022] POST /identity/v3/users => generated 303 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:03.106776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:03.128315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f4f0-bb81-467a-b31b-90bdde26a07b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:03.145987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:03.146131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.146369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.146655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.147309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:03.148954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:03.178622 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1553/3142] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:03.183030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:03.213058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714b23-50b0-425a-9100-f34cebb319e0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:03.252331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:03.253109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.256299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.256646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] PATH_INFO: `/v3/projects/c5faa886c83e4f6f81f2e107d7c09281/users/79ee3b1740bc46f389ce2842e5895908/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.376811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5faa886c83e4f6f81f2e107d7c09281, user_id=79ee3b1740bc46f389ce2842e5895908, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:03.387802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:03.437747 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1590/3143] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:03 2022] PUT /identity/v3/projects/c5faa886c83e4f6f81f2e107d7c09281/users/79ee3b1740bc46f389ce2842e5895908/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:03.441546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:03.456747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bed9a-0e9c-43a4-8e46-888bc56d8539 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:03.679294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:03.710653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:03.711288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.711564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.712342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.713037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:03.727395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d2b76-dad5-4d6c-8748-884cb65ce973 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:03.750951 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1554/3144] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:03.755663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:03.769648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a510b3-8a2f-4f36-b08e-ddb5c1f6bfdb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:03.805230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:03.805230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.805230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.805230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] PATH_INFO: `/v3/projects/c5faa886c83e4f6f81f2e107d7c09281/users/79ee3b1740bc46f389ce2842e5895908/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.831217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5faa886c83e4f6f81f2e107d7c09281, user_id=79ee3b1740bc46f389ce2842e5895908, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:03.852242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:03.886153 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1591/3145] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:03 2022] PUT /identity/v3/projects/c5faa886c83e4f6f81f2e107d7c09281/users/79ee3b1740bc46f389ce2842e5895908/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:03.896976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:03.896976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:03.896976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:03.966079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] MFA Rules not processed for user `79ee3b1740bc46f389ce2842e5895908`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:03.967528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:04.215629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1555/3146] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:04.478364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:04.481846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:04.662098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:04.667274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:04.779179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3a1b-7c37-4196-8b32-cd3372bdc3f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:04.797696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:04.800195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:04.802499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:04.802824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:04.830722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:04.832884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:04.864267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1592/3147] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:04.923671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893345c-9721-4c99-aa91-e5d90e82208c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:04.939865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:04.940517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:04.940801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:04.943969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:04.949280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:05.179711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:05.188439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:05.247077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1556/3148] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:07.147864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:07.174286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820a07-c527-4f6f-a651-08570f9a1dac service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:07.199791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:07.200426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:07.200697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:07.200971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:07.325181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:07.356720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:07.358355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9560a-003c-47a1-b6da-8e91361496b4 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:07.393552 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1593/3149] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:07 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:07.435235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:07.467293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:07.644067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858878-1890-44a7-b59c-326b20091f1e service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:07.656016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:07.657480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:07.658262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:07.658967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] PATH_INFO: `/v3/users/3e780b1741cd4d558a8cf39c3f352cc2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:07.662067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e780b1741cd4d558a8cf39c3f352cc2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:07.684334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:07.869188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e780b1741cd4d558a8cf39c3f352cc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:07.880558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e780b1741cd4d558a8cf39c3f352cc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:07.882348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e780b1741cd4d558a8cf39c3f352cc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:07.912368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e780b1741cd4d558a8cf39c3f352cc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:07.937951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e780b1741cd4d558a8cf39c3f352cc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:07.981543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1557/3150] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:07 2022] DELETE /identity/v3/users/3e780b1741cd4d558a8cf39c3f352cc2 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:07.984865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:07.986296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:07.986578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:08.032557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:08.034165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:08.157253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1594/3151] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:08.173240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:08.175076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:08.318677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeeb40-29db-4f24-901c-214b135d1352 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:08.338945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:08.339202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:08.339544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:08.339909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:08.390861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:08.395655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:08.431599 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1558/3152] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:10.239068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:10.240611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:10.268716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27cea0-3850-425e-b608-08e3786688d9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:10.291549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:10.292570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:10.292570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:10.292766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] PATH_INFO: `/v3/projects/bec2cad7804348bfbd4610e37619c4b5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:10.298127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec2cad7804348bfbd4610e37619c4b5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:10.308809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:10.417316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec2cad7804348bfbd4610e37619c4b5', 'request_id': 'req-77e36eb2-75e5-4d23-9dda-46b40776f838'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.424314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec2cad7804348bfbd4610e37619c4b5', 'request_id': 'req-77e36eb2-75e5-4d23-9dda-46b40776f838'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.439738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec2cad7804348bfbd4610e37619c4b5', 'request_id': 'req-77e36eb2-75e5-4d23-9dda-46b40776f838'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.484949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] The token cache is being invalidate because project bec2cad7804348bfbd4610e37619c4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:10.485242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.491835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.501253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1595/3153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:10 2022] DELETE /identity/v3/projects/bec2cad7804348bfbd4610e37619c4b5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:10.505017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:10.516598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f11a-1a09-4931-9c43-a947ce3a16ad service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:10.608338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:10.645861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:10.646509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:10.646786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:10.647053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] PATH_INFO: `/v3/users/79ee3b1740bc46f389ce2842e5895908` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:10.648231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ee3b1740bc46f389ce2842e5895908)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:10.650324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:10.757354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ee3b1740bc46f389ce2842e5895908'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.758323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ee3b1740bc46f389ce2842e5895908'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.760197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ee3b1740bc46f389ce2842e5895908'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.770289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ee3b1740bc46f389ce2842e5895908'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.780896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ee3b1740bc46f389ce2842e5895908'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:10.810264 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1559/3154] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:10 2022] DELETE /identity/v3/users/79ee3b1740bc46f389ce2842e5895908 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:11.221258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:11.223023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:11.246825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36eb2-75e5-4d23-9dda-46b40776f838 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:11.359225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:11.361244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:11.409077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:11.409729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:11.411076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:11.411343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] PATH_INFO: `/v3/users/a8c39a85c2fa406783a56a555bdea66a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:11.413357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c39a85c2fa406783a56a555bdea66a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:11.415781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:11.447741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:11.527958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c39a85c2fa406783a56a555bdea66a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.528987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c39a85c2fa406783a56a555bdea66a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.542341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dffbae-90ad-4102-9784-257f8cd36dc1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:11.542908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c39a85c2fa406783a56a555bdea66a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.552863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c39a85c2fa406783a56a555bdea66a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.554334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47e1761f-e8a8-49fe-b212-e4414887d247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c39a85c2fa406783a56a555bdea66a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.556327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:11.557317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:11.557843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:11.558335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] PATH_INFO: `/v3/projects/c5faa886c83e4f6f81f2e107d7c09281` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:11.560074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5faa886c83e4f6f81f2e107d7c09281)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:11.564226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:11.605133 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1596/3155] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:11 2022] DELETE /identity/v3/users/a8c39a85c2fa406783a56a555bdea66a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:11.654831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5faa886c83e4f6f81f2e107d7c09281', 'request_id': 'req-104f6945-8277-4f77-b9af-c9f7b710c913'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.660837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:11.666017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5faa886c83e4f6f81f2e107d7c09281', 'request_id': 'req-104f6945-8277-4f77-b9af-c9f7b710c913'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.681326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5faa886c83e4f6f81f2e107d7c09281', 'request_id': 'req-104f6945-8277-4f77-b9af-c9f7b710c913'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.696051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] The token cache is being invalidate because project c5faa886c83e4f6f81f2e107d7c09281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:11.696427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.697131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-104f6945-8277-4f77-b9af-c9f7b710c913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:11.702506 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1560/3156] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:11 2022] DELETE /identity/v3/projects/c5faa886c83e4f6f81f2e107d7c09281 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:11.703848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:11.704142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:11.704423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:11.744893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:11.746516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:11.935780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:11.936426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:11.936980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:11.948634 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1597/3157] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:11.975866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:11.980745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.006559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.010374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1561/3158] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:12.024237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b8bf-d242-40c1-85b6-96d3a70407db None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.037416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.039815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.041268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.041644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.044104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:12.044534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.046765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.064354 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1598/3159] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:12.068783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.087632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c4f9-2c42-4db1-b1cc-bb220e4d9ba4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.114198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.115064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.115767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.118382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.120718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.123303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.188179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1562/3160] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:12.192549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.207386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124b3-48b6-4984-b60d-c34d480dcad9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.286125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.291184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.356210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.357681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.362212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.363064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.364514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.367561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.425875 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1599/3161] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:12 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:12.429536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.437609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:12.450548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f253eb-3eaf-461c-8b89-865c9685c00f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.457515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.458462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.459568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.460028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.461197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.463904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.481360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1600/3162] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:12.485749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.502168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95243d-29d1-4b49-9f95-87d6d8fc9a01 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.502433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9fc9-07fe-454d-a009-d455783f5042 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.508517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.510315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.510868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.513022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.514073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.516097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.523166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.527187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.527495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.527774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] PATH_INFO: `/v3/projects/8b56a1a5cb59465aa604e4e0b520e46e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.531449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b56a1a5cb59465aa604e4e0b520e46e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.535962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.542097 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1601/3163] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:12.544518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.576132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b6cd-03cd-408a-abae-a825c2908791 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.611568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.612622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.614733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.615411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] PATH_INFO: `/v3/projects/e901479a6ca34dd1bcecfe2211ea82f9/users/9e0bbdc67f9440b1bcf92e62720385cf/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.661715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e901479a6ca34dd1bcecfe2211ea82f9, user_id=9e0bbdc67f9440b1bcf92e62720385cf, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.666609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e390f0-0a87-4185-bf5c-2ca12fea0e42 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:12.683631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b56a1a5cb59465aa604e4e0b520e46e', 'request_id': 'req-8b79291c-f5a9-44d7-ab96-709044d4318e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:12.699267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1602/3164] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:12 2022] PUT /identity/v3/projects/e901479a6ca34dd1bcecfe2211ea82f9/users/9e0bbdc67f9440b1bcf92e62720385cf/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:12.699502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b56a1a5cb59465aa604e4e0b520e46e', 'request_id': 'req-8b79291c-f5a9-44d7-ab96-709044d4318e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:12.716141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.717960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.719031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.721100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b56a1a5cb59465aa604e4e0b520e46e', 'request_id': 'req-8b79291c-f5a9-44d7-ab96-709044d4318e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:12.738698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] The token cache is being invalidate because project 8b56a1a5cb59465aa604e4e0b520e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:12.740256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:12.741400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8b79291c-f5a9-44d7-ab96-709044d4318e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:12.747497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1563/3165] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:12 2022] DELETE /identity/v3/projects/8b56a1a5cb59465aa604e4e0b520e46e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:59:12.749754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952f09-bd73-4371-91ff-7b68ae5c7d85 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.750385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952f09-bd73-4371-91ff-7b68ae5c7d85 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.751193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952f09-bd73-4371-91ff-7b68ae5c7d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.769259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] MFA Rules not processed for user `9e0bbdc67f9440b1bcf92e62720385cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:12.770871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.800326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f9952f09-bd73-4371-91ff-7b68ae5c7d85 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:12.806953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9952f09-bd73-4371-91ff-7b68ae5c7d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.910961 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1603/3166] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:12.911893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.918106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.956049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:13.000756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1564/3167] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:13.002346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.002731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.003099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.064691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:13.068773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:13.078032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1565/3168] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:13.082369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.105048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99005e3-0c5f-45f0-99f5-2ef3ed1d4984 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.111422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae536-cd11-4dcc-bb3f-20bc30fb2e64 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.114388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.117775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.118840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.123366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.124108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:13.124415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.131402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.132034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.132307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.132574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.133320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.134174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.136119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.155844 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1566/3169] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:13.157211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.176402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c8c8a-3191-4a75-9e47-5a7258c15ab6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.183860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.185167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.185705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.186416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.187353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.190465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.221360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1604/3170] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:12 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:13.225831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.242025 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1567/3171] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:13 2022] POST /identity/v3/projects => generated 395 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:13.255933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.344507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:13.423966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad311-0f25-4bd0-bd92-52d802f4503b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.424469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa61c4-064a-45ee-a442-9b8da6670700 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.438297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.438926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.439197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.439466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.440108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.443386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.462368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.463015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.463370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.463526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.464152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.468067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.499307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1568/3172] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:13 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:13.502348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.512425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1605/3173] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:13 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:13.518740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.542330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14ac4-ce01-47bc-989c-748700211cff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.550853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.551618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.551970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.552311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.553100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.557430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f8504-9ed9-48dc-964b-91d023d7eba0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.558995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.571988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.572969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.573441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.573921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.574852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.576711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.597058 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1606/3174] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:13.606648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1569/3175] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:13.608766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.618403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.636400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7b77-ad96-4333-b3b1-671ecb6067ba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.640558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6654-12e9-4e7d-baf4-850f1134f8e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.650707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.651827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.652383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.652696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.653494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.655299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.656174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.656854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.657475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.657667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] PATH_INFO: `/v3/projects/8a8b8840b59141ada39249defbd0711b/users/34a681996fb447abb485bd33320c150c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.684347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1570/3176] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:13.689236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.691443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8b8840b59141ada39249defbd0711b, user_id=34a681996fb447abb485bd33320c150c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.694165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.714468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43fbf-1fc2-4269-a681-e17dc1296d4c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:13.725886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1607/3177] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:13 2022] PUT /identity/v3/projects/8a8b8840b59141ada39249defbd0711b/users/34a681996fb447abb485bd33320c150c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:13.729752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:13.817094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:13.817685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.817968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.818243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] PATH_INFO: `/v3/projects/b42c182ea9bf440ab942b314ccb7b3f7/users/69fa799041b644fb8887330c0709a3e0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.863469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42c182ea9bf440ab942b314ccb7b3f7, user_id=69fa799041b644fb8887330c0709a3e0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:13.871375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05851468-415e-431b-b0a6-03895126ee61 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.877836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:13.915113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1571/3178] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:13 2022] PUT /identity/v3/projects/b42c182ea9bf440ab942b314ccb7b3f7/users/69fa799041b644fb8887330c0709a3e0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:13.926085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:13.926654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:13.927272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:13.951000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20325df7-a4c0-4855-955f-d17f74c075d6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:14.041282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] MFA Rules not processed for user `69fa799041b644fb8887330c0709a3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:14.042987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:14.091501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:14.092237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.092521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.092794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.094667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:14.097657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:14.146181 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1608/3179] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:14.147436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:14.190878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbb5d4-e014-4ea7-93c8-0e30f1d8d9c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:14.204815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:14.205549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.205824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.206093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] PATH_INFO: `/v3/projects/8a8b8840b59141ada39249defbd0711b/users/34a681996fb447abb485bd33320c150c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.211419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8b8840b59141ada39249defbd0711b, user_id=34a681996fb447abb485bd33320c150c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:14.214704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06590b-2513-4d5b-9c13-c64eb2fa1f0c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:14.237800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1609/3180] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:14 2022] PUT /identity/v3/projects/8a8b8840b59141ada39249defbd0711b/users/34a681996fb447abb485bd33320c150c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:14.248759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe959ba-5fae-40d9-b573-8034d110b5f4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.249179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe959ba-5fae-40d9-b573-8034d110b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.249546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe959ba-5fae-40d9-b573-8034d110b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.292491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cfe959ba-5fae-40d9-b573-8034d110b5f4 None None] MFA Rules not processed for user `34a681996fb447abb485bd33320c150c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:14.293989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cfe959ba-5fae-40d9-b573-8034d110b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:14.303117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:14.308566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1572/3181] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:14.321979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:14.323571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:14.442242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1610/3182] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:14.457120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.457454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.457825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.487370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72a2f-76c0-41b8-9090-1c8ddced259c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:14.496272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] MFA Rules not processed for user `9e0bbdc67f9440b1bcf92e62720385cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:14.500557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:14.627358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:14.628250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.628636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.629234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.654809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:14.668721 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1611/3183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:14.748617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:14.750449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9d47b-a986-427b-a449-c165575efd48 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:14.763766 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1573/3184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:14 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:14.847219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:14.866845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b6cb-7969-44fa-aae1-20da27a85c79 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:14.874691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:14.876138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:14.876974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:14.877126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:14.895499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:14.897276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:14.908716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1612/3185] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:15.593764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0690e-fce3-4af8-8d2e-e73db6c07aa2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:15.594051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0690e-fce3-4af8-8d2e-e73db6c07aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:15.594327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0690e-fce3-4af8-8d2e-e73db6c07aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:15.627526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3ee0690e-fce3-4af8-8d2e-e73db6c07aa2 None None] MFA Rules not processed for user `b2706dd9c4f24a41a1e990c0517b792e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:15.628824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3ee0690e-fce3-4af8-8d2e-e73db6c07aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:15.754091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1574/3186] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:16.130483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.288229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa851e40-7b7a-41e1-9bb8-b84438be5c71 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.297246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.298400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.298664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.299115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] PATH_INFO: `/v3/users/69fa799041b644fb8887330c0709a3e0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.300562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fa799041b644fb8887330c0709a3e0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:16.303633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:16.423753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:16.442598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fa799041b644fb8887330c0709a3e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.443435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fa799041b644fb8887330c0709a3e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.455598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fa799041b644fb8887330c0709a3e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.474699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.475213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.475339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.476990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fa799041b644fb8887330c0709a3e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.478029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f0c597-65f8-476b-a0f0-cf3f0be9b116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fa799041b644fb8887330c0709a3e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.527798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:16.534338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.543511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1613/3187] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:16 2022] DELETE /identity/v3/users/69fa799041b644fb8887330c0709a3e0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:16.545704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.546139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.546499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.603777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:16.605268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.712043 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1575/3188] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:16.713127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.714903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.761578 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1614/3189] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:16.771639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.773378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.874882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488fcd-c6c3-4257-914a-006f34d88038 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.884770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.886889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.887555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.888296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.901443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:16.903211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:16.908420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:16.917919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1576/3190] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:59:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:16.934857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947331b-033d-42a5-992c-9453de9af0b5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.972711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.974070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.974357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.974632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.026395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:17.027885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ef6df-6106-491c-97cd-065d8e96e032 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.073716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1615/3191] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:20.675218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:20.676997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:20.744922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53c620-c167-4250-aae9-5cbac44d6dc1 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:20.770028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:20.770678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:20.770963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:20.771238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] PATH_INFO: `/v3/projects/b42c182ea9bf440ab942b314ccb7b3f7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:20.777774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42c182ea9bf440ab942b314ccb7b3f7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:20.780768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:20.944640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42c182ea9bf440ab942b314ccb7b3f7', 'request_id': 'req-65101944-8698-4282-91f5-d1d89db33f24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:20.970350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42c182ea9bf440ab942b314ccb7b3f7', 'request_id': 'req-65101944-8698-4282-91f5-d1d89db33f24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:21.012553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42c182ea9bf440ab942b314ccb7b3f7', 'request_id': 'req-65101944-8698-4282-91f5-d1d89db33f24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:21.046191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] The token cache is being invalidate because project b42c182ea9bf440ab942b314ccb7b3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:21.048160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:21.049291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-65101944-8698-4282-91f5-d1d89db33f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:21.055502 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1577/3192] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:20 2022] DELETE /identity/v3/projects/b42c182ea9bf440ab942b314ccb7b3f7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:21.060780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:21.061414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:21.061414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:21.127971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:21.139342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:21.410232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:21.452123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1616/3193] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:21.459646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:21.459999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:21.460278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:21.515488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:21.521687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:21.550278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1578/3194] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:21.552343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:21.569214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d248-5803-493c-ae35-e0e6b29ad205 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:21.598487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:21.599313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:21.599645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:21.600040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:21.601991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:21.602652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:21.606354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:21.656230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1617/3195] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:59:21.657713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:21.670233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca855e-e463-42d4-8d49-eb2e4f2785fa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:21.703479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:21.707408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:21.707728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:21.708005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:21.708659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:21.732043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:21.867806 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1579/3196] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:21 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:59:21.873857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:21.896748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892f97-362b-4920-9c10-25a6607007e5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:22.112182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:22.116007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:22.116503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:22.116922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:22.119270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:22.122926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:22.224374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:22.224661 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1618/3197] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:21 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:22.239150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47a88c-796f-4237-9f79-96aac58f0970 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:22.253945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:22.255090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:22.255543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:22.256064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:22.257748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:22.276718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:22.321286 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1580/3198] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:22.326249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:22.341785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b184-877c-4812-b691-2e685c01f4bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:22.367624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:22.370257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:22.370557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:22.370817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:22.371480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:22.377988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9876bc-8ee2-4495-b268-73cbec47df83 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:22.410819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1619/3199] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:22.411385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:22.438029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0037-dc93-4b3f-968e-662a531b3241 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:22.464180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:22.478632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:22.489469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:22.491050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] PATH_INFO: `/v3/projects/fd976570de164b69b58bfae7d4379e26/users/4ec2ec5910404cc9aa621b4998b067bd/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:22.576610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd976570de164b69b58bfae7d4379e26, user_id=4ec2ec5910404cc9aa621b4998b067bd, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:22.585437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0451-fa12-44c8-8714-7dd506fab367 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:22.661567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1581/3200] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:22 2022] PUT /identity/v3/projects/fd976570de164b69b58bfae7d4379e26/users/4ec2ec5910404cc9aa621b4998b067bd/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:22.674669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:22.674959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:22.675234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:22.839714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] MFA Rules not processed for user `4ec2ec5910404cc9aa621b4998b067bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:22.845062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:23.075140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1620/3201] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:23.085361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06631-4618-4467-b3f2-ce043e6d0b73 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:23.087881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06631-4618-4467-b3f2-ce043e6d0b73 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:23.088373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b06631-4618-4467-b3f2-ce043e6d0b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:23.166921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34b06631-4618-4467-b3f2-ce043e6d0b73 None None] MFA Rules not processed for user `4ec2ec5910404cc9aa621b4998b067bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:23.168169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34b06631-4618-4467-b3f2-ce043e6d0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:23.207524 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1582/3202] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:23.718281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:23.719868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:23.837332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:23.905070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d333c86-694b-493e-82b7-8a9409fee8b2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:23.925769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:23.926391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:23.926828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:23.927108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:23.960589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:23.964454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:24.005910 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1621/3203] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:33.138614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:33.978101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=11 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:34.798769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.803531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.804391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.848695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:34.850724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:34.968651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1583/3204] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:34.977163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:34.978853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:35.109826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540797a-b007-4672-9508-fd977d43f0d0 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:35.115059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:35.115923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.116307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.116682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.130752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:35.133175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.147559 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1622/3205] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:38.267796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:38.269793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:38.368653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0323c2-39c8-4ebe-98d3-3e5ba04a54bf None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:38.374838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:38.375488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:38.375764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:38.376032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] PATH_INFO: `/v3/users/be43920925d44c94ae226ee021925d73` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:38.377230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=be43920925d44c94ae226ee021925d73)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:38.379121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:38.473482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be43920925d44c94ae226ee021925d73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:38.474826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be43920925d44c94ae226ee021925d73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:38.477019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be43920925d44c94ae226ee021925d73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:38.499959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be43920925d44c94ae226ee021925d73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:38.513566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-843c6fe2-3d46-4e61-8200-fe7b46c49cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be43920925d44c94ae226ee021925d73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:38.543150 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1584/3206] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:38 2022] DELETE /identity/v3/users/be43920925d44c94ae226ee021925d73 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:38.955057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:38.969004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431a3a-d1d7-409f-9dfd-d4d987af10de service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.064611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.065303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.065985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.066365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] PATH_INFO: `/v3/projects/78fef6627ff6418c9b64f7f1535dfe75` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.068018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fef6627ff6418c9b64f7f1535dfe75)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.070769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.136488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fef6627ff6418c9b64f7f1535dfe75', 'request_id': 'req-d8bb00fc-4de2-448d-b1d8-310f23d20f42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:39.150460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fef6627ff6418c9b64f7f1535dfe75', 'request_id': 'req-d8bb00fc-4de2-448d-b1d8-310f23d20f42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:39.167623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fef6627ff6418c9b64f7f1535dfe75', 'request_id': 'req-d8bb00fc-4de2-448d-b1d8-310f23d20f42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:39.182998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] The token cache is being invalidate because project 78fef6627ff6418c9b64f7f1535dfe75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:39.183210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:39.183892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8bb00fc-4de2-448d-b1d8-310f23d20f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:39.185909 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1623/3207] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:38 2022] DELETE /identity/v3/projects/78fef6627ff6418c9b64f7f1535dfe75 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:39.190848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.191137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.191415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.232880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:39.234173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:39.310214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:39.376161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1585/3208] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:39.384397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.384649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.384869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.414033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:39.415361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:39.424222 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1624/3209] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:39.428172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.441274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426f758-93a0-486b-a4b6-1d274e8df77f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.446676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.447134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.447437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.447674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.448323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:39.448623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.450286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.466468 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1586/3210] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:39.470634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.481913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ade6-0647-4cbe-9286-9dc1ab36197e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.487356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.488284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.488738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.489351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.490448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.492565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.516586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:39.538338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1625/3211] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:39 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:59:39.542992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.557557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688336fe-2bb7-41e9-9b23-bc51d8fd4d18 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.663337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.664022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.664347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.664623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.665387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.667680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.699088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1587/3212] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:39 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:39.703144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.714490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64da0-b429-443c-883b-0dd21b2aab1c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.721048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.721757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.722111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.722488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.723273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.725234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.752881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1626/3213] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:39.753561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.786343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d52e-3857-48e3-aea9-9beb1dc34ef2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.792235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.792858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.793174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.793456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.794109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.795731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9da2a-cc0a-448c-8e49-a2d888f47671 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.809270 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1588/3214] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:39.812986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:39.824079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b153-a2e9-4bed-8ca3-1f7cedd5a62c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:39.839367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:39.840196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.840576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.841238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] PATH_INFO: `/v3/projects/c1b921cd14fb49308c16ce63d1120b1d/users/2b4bc09d609742b5b57d7e7fd6b47118/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.867065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b921cd14fb49308c16ce63d1120b1d, user_id=2b4bc09d609742b5b57d7e7fd6b47118, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:39.870815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:39.913695 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1627/3215] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:39 2022] PUT /identity/v3/projects/c1b921cd14fb49308c16ce63d1120b1d/users/2b4bc09d609742b5b57d7e7fd6b47118/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:39.919666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:39.919964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:39.920234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:39.957872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:39.959487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:40.052351 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1589/3216] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:40.064676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:40.066424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:40.146358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ab0b-7ca9-4b50-aeab-0c0e50d4793d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:40.153692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:40.154083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:40.154363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:40.154635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:40.164470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:40.166447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62f958-3b1e-443b-83ec-fdc5bce2151a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:40.176039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1628/3217] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:43.729120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:43.731154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:43.806237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:43.897372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41dda8-f744-40be-8d0c-09966df41c46 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:43.926877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:43.927514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.927798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.928068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.938178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:44.111374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.114015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:44.141674 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1590/3218] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:50.172027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:52.247697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b7d-ed65-473b-a680-2c3bc4e8a9dc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.247697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b7d-ed65-473b-a680-2c3bc4e8a9dc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.247697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b7d-ed65-473b-a680-2c3bc4e8a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.249853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:52.251428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.280654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2955db-4523-4132-946e-fae832a4919a service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:52.295177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:52.295326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a7e73b7d-ed65-473b-a680-2c3bc4e8a9dc None None] MFA Rules not processed for user `2b4bc09d609742b5b57d7e7fd6b47118`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:52.296170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.296615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.297002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7e73b7d-ed65-473b-a680-2c3bc4e8a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.297279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] PATH_INFO: `/v3/users/9e0bbdc67f9440b1bcf92e62720385cf` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.299292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0bbdc67f9440b1bcf92e62720385cf)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:52.303310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:52.429976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0bbdc67f9440b1bcf92e62720385cf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:52.431505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0bbdc67f9440b1bcf92e62720385cf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:52.432220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0bbdc67f9440b1bcf92e62720385cf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:52.435176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1629/3219] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:52.447332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.447614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.448152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.450889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0bbdc67f9440b1bcf92e62720385cf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:52.462368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8376d2d7-b2b7-4b90-82aa-81748fa4b3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0bbdc67f9440b1bcf92e62720385cf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:52.487437 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1591/3220] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:52 2022] DELETE /identity/v3/users/9e0bbdc67f9440b1bcf92e62720385cf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:59:52.494315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.494724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.495103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.499647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] MFA Rules not processed for user `2b4bc09d609742b5b57d7e7fd6b47118`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:52.500812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.523598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:52.525249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.568890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:52.619790 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1630/3221] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:52.631773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:52.631963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1592/3222] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:52.633835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.642359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:52.644082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.742372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ecb2-bd22-4411-948f-1c3928688ff1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:52.766013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:52.766997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.766997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.767215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.772965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.804356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:52.806503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:52.822344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3bc9-039f-46df-b9a7-a177cf5921c4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:52.823088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1631/3223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:52.832012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:52.833627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.835636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.836033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.861468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:52.865961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:52.911744 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1593/3224] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:53.203735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:53.205367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:53.236213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84461-fa23-42d0-b959-37c2867f43aa service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:53.247447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:53.248203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:53.248700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:53.248774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] PATH_INFO: `/v3/projects/e901479a6ca34dd1bcecfe2211ea82f9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:53.253819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e901479a6ca34dd1bcecfe2211ea82f9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:53.259701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:53.306697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:53.381887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e901479a6ca34dd1bcecfe2211ea82f9', 'request_id': 'req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.397544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e901479a6ca34dd1bcecfe2211ea82f9', 'request_id': 'req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.430582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e901479a6ca34dd1bcecfe2211ea82f9', 'request_id': 'req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.487264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] The token cache is being invalidate because project e901479a6ca34dd1bcecfe2211ea82f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:53.487565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.491399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.500180 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1632/3225] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:53 2022] DELETE /identity/v3/projects/e901479a6ca34dd1bcecfe2211ea82f9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:53.503733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:53.516881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae49638-9152-4461-96fd-a9c8b4321ef0 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:53.644593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:53.645557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:53.645848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:53.646293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] PATH_INFO: `/v3/users/34a681996fb447abb485bd33320c150c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:53.647497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a681996fb447abb485bd33320c150c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:53.649562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:53.736447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a681996fb447abb485bd33320c150c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.737290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a681996fb447abb485bd33320c150c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.738083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a681996fb447abb485bd33320c150c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.750823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a681996fb447abb485bd33320c150c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.773649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7097d839-df90-435b-aa00-06833fb417f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a681996fb447abb485bd33320c150c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.834871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:53.863180 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1594/3226] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:53 2022] DELETE /identity/v3/users/34a681996fb447abb485bd33320c150c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:54.458471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:54.462375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:54.505303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d3741-9d18-4d46-9258-5e2c1ea120ec admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:54.670812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:54.671493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:54.674361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:54.674758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] PATH_INFO: `/v3/projects/8a8b8840b59141ada39249defbd0711b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:54.682635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8b8840b59141ada39249defbd0711b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:54.692522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:54.824506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8b8840b59141ada39249defbd0711b', 'request_id': 'req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:54.861466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8b8840b59141ada39249defbd0711b', 'request_id': 'req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:54.886361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8b8840b59141ada39249defbd0711b', 'request_id': 'req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:54.919568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] The token cache is being invalidate because project 8a8b8840b59141ada39249defbd0711b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:54.919864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:54.921465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6c7a37de-c4c8-4e00-8108-2e8b18df88f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:54.927567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1633/3227] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:54 2022] DELETE /identity/v3/projects/8a8b8840b59141ada39249defbd0711b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:54.930408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:54.931400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:54.931532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:54.980886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:54.982143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:55.171368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1595/3228] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:55.180454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.180844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.181232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.240378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:55.242455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:55.286384 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1634/3229] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:55.291332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.318304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c86a3-c07b-4331-ac03-2e20eca3ae0a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.323692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.324521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.324801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.325146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.325938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:55.326244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.328033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.356537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.366636 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1596/3230] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:55.366946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5ca5-25bc-4a56-ad2a-20852e0d1580 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.376281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.376974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.377229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.377522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.378581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.391293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.484468 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1635/3231] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:55.488151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.501840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65240783-6f94-4a96-a867-a0268a7855be admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.603489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.604118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.604395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.604667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.605358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.610666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.665417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1597/3232] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:55.669365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.691654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:55.699030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429376e-6f59-4610-b584-9726206f3193 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.731917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.732784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.733244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.733655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.734488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.740656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.755366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1636/3233] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:55.760507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.792080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279949-1bd5-45b7-9a85-9d9af4184f53 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.800495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.809476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.809476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.809476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.809476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.809476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ee6bd-273a-4aae-9857-31474a1b94c7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.846404 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1598/3234] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:55.847208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.860792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8de55-b744-4e4b-bf7d-401c60c1be7b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.878309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.879150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.879431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.879727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] PATH_INFO: `/v3/projects/bacc4338668a483cb1db22e32729a5f1/users/9c8f9fcac85e4b218eb284c19667eca0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.911423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacc4338668a483cb1db22e32729a5f1, user_id=9c8f9fcac85e4b218eb284c19667eca0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.939664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664ea7-1628-4689-818a-562131f6c430 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.979302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1637/3235] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:55 2022] PUT /identity/v3/projects/bacc4338668a483cb1db22e32729a5f1/users/9c8f9fcac85e4b218eb284c19667eca0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:55.989847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.990374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.990374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.121188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] MFA Rules not processed for user `9c8f9fcac85e4b218eb284c19667eca0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:56.122685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.250304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.250892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.251232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.325405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:56.330810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.332780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:56.366601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1599/3236] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:56.369360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.533640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1638/3237] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:56.551282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.553037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.577968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb8ef-77d6-4a1b-abc5-5611c2ea559c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.592477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.593488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.593850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.596302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.597083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.599216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:56.672796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1600/3238] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:56 2022] POST /identity/v3/projects => generated 393 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:56.690070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.749859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792c71-05c7-4d17-9b47-0e3842c1d2e3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.873455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133728a-7228-49a0-82eb-df13a2322c38 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.885263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.885862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.886243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.886728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.887501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.890487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:56.902887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.903524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.903826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.904065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.927539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1601/3239] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:56 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:56.929150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.939980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:56.965255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ccc7-5262-4533-8739-962c53209972 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.985221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.985859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.986139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.986638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.987056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.989086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.012682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1602/3240] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:57.014138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.026127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.027744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.033070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1e13-3d51-47b0-b0c5-55f2c9e14d67 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.042164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.043150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.043609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.043812 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1639/3241] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 09:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:59:57.044400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] PATH_INFO: `/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f/users/82034c5ee1fb4eb28fae15c16f271b70/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.068004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbe371f8b8f45a489923a2cfa2a096f, user_id=82034c5ee1fb4eb28fae15c16f271b70, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.071699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.124386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1603/3242] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:57 2022] PUT /identity/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f/users/82034c5ee1fb4eb28fae15c16f271b70/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:59:57.126331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.149306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ecff-4a6b-4cb3-813a-530ddbbc9b03 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.326447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.336415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.336767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.337105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.341706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.343799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee33b1-be7f-4ddc-b4ce-d8f6d46e57af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.373868 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1640/3243] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:57.378015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.396225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7556-99af-4519-bb6d-bc89f7e63bf5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.413297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.413993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.414333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.414546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] PATH_INFO: `/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f/users/82034c5ee1fb4eb28fae15c16f271b70/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.418924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbe371f8b8f45a489923a2cfa2a096f, user_id=82034c5ee1fb4eb28fae15c16f271b70, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.425206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.444498 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1604/3244] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:57 2022] PUT /identity/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f/users/82034c5ee1fb4eb28fae15c16f271b70/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:57.459911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.460359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.460853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.508116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] MFA Rules not processed for user `82034c5ee1fb4eb28fae15c16f271b70`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:57.509465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.666231 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1641/3245] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:57.898530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.902870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.985167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:58.117703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c991-401f-411e-87ad-5794727e3b1f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.131743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.132376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.132654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.132944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.154371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.156445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.182884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1605/3246] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:58.571334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.573329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.638218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.639748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.664561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684624fa-1ef9-4b78-86cb-96d2e1304fe6 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.691199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.692091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.692437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.694141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.708277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:58.744826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215563-70eb-4441-8ca8-75ac5cc99da3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.755793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.756658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.757145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.757943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.764995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.836376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.839744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.888320 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1606/3247] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:58.907078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.992413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.994480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed363d-80bf-4915-a806-6264ef82e092 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.013507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1642/3248] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:59.062044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b295d-aa08-429e-9fbc-a872a99f8cf4 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.068376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.069305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.069805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.070458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] PATH_INFO: `/v3/users/9c8f9fcac85e4b218eb284c19667eca0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.072587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8f9fcac85e4b218eb284c19667eca0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.075051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.194839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:59.197983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8f9fcac85e4b218eb284c19667eca0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.198787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8f9fcac85e4b218eb284c19667eca0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.199632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8f9fcac85e4b218eb284c19667eca0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.225435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8f9fcac85e4b218eb284c19667eca0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.240504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8f9fcac85e4b218eb284c19667eca0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.301939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1607/3249] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:58 2022] DELETE /identity/v3/users/9c8f9fcac85e4b218eb284c19667eca0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:59.307089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.307887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.308154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.347419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:59.348748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:59.508500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1643/3250] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 09:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:59.548273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.551067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:59.730674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c9ba-4413-4458-8bbc-479776afdbfe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.741742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.742576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.743389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.743664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.771845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.773491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.794582 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1608/3251] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:59.943956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.948429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:00.076742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82399-f268-46bc-be02-65fba915ad89 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:00.096219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:00.099005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:00.099359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:00.099900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:00.105119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:00.170464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:00.317618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:00.320508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:00.347272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1644/3252] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:00.710138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:00.716230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:00.793649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a68b2-6c6e-473d-ad03-560cd61dc11f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:00.826520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:00.830484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:00.833371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:00.833897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] PATH_INFO: `/v3/projects/bacc4338668a483cb1db22e32729a5f1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:00.839926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacc4338668a483cb1db22e32729a5f1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:00.843596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:00.993697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacc4338668a483cb1db22e32729a5f1', 'request_id': 'req-90c248e4-3b8f-424a-82fb-cb326ec508b0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.005662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacc4338668a483cb1db22e32729a5f1', 'request_id': 'req-90c248e4-3b8f-424a-82fb-cb326ec508b0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.015494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacc4338668a483cb1db22e32729a5f1', 'request_id': 'req-90c248e4-3b8f-424a-82fb-cb326ec508b0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.040428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] The token cache is being invalidate because project bacc4338668a483cb1db22e32729a5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:01.040715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.041317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.043066 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1609/3253] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:00 2022] DELETE /identity/v3/projects/bacc4338668a483cb1db22e32729a5f1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:01.047022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:01.065730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495eac1-3285-41fa-9e9a-48100da10630 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:01.208597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:01.209279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:01.209555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:01.209826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] PATH_INFO: `/v3/users/82034c5ee1fb4eb28fae15c16f271b70` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:01.210950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82034c5ee1fb4eb28fae15c16f271b70)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:01.218848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:01.353071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82034c5ee1fb4eb28fae15c16f271b70'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.358070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82034c5ee1fb4eb28fae15c16f271b70'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.373478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82034c5ee1fb4eb28fae15c16f271b70'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.391569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82034c5ee1fb4eb28fae15c16f271b70'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.392358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-25b9149b-6e68-46fa-a764-b63a085c6278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82034c5ee1fb4eb28fae15c16f271b70'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.415925 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1645/3254] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:01 2022] DELETE /identity/v3/users/82034c5ee1fb4eb28fae15c16f271b70 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:02.808707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:02.810437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:02.863488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c248e4-3b8f-424a-82fb-cb326ec508b0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:02.962825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:02.988266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:02.989077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.989331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.989796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] PATH_INFO: `/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.991340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbe371f8b8f45a489923a2cfa2a096f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:02.993429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.099705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbe371f8b8f45a489923a2cfa2a096f', 'request_id': 'req-ae98826a-5b9b-497e-bee8-858fdea35c75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.110935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbe371f8b8f45a489923a2cfa2a096f', 'request_id': 'req-ae98826a-5b9b-497e-bee8-858fdea35c75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.130876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbe371f8b8f45a489923a2cfa2a096f', 'request_id': 'req-ae98826a-5b9b-497e-bee8-858fdea35c75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.159603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] The token cache is being invalidate because project 5dbe371f8b8f45a489923a2cfa2a096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:03.160009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.161507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae98826a-5b9b-497e-bee8-858fdea35c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.164154 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1610/3255] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:02 2022] DELETE /identity/v3/projects/5dbe371f8b8f45a489923a2cfa2a096f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:03.170144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.171086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.171522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.226358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:03.236974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.339527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:03.402134 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1646/3256] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:03.405109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.407197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.407541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.466999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:03.468591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.489437 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1611/3257] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:03.493758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.512315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0af47-e3ec-47d5-8d71-859f278fc709 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.520514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.521232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.521518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.521789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.523056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:03.523365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.528352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.571684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1647/3258] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:03.575966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.593350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d2ab-1669-4a86-9ec5-b0b0aa6006e8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.607407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.608049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.608557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.608993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.609653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.611638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.718624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1612/3259] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:03.719850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.734127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0ed89-f9ff-4f9c-a72f-377090a02ab2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.920639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.921298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.921575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.921844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.928455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.936622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.008093 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1648/3260] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/users => generated 286 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:04.009633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.028855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c02b8-ab74-4765-a915-520af942aece admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.035904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.036845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.037418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.037697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.038415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.040809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.056353 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1613/3261] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:04.057632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.070907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe44c8-4539-4ace-92c4-a3180a0e5be8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.079196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.079946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.080228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.080631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.081884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.083915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90145c8e-4514-4483-8527-47462be482ff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.110097 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1649/3262] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:04.114071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.130117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a7dd-18f9-4b3c-9054-20f1888613dc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.141545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.143007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.143589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.143871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] PATH_INFO: `/v3/projects/281a28d9d47942658dbe3b856bc65dcf/users/00327723c79844239950d8292146d231/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.164127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281a28d9d47942658dbe3b856bc65dcf, user_id=00327723c79844239950d8292146d231, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.169883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.212132 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1614/3263] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:04 2022] PUT /identity/v3/projects/281a28d9d47942658dbe3b856bc65dcf/users/00327723c79844239950d8292146d231/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:04.212743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95b48-c64c-4565-9c9b-a39c4265c201 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.213176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95b48-c64c-4565-9c9b-a39c4265c201 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.213260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95b48-c64c-4565-9c9b-a39c4265c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.288386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f5f95b48-c64c-4565-9c9b-a39c4265c201 None None] MFA Rules not processed for user `00327723c79844239950d8292146d231`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:04.290253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f5f95b48-c64c-4565-9c9b-a39c4265c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:04.430579 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1650/3264] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:05.211978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:05.215406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:05.387671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:05.400297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9a6d-d940-455c-bd9e-4a6fe6625f25 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:05.409720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:05.410785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:05.411508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:05.412397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:05.435075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:05.437579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:05.449751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1615/3265] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:07.892613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:07.895635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:07.896110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:07.925572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:07.927319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:08.003312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:08.039360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1651/3266] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:08.109143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:08.110769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:08.292402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab596cc-b533-4b2f-8e22-410427c2dc1e service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:08.311904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:08.316876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:08.317453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:08.317923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:08.328604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:08.331173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:08.342915 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1616/3267] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:11.702078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:11.704076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:11.832428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fffd-0dc7-4150-a143-73f249db818e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:11.867356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:11.873310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:11.873612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:11.873903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:11.894368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:11.930948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:11.932568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706119e0-f1f0-4989-bfd9-b410795cbb76 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:11.962939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1652/3268] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:12.272153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:12.528966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a41e44-397f-46ef-9fec-8c4b561b3d0c service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:12.551876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:12.553135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:12.553661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:12.554158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] PATH_INFO: `/v3/users/00327723c79844239950d8292146d231` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:12.556820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00327723c79844239950d8292146d231)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:12.560037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:12.674574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00327723c79844239950d8292146d231'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:12.674574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00327723c79844239950d8292146d231'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:12.675329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00327723c79844239950d8292146d231'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:12.693212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00327723c79844239950d8292146d231'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:12.709203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00327723c79844239950d8292146d231'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:12.740161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:12.760472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1617/3269] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:12 2022] DELETE /identity/v3/users/00327723c79844239950d8292146d231 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:12.763438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:12.764348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:12.765052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:12.842291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:12.844343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:13.137628 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1653/3270] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:13.143376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:13.144989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:13.380632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220302bb-9990-4419-aa10-35efcc86812a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:13.387464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:13.388324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:13.390089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:13.390706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:13.414378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:13.416680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50326-5757-47d8-8db5-78195ddb22cc service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:13.443896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1618/3271] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:14.489061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:14.490645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:14.525886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeafc7a-fbc7-4a97-8e1a-d7913ce21827 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:14.540936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:14.543181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:14.543712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:14.544674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] PATH_INFO: `/v3/projects/281a28d9d47942658dbe3b856bc65dcf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:14.548706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=281a28d9d47942658dbe3b856bc65dcf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:14.552961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:14.668791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281a28d9d47942658dbe3b856bc65dcf', 'request_id': 'req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:14.687482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281a28d9d47942658dbe3b856bc65dcf', 'request_id': 'req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:14.707204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281a28d9d47942658dbe3b856bc65dcf', 'request_id': 'req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:14.735315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] The token cache is being invalidate because project 281a28d9d47942658dbe3b856bc65dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:14.736568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:14.738422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1cf22d3-989f-44b5-a3db-b2849ba8ae7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:14.748108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:14.748635 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1654/3272] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:14 2022] DELETE /identity/v3/projects/281a28d9d47942658dbe3b856bc65dcf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:14.749095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:14.749563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:14.807673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:14.823617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:15.031450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1619/3273] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:15.033184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.033479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.033743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.080916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:15.084035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:15.113286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.117978 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1655/3274] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:15.124686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d578ee-9440-4322-a9ec-447f55e4fa09 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.136339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.137586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.138074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.138723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.139599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:15.140141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.142126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:15.214987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.217604 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1620/3275] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:15.223299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:15.238495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0864-d8d5-4171-b6da-f4e9df91003f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.260766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.271785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.272038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.272267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.272931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.275635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:15.460584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1656/3276] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:00:15.464035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.477547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a458c-c5e5-4e1b-9d30-911380f7d68c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.604229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.604875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.605191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.605462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.606137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.608154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:15.701085 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1621/3277] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:15 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:15.702779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.731960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3e67-e30c-4a9a-aa23-0456cd789a6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.745906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.746813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.747263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.747685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.748775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.751654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:15.782182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.786607 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1657/3278] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:15.799473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7f00-9e6b-433c-a70c-e54db10e36ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.821985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.822612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.822879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.823143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.823786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.825451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30719-23df-479e-ac8a-74a6d3c25c0e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:15.860632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1622/3279] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:00:15.862333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:15.889234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f6c0-a6b0-4378-b597-f3609722bcf2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:15.901601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:15.902660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:15.903137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:15.903622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] PATH_INFO: `/v3/projects/62cc361b65c04697b7c9b850ed2374d9/users/a721f00ecff14a01b2b7a600581eafe9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:15.950794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cc361b65c04697b7c9b850ed2374d9, user_id=a721f00ecff14a01b2b7a600581eafe9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:15.954958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:16.009655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1658/3280] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:15 2022] PUT /identity/v3/projects/62cc361b65c04697b7c9b850ed2374d9/users/a721f00ecff14a01b2b7a600581eafe9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:16.013441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:16.013731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:16.014927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:16.117540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:16.154613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] MFA Rules not processed for user `a721f00ecff14a01b2b7a600581eafe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:16.155877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:16.359631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1623/3281] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:17.881142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:17.884626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:18.210086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2e88-2940-491a-b523-5f58790e4f09 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:18.228030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:18.228867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:18.229274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:18.229640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:18.255031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:18.256824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:18.279317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1659/3282] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:19.159428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.160996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:19.314888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf4ad9-b92a-47e7-8db4-f09d1afbfef2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.331334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.332100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.332464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.332743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.338815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:19.394912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.396620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.402985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.405318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:19.448242 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1624/3283] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:19.696871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fce40-62fa-42ab-ad3f-edbf0b2c0d3d service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.709322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.710038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.710314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.710583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] PATH_INFO: `/v3/users/d76e0eb51a9b418bb28e81b5ac1520f9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.711784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76e0eb51a9b418bb28e81b5ac1520f9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.713781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.791000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:19.850156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76e0eb51a9b418bb28e81b5ac1520f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:19.851576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76e0eb51a9b418bb28e81b5ac1520f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:19.869734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76e0eb51a9b418bb28e81b5ac1520f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:19.894470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76e0eb51a9b418bb28e81b5ac1520f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:19.895446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76e0eb51a9b418bb28e81b5ac1520f9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:19.973989 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1660/3284] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:19 2022] DELETE /identity/v3/users/d76e0eb51a9b418bb28e81b5ac1520f9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:20.284167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:20.285676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.504191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:20.506101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.540354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df08b9a-54f2-4036-83e9-d2d9bee0d59a service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:20.628419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:20.717317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:20.719900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:20.720192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:20.720466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:20.725379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66642f-c5f9-4f7f-b22d-1b0a85e0ac9b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:20.727843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.747761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:20.750310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:20.750654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:20.750934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] PATH_INFO: `/v3/projects/38bd1e9a411e49c0b6c13914f4b53caf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:20.755182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bd1e9a411e49c0b6c13914f4b53caf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:20.760052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:20.888289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bd1e9a411e49c0b6c13914f4b53caf', 'request_id': 'req-fd14840f-6d99-4221-b25f-463efd1db934'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:20.898191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bd1e9a411e49c0b6c13914f4b53caf', 'request_id': 'req-fd14840f-6d99-4221-b25f-463efd1db934'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:20.921703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bd1e9a411e49c0b6c13914f4b53caf', 'request_id': 'req-fd14840f-6d99-4221-b25f-463efd1db934'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:20.927066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:20.934626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eef26-9cdf-46ed-8dab-d09be066d1ad service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:20.948951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] The token cache is being invalidate because project 38bd1e9a411e49c0b6c13914f4b53caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:20.949311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:20.950229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:20.957366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1661/3285] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:20 2022] DELETE /identity/v3/projects/38bd1e9a411e49c0b6c13914f4b53caf => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:00:20.960701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:20.964165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.967423 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1625/3286] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:21.085658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:21.125734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14840f-6d99-4221-b25f-463efd1db934 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:21.145667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:21.149897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:21.150475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:21.150766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] PATH_INFO: `/v3/users/e1ab306d44cc4ac683d6a1715472c18a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:21.153588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ab306d44cc4ac683d6a1715472c18a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:21.155861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:21.283732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ab306d44cc4ac683d6a1715472c18a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:21.285122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ab306d44cc4ac683d6a1715472c18a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:21.305486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ab306d44cc4ac683d6a1715472c18a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:21.357463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ab306d44cc4ac683d6a1715472c18a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:21.366416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ab306d44cc4ac683d6a1715472c18a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:21.442923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:21.443697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:21.443881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1662/3287] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:20 2022] DELETE /identity/v3/users/e1ab306d44cc4ac683d6a1715472c18a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:21.450783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:21.646573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:21.650060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:21.855783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1626/3288] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:21.908986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:21.913051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.070674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64f4c-1b38-49ad-a812-0068d2ade681 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:22.076917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:22.077706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.077985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.078251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.091735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:22.094266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ec07-fd41-47af-9025-35b44772fbfe service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:22.115441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1663/3289] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:22.127543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:22.129125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.261805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:22.337383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4aa9b-05e1-4262-88f6-b025c1970537 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:22.353215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:22.353487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.353929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.353929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] PATH_INFO: `/v3/projects/209ee62e87b644d88681cd0ff30bcb78` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.356008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209ee62e87b644d88681cd0ff30bcb78)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:22.383106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:22.535266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209ee62e87b644d88681cd0ff30bcb78', 'request_id': 'req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:22.553522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209ee62e87b644d88681cd0ff30bcb78', 'request_id': 'req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:22.572872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209ee62e87b644d88681cd0ff30bcb78', 'request_id': 'req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:22.627086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4508-cee3-4bfd-8154-e33d4327b4c9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.627376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4508-cee3-4bfd-8154-e33d4327b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.627593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4508-cee3-4bfd-8154-e33d4327b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.629793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] The token cache is being invalidate because project 209ee62e87b644d88681cd0ff30bcb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:22.630613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:22.631798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a77fbd8f-33a5-4a1c-94e0-ead2646ba7c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:22.643627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1627/3290] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:22 2022] DELETE /identity/v3/projects/209ee62e87b644d88681cd0ff30bcb78 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:22.646960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.648171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.648596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.684109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-263d4508-cee3-4bfd-8154-e33d4327b4c9 None None] MFA Rules not processed for user `a721f00ecff14a01b2b7a600581eafe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:22.685452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-263d4508-cee3-4bfd-8154-e33d4327b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.751213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:22.758903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.776619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:22.899759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1664/3291] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:23.033211 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1628/3292] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:23.042003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.043085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.043579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.117913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:23.125885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:23.143830 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1665/3293] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:23.148445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.194300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed186d3-08aa-492c-ade3-8d6a1bbc491c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.214900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.215995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.218505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.219106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.222104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:23.225527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.234438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.279027 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1629/3294] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:23.280677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.299248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340c1bf-b51a-43b5-a803-3852e94c315d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.317105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.317927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.318660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.319035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.320016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.339491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18770448-2586-4f03-874e-6c6599d3c7a2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.450080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1666/3295] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:23 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:23.452091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.469404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302e23-02b3-446c-8a57-b6aa789ece95 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.652584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.652996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.653349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.682363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:23.697650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:23.713812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:23.714746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.716569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.718159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.718456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.719637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.722685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.784091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1630/3296] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:23 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:23.787015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.813543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a765-60c5-479b-a6c7-f161ef49db15 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.825266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.825915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.826404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.826701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.827668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.830692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.864739 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1631/3297] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:23.864739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.880157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a89c5-7368-40bd-8c4b-a4cf715a1bf4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.887180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.888360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.888814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.889270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.890228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.892991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.910158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1667/3298] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:23.922653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.929118 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1632/3299] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:23.933892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.936190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:23.949646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5b82-e25d-4513-8e6d-2ae7cc9c67f5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.961542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.963871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.964526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.966987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] PATH_INFO: `/v3/projects/cbc6c86197e942fc981ada7b252f3923/users/983056352c024fdab33b6b77970dad6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.999173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc6c86197e942fc981ada7b252f3923, user_id=983056352c024fdab33b6b77970dad6f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.007929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fa8b5-09ef-4ad3-82df-71b912590f76 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.051747 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1633/3300] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:23 2022] PUT /identity/v3/projects/cbc6c86197e942fc981ada7b252f3923/users/983056352c024fdab33b6b77970dad6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:00:24.053324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.053677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.053962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.088819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] MFA Rules not processed for user `983056352c024fdab33b6b77970dad6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:24.091025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:24.143313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c43f-22ae-458d-b896-2d44c7a84748 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.229892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:24.253049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.254522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.255511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.255623 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1634/3301] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:24.256180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.261619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:24.420022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.423184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.438127 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1668/3302] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:24.463220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a95589-f79b-468c-98c0-9ae3beb61006 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.473180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.477669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.478588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.479426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.481230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.487356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.589188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1635/3303] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:24.589426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:24.617442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ca47-bb72-4fc2-ac22-9a3af8381bc8 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.822702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.824391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.824688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.825010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.826865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.831842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.886903 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1669/3304] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:24 2022] POST /identity/v3/users => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:00:24.889785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:24.906633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68e77-4807-4628-b4f6-e43351a00db6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.918737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.919413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.919692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.919969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.920649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.925934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.963081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1636/3305] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:24.965435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:24.980749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7279-b2fc-4b1e-917a-9dfaee3c252e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.989614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.990372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.990659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.996128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] PATH_INFO: `/v3/projects/a4017ef8159b45d197cfba851eb5c04e/users/7709ffd4779e4d3385498636936cec40/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:25.034786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4017ef8159b45d197cfba851eb5c04e, user_id=7709ffd4779e4d3385498636936cec40, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:25.056000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:25.079942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1670/3306] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:24 2022] PUT /identity/v3/projects/a4017ef8159b45d197cfba851eb5c04e/users/7709ffd4779e4d3385498636936cec40/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:25.083286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:25.091315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:25.100205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d748e0-a4db-4a3b-a9ca-c75ac3f8fea2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:25.290009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:25.290993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:25.291424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:25.291844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:25.292639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:25.294573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c323-2223-45c3-97bd-02bdf1714964 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:25.331121 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1637/3307] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:25.332237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:25.365011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e4792-f8b7-436b-9109-cc4efed616c4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:25.396047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:25.396932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:25.397438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:25.397719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] PATH_INFO: `/v3/projects/a4017ef8159b45d197cfba851eb5c04e/users/7709ffd4779e4d3385498636936cec40/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:25.408536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4017ef8159b45d197cfba851eb5c04e, user_id=7709ffd4779e4d3385498636936cec40, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:25.413325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:25.476292 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1671/3308] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:25 2022] PUT /identity/v3/projects/a4017ef8159b45d197cfba851eb5c04e/users/7709ffd4779e4d3385498636936cec40/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:25.479649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:25.479959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:25.480212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:25.542033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] MFA Rules not processed for user `7709ffd4779e4d3385498636936cec40`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:25.543063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:25.733955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1638/3309] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:26.738981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:26.740793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:26.890793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:26.942310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cc6fc-6106-46f2-971f-d9b7c3399059 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:26.952521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:26.953344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:26.953771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:26.954201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.101879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.103675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec3ff-fbb7-4f5d-a69c-0724b74d9e6d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.161611 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1672/3310] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:30.780620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:30.783149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:30.946878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d4a4c-7716-4515-9d6c-2a508afa0ffc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:30.957222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:30.964053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:30.964709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:30.966734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:30.972476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:30.998221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:31.003880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:31.032624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1639/3311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:31.588854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:31.589845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:31.590282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:31.656477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:31.660679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:31.833065 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1673/3312] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:31.848114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:31.943282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:32.019152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f858fa-2c11-4b08-82da-7bd0171ac5d9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:32.026720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:32.028356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.028486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.028683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.065034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:32.066846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:32.109141 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1640/3313] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:32.355220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:32.357033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:32.386949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:32.422412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733847dd-1d52-4dfd-a4ec-9eca6e0a298a service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:32.435861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:32.436678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.437238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.437426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.472886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:32.478909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fee0-7256-40bb-83a8-72f181a6cd88 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:32.520537 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1641/3314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:32.521882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.522174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.522448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.565960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:32.569642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:32.581457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56a2a-90e8-4b2e-a6ca-91af68cdc40d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:32.590004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1642/3315] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:32.600047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:32.600827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.601226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.601592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] PATH_INFO: `/v3/users/a721f00ecff14a01b2b7a600581eafe9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.603764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a721f00ecff14a01b2b7a600581eafe9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:32.605894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:32.606775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:32.630919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cdc7e-b1b1-4d79-addf-3126ea09c276 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:32.649869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:32.658373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.659313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.663835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.680931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:32.687528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:32.700233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628aff5-461e-4e99-ba21-d77bef161a59 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:32.718845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1643/3316] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:32.720638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a721f00ecff14a01b2b7a600581eafe9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.721918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a721f00ecff14a01b2b7a600581eafe9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.752111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a721f00ecff14a01b2b7a600581eafe9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.779900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a721f00ecff14a01b2b7a600581eafe9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.780935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a721f00ecff14a01b2b7a600581eafe9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.810566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1674/3317] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:32 2022] DELETE /identity/v3/users/a721f00ecff14a01b2b7a600581eafe9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:32.815264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.816087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.816446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.842444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:32.843779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:33.018170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1644/3318] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:33.048474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:33.049968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:33.186003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bee6d6-cabf-40d6-891a-6862abc184c4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:33.191740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:33.192371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:33.192698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:33.193488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:33.239320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:33.240797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632db26-1be5-4381-b6d1-99a2d921a9f7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:33.274940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1675/3319] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:34.901591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:34.903095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:34.923603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff82d5-6383-4a51-9880-98238e10355e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:34.934610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:34.936051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.940587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.941284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] PATH_INFO: `/v3/projects/62cc361b65c04697b7c9b850ed2374d9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.943348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62cc361b65c04697b7c9b850ed2374d9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:34.947854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.075575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cc361b65c04697b7c9b850ed2374d9', 'request_id': 'req-4fc35c47-e61b-423c-878b-e72169f74626'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:35.102929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cc361b65c04697b7c9b850ed2374d9', 'request_id': 'req-4fc35c47-e61b-423c-878b-e72169f74626'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:35.117743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cc361b65c04697b7c9b850ed2374d9', 'request_id': 'req-4fc35c47-e61b-423c-878b-e72169f74626'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:35.159208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] The token cache is being invalidate because project 62cc361b65c04697b7c9b850ed2374d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:35.165946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:35.170106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc35c47-e61b-423c-878b-e72169f74626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:35.181022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1645/3320] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:34 2022] DELETE /identity/v3/projects/62cc361b65c04697b7c9b850ed2374d9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:35.182296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.182740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.182839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.255347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:35.272043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:35.502178 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1676/3321] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:35.511131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.511553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.511933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.558590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:35.601474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:35.603499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:35.615807 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1646/3322] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:35.620265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.634685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bae77-aee8-4fc3-93f2-589eba9590e4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.646547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.647395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.647673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.647944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.648957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:35.649985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.653661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.686423 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1677/3323] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:35.690732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.703544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c342e-32a6-4e5f-b2a8-3088bb0deb49 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.714799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.715713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.716143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.716559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.717636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.721994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.790255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1647/3324] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:35 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:35.791479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.804773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91167c6b-7fd6-4b52-a097-3a4b03bfc709 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.890476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:35.948505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.950483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.950772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.951047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.954218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.960379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.011002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1678/3325] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:35 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:36.012308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.039377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cd14c-d043-472e-868a-a55ac2dafde5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.064765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.065462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.065782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.066194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.066856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.068545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.107259 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1648/3326] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:36.112944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.127752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a6fe-84c0-49ce-82bc-7da8f89f5dce admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.143404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.144218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.144504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.144828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.145696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.149875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5fc83-e4d0-4b77-a10d-0f82e796435f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.168668 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1679/3327] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:36.173352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.187741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca42bf-1b7e-40b0-b14b-f689c22f1144 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.200046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.200741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.201805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.202090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] PATH_INFO: `/v3/projects/9a31338ba1ee4f9fa964ae11288bf7ef/users/62a9109807284f8eb460fbfd10695c6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.241471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a31338ba1ee4f9fa964ae11288bf7ef, user_id=62a9109807284f8eb460fbfd10695c6f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.250180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.288954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1649/3328] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:36 2022] PUT /identity/v3/projects/9a31338ba1ee4f9fa964ae11288bf7ef/users/62a9109807284f8eb460fbfd10695c6f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:36.298099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.298718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.298997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.385046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.388281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.392841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] MFA Rules not processed for user `62a9109807284f8eb460fbfd10695c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:36.396170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.612855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b93a-d064-4216-9f7d-6c25f4410511 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.618936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.619580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.619865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.620127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] PATH_INFO: `/v3/users/2b4bc09d609742b5b57d7e7fd6b47118` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.622233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4bc09d609742b5b57d7e7fd6b47118)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.624151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.628291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1680/3329] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:36.641350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.642817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.725975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4bc09d609742b5b57d7e7fd6b47118'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:36.727862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4bc09d609742b5b57d7e7fd6b47118'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:36.729184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4bc09d609742b5b57d7e7fd6b47118'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:36.744727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4bc09d609742b5b57d7e7fd6b47118'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:36.762267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bb3aeac-c855-400d-864c-623aaa8b3587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4bc09d609742b5b57d7e7fd6b47118'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:36.815903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6158b7-10ca-4a75-9b71-1cfd39422361 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.824353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.825425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.825881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1650/3330] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:36 2022] DELETE /identity/v3/users/2b4bc09d609742b5b57d7e7fd6b47118 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:00:36.826013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.826422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.833355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.852028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.853768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.868071 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1681/3331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:00:37.121133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:37.122158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:37.122582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:37.164343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:37.166133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:37.209422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:37.297102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1651/3332] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:37.332725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:37.335162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:37.390021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:37.392112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:37.525013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:37.564264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3baeb-632d-467d-9eec-6fb86bb64e75 service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:37.614775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c6d29-da2d-4a9a-a641-df37c0d65e6b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:37.622189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:37.623338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:37.623631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:37.623926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] PATH_INFO: `/v3/projects/c1b921cd14fb49308c16ce63d1120b1d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:37.625610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b921cd14fb49308c16ce63d1120b1d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:37.629389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:37.726375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:37.740321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b921cd14fb49308c16ce63d1120b1d', 'request_id': 'req-882ce129-f41f-40b2-9480-c93ffded3e30'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:37.741305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:37.743658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:37.745531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:37.755661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b921cd14fb49308c16ce63d1120b1d', 'request_id': 'req-882ce129-f41f-40b2-9480-c93ffded3e30'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:37.768461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b921cd14fb49308c16ce63d1120b1d', 'request_id': 'req-882ce129-f41f-40b2-9480-c93ffded3e30'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:37.791340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:37.796003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8cf4f-2f47-4830-b54a-608f3640cc5f service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:37.809316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] The token cache is being invalidate because project c1b921cd14fb49308c16ce63d1120b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:37.810391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:37.811803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882ce129-f41f-40b2-9480-c93ffded3e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:37.819189 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1652/3333] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:37 2022] DELETE /identity/v3/projects/c1b921cd14fb49308c16ce63d1120b1d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:37.820821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:37.821160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:37.821444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:37.829364 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1682/3334] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:37.858987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:37.860215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:38.025156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:38.056966 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1653/3335] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:38.064991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.064991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.064991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.087654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:38.089184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:38.101295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1683/3336] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:38.103618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.146702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9984-95ec-4133-bf6b-dda6e864d951 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.166898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.168770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.182487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.184484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.211032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:38.212315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.218686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.270436 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1654/3337] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:38.274785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.288019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc893-2f7e-4c0b-9a43-22e5858cb4cc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.309737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.311739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.314069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.321457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.323693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.343411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.394820 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1684/3338] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:38 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:38.399849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.417640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c8032-82b6-4715-aefe-4f3a1e0a78ba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.552494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.553422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.553875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.554297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.556328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.558745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.611298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.624266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17accf5e-d257-4bb0-9cc6-299864a7c277 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.624737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1655/3339] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:38 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:38.633711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.636184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.637642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.638725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.639762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.641749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.671887 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1685/3340] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:38.680085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.697204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00848-b7db-4c81-9f05-736ebc9e16f4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.704463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.705137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.705418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.705690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.706828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.709372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a6f42-4bb7-46cd-9a34-562b6b31236e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.731293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:38.741699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1656/3341] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:38.752091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f829f-c258-46c7-ad46-4bf037a4b92a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:38.765603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:38.766546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.766980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.767401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] PATH_INFO: `/v3/projects/9a1eb6ee53b0459b9ba5a61dec5108e0/users/0db24bba973f4b52b0c1409fd80daf74/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.800825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1eb6ee53b0459b9ba5a61dec5108e0, user_id=0db24bba973f4b52b0c1409fd80daf74, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:38.803789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5533cd-e68d-404a-9c9d-42dfc430e1e9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:38.835774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1686/3342] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:38 2022] PUT /identity/v3/projects/9a1eb6ee53b0459b9ba5a61dec5108e0/users/0db24bba973f4b52b0c1409fd80daf74/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:38.838548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:38.839056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:38.839476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:38.901395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:38.904770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:39.135414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:39.135724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:39.135982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:39.166005 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1657/3343] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:39.181166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:39.182760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:39.187607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:39.192357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:39.372616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36156e85-2a86-4962-a65d-0558a099e11b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:39.382637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:39.383316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:39.383600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:39.383873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:39.413396 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1687/3344] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:39.425260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:39.428192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:39.439741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:39.442059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:39.444193 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1658/3345] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:39.505600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:39.613849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda492-0429-4f49-8a7e-5380e9401410 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:39.630135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:39.631199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:39.631624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:39.632097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:39.654766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:39.663333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:39.688698 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1688/3346] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:40.073581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:40.078108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:40.131575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe67ef-1463-43cc-9bee-35ea52a12f34 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:40.153222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:40.154676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:40.155317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:40.155835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] PATH_INFO: `/v3/users/b2706dd9c4f24a41a1e990c0517b792e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:40.157675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2706dd9c4f24a41a1e990c0517b792e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:40.161403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:40.163530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:40.256647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2706dd9c4f24a41a1e990c0517b792e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:40.259150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2706dd9c4f24a41a1e990c0517b792e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:40.259989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2706dd9c4f24a41a1e990c0517b792e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:40.276439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2706dd9c4f24a41a1e990c0517b792e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:40.291438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2706dd9c4f24a41a1e990c0517b792e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:40.336615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1659/3347] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:40 2022] DELETE /identity/v3/users/b2706dd9c4f24a41a1e990c0517b792e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:40.806755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:40.829096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84cb1d-a40f-4af3-a38f-87323798263c service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:40.965717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:40.966857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:40.967271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:40.967687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] PATH_INFO: `/v3/projects/aa7146c7cb464ce99ad2f6593f0ebb0b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:40.969631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7146c7cb464ce99ad2f6593f0ebb0b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:40.973081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:41.113550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'request_id': 'req-1ab4ad9d-d041-4a1c-a09c-256198d177f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.131044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'request_id': 'req-1ab4ad9d-d041-4a1c-a09c-256198d177f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.150882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'request_id': 'req-1ab4ad9d-d041-4a1c-a09c-256198d177f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.192949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] The token cache is being invalidate because project aa7146c7cb464ce99ad2f6593f0ebb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:41.193300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.193956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.198944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1689/3348] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:40 2022] DELETE /identity/v3/projects/aa7146c7cb464ce99ad2f6593f0ebb0b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:41.203273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:41.205245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:41.229344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919dbd3-a1d3-42e3-bee3-77ec6eb90129 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:41.483398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:41.485549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:41.485549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:41.486037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] PATH_INFO: `/v3/users/b6de9b26fccd4f22b745eba7f04dd157` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:41.487567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6de9b26fccd4f22b745eba7f04dd157)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:41.489815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:41.725443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6de9b26fccd4f22b745eba7f04dd157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.727635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6de9b26fccd4f22b745eba7f04dd157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.730731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6de9b26fccd4f22b745eba7f04dd157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.753123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6de9b26fccd4f22b745eba7f04dd157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.779697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5997d77-c058-44fe-9cd7-0efae0098725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6de9b26fccd4f22b745eba7f04dd157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:41.837538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:41.860318 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1660/3349] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:41 2022] DELETE /identity/v3/users/b6de9b26fccd4f22b745eba7f04dd157 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:43.049559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:43.051755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:43.090698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad9d-d041-4a1c-a09c-256198d177f8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:43.303019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:43.365367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:43.366030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:43.366304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:43.366585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] PATH_INFO: `/v3/projects/4847dbc2755946869b6206a5c04666a9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:43.378763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4847dbc2755946869b6206a5c04666a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:43.394789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:43.524007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4847dbc2755946869b6206a5c04666a9', 'request_id': 'req-82403779-5b68-4875-b1d6-29b80be8f13d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:43.538128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4847dbc2755946869b6206a5c04666a9', 'request_id': 'req-82403779-5b68-4875-b1d6-29b80be8f13d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:43.551676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4847dbc2755946869b6206a5c04666a9', 'request_id': 'req-82403779-5b68-4875-b1d6-29b80be8f13d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:43.589764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] The token cache is being invalidate because project 4847dbc2755946869b6206a5c04666a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:43.590066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:43.591056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82403779-5b68-4875-b1d6-29b80be8f13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:43.596166 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1690/3350] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:43 2022] DELETE /identity/v3/projects/4847dbc2755946869b6206a5c04666a9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:43.599733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:43.600270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:43.600270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:43.642176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:43.643687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:43.833267 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1661/3351] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:43.835702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:43.836147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:43.836512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:43.901473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:43.902784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:43.929223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1691/3352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:43.932457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:43.959066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629b2f3-be0a-4719-abca-b93dc2f48107 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:43.971788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:43.975518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:43.975861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:43.976139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:43.981579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:43.981906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:43.988487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.037651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1662/3353] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:44.039158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.054581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a8b4-299a-4fcd-ad5f-442ef1769736 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.073693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:44.074426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.085831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.086144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.087398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:44.093603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.199256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1692/3354] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:44 2022] POST /identity/v3/projects => generated 395 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:00:44.203707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.226949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199c3a-0b70-4b72-af43-083eb33f6fbb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.410847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:44.411595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.411767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.412044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.412783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:44.414838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.469503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1663/3355] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:44 2022] POST /identity/v3/users => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:44.477118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.498082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3241c-f2c0-4d95-908f-74dbb5ae1ac5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.510842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:44.511728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.512023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.512300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.512987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:44.514884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.553256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1693/3356] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:44.557211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.575616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3377f-51b7-4448-bf2b-9a7fccdda454 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.589936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:44.591279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.591566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.591906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.592654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:44.594514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.634677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.636649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:44.650546 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1664/3357] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:44.655013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:44.684895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acf8b-7dab-4074-9f3b-94f338f248ec admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.701743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:44.702560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.702840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.703195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] PATH_INFO: `/v3/projects/0c49ee1d5d5642749e3e90fb9d596636/users/854e41184e0f4b06aa85a150fec89fd4/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.767418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c49ee1d5d5642749e3e90fb9d596636, user_id=854e41184e0f4b06aa85a150fec89fd4, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:44.767418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ffad-c79b-4c53-8b2c-81619e6126de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:44.826257 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1665/3358] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:44 2022] PUT /identity/v3/projects/0c49ee1d5d5642749e3e90fb9d596636/users/854e41184e0f4b06aa85a150fec89fd4/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:44.840969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b323-4a56-483c-a39c-14d3f2d1b6ec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:44.841227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880626-020a-4503-9350-f8806e8ed1c0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:44.841317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b323-4a56-483c-a39c-14d3f2d1b6ec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:44.841317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b323-4a56-483c-a39c-14d3f2d1b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:44.963945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5ed8b323-4a56-483c-a39c-14d3f2d1b6ec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:44.965223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ed8b323-4a56-483c-a39c-14d3f2d1b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:45.047755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:45.070338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:45.071782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:45.071876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:45.072193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:45.085884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:45.091350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:45.120020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:45.127834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:45.174603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1694/3359] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:45.218678 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1666/3360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:45.240179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:45.241674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:45.278970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b99d-4dc8-4ce0-91ef-5fa57246a546 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:45.302605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:45.302605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:45.302992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:45.303073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:45.350365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:45.352237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:45.382011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1695/3361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:47.739888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e53d-f2be-4b6d-83a4-724123bd6f16 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:47.740501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e53d-f2be-4b6d-83a4-724123bd6f16 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:47.740655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e53d-f2be-4b6d-83a4-724123bd6f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:47.792647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e403e53d-f2be-4b6d-83a4-724123bd6f16 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:47.798842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e403e53d-f2be-4b6d-83a4-724123bd6f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:47.939807 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1667/3362] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:00:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:47.946888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:47.948348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:48.214319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a6ce-e85a-43f9-b1fb-17834401a222 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:48.232406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:48.234081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.235216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.235960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.262912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:48.267896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:48.298930 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1696/3363] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:00:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:50.706778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:50.707386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:50.707386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:50.763773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] MFA Rules not processed for user `0db24bba973f4b52b0c1409fd80daf74`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:50.765230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:50.988048 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1668/3364] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:58.114310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:58.121478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:58.319067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0c37-2473-4a26-8329-e7b0e718388c service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:58.337200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:58.339644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:58.339985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:58.340264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:58.344113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:58.378262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:58.379904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5d73b-7464-4cb1-bfba-41f3f11bd762 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:58.418633 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1697/3365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:58.502389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:58.518572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e0f67-6bb6-4f42-bd6d-2f4aaafc886a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:58.527123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:58.527744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:58.528036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:58.528339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:58.549380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:58.551229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2fd82-a24e-49a8-bbdf-6ae6646563db service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:58.597556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1669/3366] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:58.986508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:58.986767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:58.987551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:59.036501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] MFA Rules not processed for user `854e41184e0f4b06aa85a150fec89fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:59.037792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:59.139973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:59.233817 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1698/3367] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:59.245241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337554f5-13f5-4328-abf3-cc6d49acb954 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:59.246552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337554f5-13f5-4328-abf3-cc6d49acb954 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:59.248062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337554f5-13f5-4328-abf3-cc6d49acb954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:59.353744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-337554f5-13f5-4328-abf3-cc6d49acb954 None None] MFA Rules not processed for user `854e41184e0f4b06aa85a150fec89fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:59.358998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-337554f5-13f5-4328-abf3-cc6d49acb954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:59.379942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1670/3368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:59.961998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:59.978107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779e1ef-ec30-4ac2-87b9-5a457de21dcc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:00.004080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:00.004731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:00.005074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:00.005348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:00.018096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:00.019996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e9aa-99d8-4d9d-bf0a-46dea74571c4 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:00.033582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1699/3369] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:00.989017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb6-94ad-4cde-a66f-11e7e60966b2 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:00.989617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb6-94ad-4cde-a66f-11e7e60966b2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:00.989617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb6-94ad-4cde-a66f-11e7e60966b2 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:00.991709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1671/3370] 10.222.0.16 () {54 vars in 921 bytes} [Fri Oct 28 10:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:01:01.003399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:01.004278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:01.004717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:01.134415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:01.135967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:01.160715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1700/3371] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:01:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:01.175379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9fb6-94ad-4cde-a66f-11e7e60966b2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:01.199394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9fb6-94ad-4cde-a66f-11e7e60966b2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:01.212419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:01.213276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:01.214218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:01.214652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:01.233169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:01.235138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:01.251232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:01.252688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:01.302755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1672/3372] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:01.481057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470716b1-9928-4b78-ac51-d6d2ed0442d8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:01.490174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:01.491063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:01.491550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:01.492029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:01.494683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:01.495744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:01.498951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:01.510631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:01.512820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:01.529378 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1701/3373] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:01.585889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5adb-227f-4dd3-915a-5c9b928a9f81 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:01.616339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:01.617267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:01.618712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:01.619058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:01.654912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:01.656535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec443b00-1dc5-4585-be37-916366d5b13b service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:01.691596 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1673/3374] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:01.792984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:01.794398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:01.823219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b64dd3-9cd6-4950-b59e-61af97155434 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:01.854264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:01.857752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:01.858141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:01.859346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] PATH_INFO: `/v3/users/983056352c024fdab33b6b77970dad6f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:01.862239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=983056352c024fdab33b6b77970dad6f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:01.867369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:02.073964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983056352c024fdab33b6b77970dad6f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:02.078024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983056352c024fdab33b6b77970dad6f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:02.118603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983056352c024fdab33b6b77970dad6f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:02.173994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983056352c024fdab33b6b77970dad6f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:02.177967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983056352c024fdab33b6b77970dad6f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:02.255471 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1702/3375] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:01 2022] DELETE /identity/v3/users/983056352c024fdab33b6b77970dad6f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:02.261511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:02.262020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:02.262127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:02.364452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:02.365723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:02.535732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:02.715654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1674/3376] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:02.726722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:02.730146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:02.756702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:02.852990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ed883-d099-4f52-a1c4-844e8d25f24f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:02.858183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:02.859245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:02.859682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:02.873447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:02.895728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:02.897590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:02.917654 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1703/3377] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:03.393855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:03.395612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:03.434950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87190e6b-72a0-458e-8ca1-97957ce4dc3f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:03.454757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:03.459098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:03.459444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:03.459725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] PATH_INFO: `/v3/projects/cbc6c86197e942fc981ada7b252f3923` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:03.465103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc6c86197e942fc981ada7b252f3923)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:03.471208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:03.571722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc6c86197e942fc981ada7b252f3923', 'request_id': 'req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:03.599370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc6c86197e942fc981ada7b252f3923', 'request_id': 'req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:03.649688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc6c86197e942fc981ada7b252f3923', 'request_id': 'req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:03.712755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] The token cache is being invalidate because project cbc6c86197e942fc981ada7b252f3923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:03.712994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:03.716665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78a86e12-64ce-475a-95e1-2f5c7b3cdcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:03.718651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1675/3378] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:03 2022] DELETE /identity/v3/projects/cbc6c86197e942fc981ada7b252f3923 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:03.723903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:03.741184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182893-4357-421e-9246-3cecd0725f5a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:03.920086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:03.920519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:03.920896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:03.922802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:03.923457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:03.923738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:03.924012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] PATH_INFO: `/v3/users/7709ffd4779e4d3385498636936cec40` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:03.926700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7709ffd4779e4d3385498636936cec40)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:03.928869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:04.005832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:04.013794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:04.060455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7709ffd4779e4d3385498636936cec40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:04.062800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7709ffd4779e4d3385498636936cec40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:04.083369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7709ffd4779e4d3385498636936cec40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:04.110200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7709ffd4779e4d3385498636936cec40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:04.113938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7709ffd4779e4d3385498636936cec40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:04.155119 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1704/3379] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:03 2022] DELETE /identity/v3/users/7709ffd4779e4d3385498636936cec40 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:04.181689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1676/3380] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:01:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:04.207548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:04.209150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:04.302706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:04.398972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75cf6c-6ace-4e8c-89bf-739d31f7761e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:04.415173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:04.415893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:04.416175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:04.416446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:04.612189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:04.623490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6615f-87ff-4740-b441-481b791fa397 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:04.648496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1705/3381] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:01:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:04.666479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:04.668758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:04.714215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ebf6-d020-4293-b113-cf839d7ef150 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:04.878325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:04.888375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:04.889424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:04.889900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:04.890474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] PATH_INFO: `/v3/projects/a4017ef8159b45d197cfba851eb5c04e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:04.891845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4017ef8159b45d197cfba851eb5c04e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:04.894059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:05.014042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4017ef8159b45d197cfba851eb5c04e', 'request_id': 'req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:05.032749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4017ef8159b45d197cfba851eb5c04e', 'request_id': 'req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:05.046167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4017ef8159b45d197cfba851eb5c04e', 'request_id': 'req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:05.068303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] The token cache is being invalidate because project a4017ef8159b45d197cfba851eb5c04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:05.068631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:05.069323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0275619-1fc0-42b0-8693-d5e3e95ddbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:05.074812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1677/3382] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:04 2022] DELETE /identity/v3/projects/a4017ef8159b45d197cfba851eb5c04e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:05.076004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:05.076540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:05.076540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:05.132211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:05.143449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:05.329833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1706/3383] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:05.332360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:05.333132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:05.333608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:05.377962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:05.380363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:05.425805 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1678/3384] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:05.430026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:05.446514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b94ed7-6257-4ee8-bfd7-2d19993603ed None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:05.484440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:05.485238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:05.485524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:05.485792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:05.486451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:05.486748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:05.488374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:05.537156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:05.541272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1707/3385] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:05.551324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbfd22-a656-4e03-8901-087780a83af1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:05.565463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:05.566451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:05.566937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:05.568268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:05.569208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:05.572800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:05.668946 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1679/3386] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:05 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:05.672834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:05.686595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e1d30-3121-40e4-8f2c-7ffdbf23b146 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:05.899516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:05.905201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:05.908828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:05.909586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:05.911343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:05.917786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:05.946728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:05.988071 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1708/3387] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:05 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:05.989614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:06.003990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a41518-2a9c-493b-b935-18562a019138 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:06.013150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:06.014766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:06.015270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:06.015749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:06.016615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:06.047783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:06.089535 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1680/3388] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:06.093253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:06.111378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721dba0-8a5e-40f9-bf19-d17ea896aaff admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:06.126676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:06.128545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:06.129170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:06.129597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:06.130421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:06.132320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151154-35a0-47d7-b2c5-2914d9f3a38a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:06.166772 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1709/3389] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:06.168983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:06.206594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15529e7e-9295-44fb-a2e2-ab376eebb862 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:06.227219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:06.233757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:06.234246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:06.234693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] PATH_INFO: `/v3/projects/6dcc2826ba6d4a1a9e5534cf94edd809/users/10535d8981ed4c3c908f2d3325052c6a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:06.286957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcc2826ba6d4a1a9e5534cf94edd809, user_id=10535d8981ed4c3c908f2d3325052c6a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:06.290306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:06.342353 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1681/3390] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:06 2022] PUT /identity/v3/projects/6dcc2826ba6d4a1a9e5534cf94edd809/users/10535d8981ed4c3c908f2d3325052c6a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:06.353893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:06.354237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:06.354448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:06.391666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] MFA Rules not processed for user `10535d8981ed4c3c908f2d3325052c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:06.394467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:06.701353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1710/3391] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:06.702672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:06.951187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada61-866e-4685-800a-202ebb7d3eca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:06.957091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:06.958041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:06.958509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:06.958993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:06.959834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:06.962404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.030352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.039917 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1682/3392] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:06 2022] POST /identity/v3/projects => generated 391 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:07.048006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670222e2-2882-40e5-ac4f-1c57ec535012 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:07.208509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:07.209335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.209739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.210112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.212427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:07.215375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.252825 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1711/3393] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:07 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:07.257240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.304881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8ba5a-3cad-4440-b7ef-833cc1c3d925 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:07.324004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:07.327188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.329460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.331433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.332401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:07.342800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.357271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:07.395625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1683/3394] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:07.397679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.416502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc06f66-b4c2-48ee-bf81-2bedd58430dd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:07.442169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:07.443350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.443640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.443913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] PATH_INFO: `/v3/projects/3807951fd06940f4aeb74425c22415a2/users/3522ce5a8a9b4eb68f5323342fb96c28/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.498854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807951fd06940f4aeb74425c22415a2, user_id=3522ce5a8a9b4eb68f5323342fb96c28, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:07.502953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.538217 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1712/3395] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:07 2022] PUT /identity/v3/projects/3807951fd06940f4aeb74425c22415a2/users/3522ce5a8a9b4eb68f5323342fb96c28/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:07.543311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.554442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f276-870e-467b-9b01-f98211344806 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:07.684601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:07.685384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.685671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.688433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.689772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:07.691002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.698499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.707163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:07.717221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1684/3396] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:07.724076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:07.763385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40ddb-7052-4524-854d-ee855cf6d7b5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:07.782526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:07.783668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.783988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.784356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] PATH_INFO: `/v3/projects/3807951fd06940f4aeb74425c22415a2/users/3522ce5a8a9b4eb68f5323342fb96c28/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.788629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807951fd06940f4aeb74425c22415a2, user_id=3522ce5a8a9b4eb68f5323342fb96c28, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:07.796013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a86a-5caa-4371-806d-8b28411ff46a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:07.846076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1685/3397] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:07 2022] PUT /identity/v3/projects/3807951fd06940f4aeb74425c22415a2/users/3522ce5a8a9b4eb68f5323342fb96c28/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:07.847966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545914a-0dbd-4335-90cf-c67c0e157020 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:07.853782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545914a-0dbd-4335-90cf-c67c0e157020 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:07.854093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545914a-0dbd-4335-90cf-c67c0e157020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:07.879938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:07.923543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8545914a-0dbd-4335-90cf-c67c0e157020 None None] MFA Rules not processed for user `3522ce5a8a9b4eb68f5323342fb96c28`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:07.925164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8545914a-0dbd-4335-90cf-c67c0e157020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:07.974289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0545b3-83c6-4b6e-8330-90b6223377eb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:08.090338 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1686/3398] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:08.092014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:08.092309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:08.092597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:08.126248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:08.128301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:08.129348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] MFA Rules not processed for user `10535d8981ed4c3c908f2d3325052c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:08.130082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:08.130615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:08.130783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:08.135354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:08.171316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:08.173367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57c4ad-3c7d-41a7-9c99-4d61ec7b5e08 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:08.196311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1713/3399] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:08.318819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1687/3400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:08.339687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c93a9-d5ab-426a-9b50-3fdad4f070c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:08.340224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c93a9-d5ab-426a-9b50-3fdad4f070c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:08.340326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c93a9-d5ab-426a-9b50-3fdad4f070c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:08.382050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-802c93a9-d5ab-426a-9b50-3fdad4f070c8 None None] MFA Rules not processed for user `0db24bba973f4b52b0c1409fd80daf74`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:08.383988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-802c93a9-d5ab-426a-9b50-3fdad4f070c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:08.522596 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1714/3401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:08.830800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:08.832394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:08.872623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24e5e-d295-485e-906d-33eea3e198c5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:08.890099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:08.891092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:08.891605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:08.892266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:08.909838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:08.914032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:08.919469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:08.939600 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1688/3402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:12.607890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4be2-0aaa-49e3-b268-82f299c03a72 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.608365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4be2-0aaa-49e3-b268-82f299c03a72 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.608464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4be2-0aaa-49e3-b268-82f299c03a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.633594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cf4a4be2-0aaa-49e3-b268-82f299c03a72 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:12.635491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cf4a4be2-0aaa-49e3-b268-82f299c03a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.729780 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1715/3403] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:12.745918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.747989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.865853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370072c-49da-4cd3-b949-b7532da5dbe7 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.873306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.874326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.874605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.874872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.887896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.891025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.902673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1689/3404] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:14.071677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.072660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.072826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.101422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.102914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.139662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:14.140866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.184647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1716/3405] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:14.200283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.241502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:14.244622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfce2e-9e7e-4349-acbc-8e04cfb4fcf2 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.258099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.258803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41677-1a15-426d-9dd4-807850d478e2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.259245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.259546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.259778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] PATH_INFO: `/v3/users/679fbb3562d24d04af630ab8d37d35ae` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.265734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679fbb3562d24d04af630ab8d37d35ae)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.268064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.269506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.269964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.270083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.270516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.301746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.316013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22255318-42f3-4562-80cd-0505e16f7645 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.333101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1717/3406] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:01:14.434606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679fbb3562d24d04af630ab8d37d35ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.435456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679fbb3562d24d04af630ab8d37d35ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.437461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679fbb3562d24d04af630ab8d37d35ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.454812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679fbb3562d24d04af630ab8d37d35ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.476499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679fbb3562d24d04af630ab8d37d35ae'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.564959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1690/3407] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:14 2022] DELETE /identity/v3/users/679fbb3562d24d04af630ab8d37d35ae => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:14.566505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.567539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.567847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.592721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.607618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.614217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:14.615456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.634840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:14.748692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1117-03af-45bc-a5c1-133f58b41c04 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.750446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1718/3408] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:14.756584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.757496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.757884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.759202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] PATH_INFO: `/v3/users/62a9109807284f8eb460fbfd10695c6f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.759914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a9109807284f8eb460fbfd10695c6f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.763301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.769014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.771259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.893846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a9109807284f8eb460fbfd10695c6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.894609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a9109807284f8eb460fbfd10695c6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.895681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a9109807284f8eb460fbfd10695c6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.905358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843a6a-c73a-42f5-b149-1992cc02026b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.911898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.912655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.913031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.913371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.916071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a9109807284f8eb460fbfd10695c6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.920685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.928416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-50b0bb17-fd18-4b82-8702-6337e54515d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a9109807284f8eb460fbfd10695c6f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:14.949393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.952157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.957431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1691/3409] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:14 2022] DELETE /identity/v3/users/62a9109807284f8eb460fbfd10695c6f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:14.964228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.964822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.965264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.973192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1719/3410] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:15.006838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:15.009313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.104447 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1692/3411] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:15.132373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.134392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.160698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d731827-d0fe-400f-90eb-a3086d2af361 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:15.257656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:15.259056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.259514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.260066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.271885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:15.274458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:15.292282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1720/3412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:15.734147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.736108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.751471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e25ac-c00e-45e4-904b-ac110ecbe721 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:15.759843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:15.761057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.761693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.762227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] PATH_INFO: `/v3/projects/d46da14317314fe5ad7ee374b335891f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.764154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46da14317314fe5ad7ee374b335891f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:15.766385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:15.803382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:15.854798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46da14317314fe5ad7ee374b335891f', 'request_id': 'req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.871786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46da14317314fe5ad7ee374b335891f', 'request_id': 'req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.887850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46da14317314fe5ad7ee374b335891f', 'request_id': 'req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.916645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.918386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.938277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] The token cache is being invalidate because project d46da14317314fe5ad7ee374b335891f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:15.938277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.938910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.943280 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1693/3413] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:15 2022] DELETE /identity/v3/projects/d46da14317314fe5ad7ee374b335891f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:15.947332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.949619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.954179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a1ac-2297-47da-a155-9218ba2ac909 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.073676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:16.125358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.126034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.126408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.126686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] PATH_INFO: `/v3/projects/9a31338ba1ee4f9fa964ae11288bf7ef` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.130267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a31338ba1ee4f9fa964ae11288bf7ef)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.131966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ee74-3a71-4d0d-8c92-d828faf3f88a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.136248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:16.151245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.151775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.152050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.152317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] PATH_INFO: `/v3/users/734c6360de7f4411a371a9845a0b1bb1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.153512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=734c6360de7f4411a371a9845a0b1bb1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.155451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:16.272141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734c6360de7f4411a371a9845a0b1bb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.272932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734c6360de7f4411a371a9845a0b1bb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.273678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734c6360de7f4411a371a9845a0b1bb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.287244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734c6360de7f4411a371a9845a0b1bb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.293925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a31338ba1ee4f9fa964ae11288bf7ef', 'request_id': 'req-7b6f1795-520c-49ab-838e-f3c12d0c1edd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.298515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16eecc60-4c8a-4c1c-be9c-1143b08f9dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734c6360de7f4411a371a9845a0b1bb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.308235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a31338ba1ee4f9fa964ae11288bf7ef', 'request_id': 'req-7b6f1795-520c-49ab-838e-f3c12d0c1edd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.321659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a31338ba1ee4f9fa964ae11288bf7ef', 'request_id': 'req-7b6f1795-520c-49ab-838e-f3c12d0c1edd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.327054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1694/3414] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:15 2022] DELETE /identity/v3/users/734c6360de7f4411a371a9845a0b1bb1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:16.347316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] The token cache is being invalidate because project 9a31338ba1ee4f9fa964ae11288bf7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:16.347734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.348544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b6f1795-520c-49ab-838e-f3c12d0c1edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.353908 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1721/3415] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:15 2022] DELETE /identity/v3/projects/9a31338ba1ee4f9fa964ae11288bf7ef => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:16.356345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.356345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.356713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.382626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:16.384885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:16.439385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:16.544020 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1695/3416] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:16.556132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.556694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.556950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.598867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:16.600124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:16.630923 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1722/3417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:16.634610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:16.678105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a721b-3641-44e7-a0bf-9740949f71e8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.693668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.694404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.694786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.695056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.695803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:16.696161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.699486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:16.719511 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1696/3418] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:16.720592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:16.743217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab71e-e6f8-4adc-a6d0-98e1a6e663cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.755498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.756279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.756559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.756878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.757556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.763328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:16.804610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:16.814627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1723/3419] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:16 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:16.818708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd5e5-ffff-4df3-acd9-77712da3b413 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.963700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.965854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.966504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.967573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.968824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.973754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.022873 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1697/3420] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:16 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:17.024675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.040392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c3f0-67cc-4cfe-acba-cd2b4b7c8890 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.056081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.057599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.058142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.058381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.060217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.061884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.087797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1724/3421] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:17.093631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.108386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb716-4c12-4636-8965-4a9a90a98217 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.113915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.114538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.115676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.116192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.116853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.119760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b670b1e-8a99-4e78-842b-d89ffed14904 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.136243 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1698/3422] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:17.137006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.148203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588794-601d-4afc-9be6-3778b799b15f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.154556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.155332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.155672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.155945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] PATH_INFO: `/v3/projects/3be0ab02a95a48628dd5f9f1ac2f4596/users/28313b7c89184dd683e3479d23be489d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.207239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be0ab02a95a48628dd5f9f1ac2f4596, user_id=28313b7c89184dd683e3479d23be489d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.210464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.243063 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1725/3423] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:17 2022] PUT /identity/v3/projects/3be0ab02a95a48628dd5f9f1ac2f4596/users/28313b7c89184dd683e3479d23be489d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:17.254565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.255238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.255661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.305384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:17.306908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:17.404947 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1699/3424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:17.470297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.472649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:17.547465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24f71-5c40-4c78-93c9-2136459ee047 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.552184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.553973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.554409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.554862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.572588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.576126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc45d-ddae-4288-948f-e5801dd8e08b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.603133 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1726/3425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:17.694583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.700012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:17.726718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe0b4-113a-4b03-aacb-ced228c6bb20 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.733594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.734192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.734475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.734750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] PATH_INFO: `/v3/projects/9c4a7edb9e1647c48eea24f76772c91d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.750041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4a7edb9e1647c48eea24f76772c91d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.754062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.833501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:17.852871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4a7edb9e1647c48eea24f76772c91d', 'request_id': 'req-0fe2541a-828f-4680-9be2-a1cc82bb76f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.863074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4a7edb9e1647c48eea24f76772c91d', 'request_id': 'req-0fe2541a-828f-4680-9be2-a1cc82bb76f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.883753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4a7edb9e1647c48eea24f76772c91d', 'request_id': 'req-0fe2541a-828f-4680-9be2-a1cc82bb76f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.910689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] The token cache is being invalidate because project 9c4a7edb9e1647c48eea24f76772c91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:17.910992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.912347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0fe2541a-828f-4680-9be2-a1cc82bb76f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.918057 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1700/3426] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:17 2022] DELETE /identity/v3/projects/9c4a7edb9e1647c48eea24f76772c91d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:17.923475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.924063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.924317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.935935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:17.949449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:17.951611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:18.040881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1727/3427] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:18.048535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.048951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.049306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.074856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:18.076434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:18.088546 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1701/3428] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:18.090121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.106443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc42ac-ac2b-422c-9593-bd8f3dc42595 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.112646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.113491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.113992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.114405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.115220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:18.115986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.119488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.138937 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1728/3429] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:18.139619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.154781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e801-1118-48aa-8ec8-ed1365c976d3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.160353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.161185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.161594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.161977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.162829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.165588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.204831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1702/3430] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:01:18.206933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.218796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20ffa2-a502-479a-8c35-a99df42e3dd5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.317270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.318279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.318949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.319350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.320112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.323094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.364401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1729/3431] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:18.365016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.379829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296839-6c90-4408-9154-0395f1a6e22d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.386860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.387795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.388286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.388733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.389630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.391477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.413244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.425128 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1703/3432] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:01:18.428024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6721d-a5f8-4841-a82d-522342b9aac7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.438060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.438856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.439289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.439632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.440373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.452987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bc867-c9e1-48ab-86f1-3f62b3501222 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.478684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.484969 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1730/3433] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:01:18.491575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591854a8-61ac-4ea8-98bf-c3e761a15860 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.500769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.501620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.501973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.502315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] PATH_INFO: `/v3/projects/d9d393e04ca84c6085aaec0188815d7b/users/debe6f28a9304322a95fa91f62e6663f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.526111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d393e04ca84c6085aaec0188815d7b, user_id=debe6f28a9304322a95fa91f62e6663f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.529674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.559599 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1704/3434] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:18 2022] PUT /identity/v3/projects/d9d393e04ca84c6085aaec0188815d7b/users/debe6f28a9304322a95fa91f62e6663f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:18.561164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.561928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.562270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.619734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] MFA Rules not processed for user `debe6f28a9304322a95fa91f62e6663f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:18.623749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:18.736052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:18.747124 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1731/3435] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:18.748509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.897784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ebac-1015-4e76-975e-b72cec1a96f2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.904726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.905504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.906445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.906727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.907595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.910660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.978239 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1705/3436] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/projects => generated 401 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:18.982620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.000727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b25c-1b04-471f-9b2f-003f55d7b41e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.152339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.153127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.153306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.153551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.154192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.161901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.230720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.244675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1732/3437] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/users => generated 307 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:19.254636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d2c68-2e9b-441e-a14d-1c6760b49b36 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.275501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.276141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.276425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.276896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.277373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.278997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.319848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.330290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1706/3438] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:19.335717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c789ba-4786-4d6f-b0ec-474dc65dd393 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.348129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.349759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.350035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.350622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] PATH_INFO: `/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07/users/8eb8460542534711a8f4453d55334cc4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.387896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30430b6ef0b843d9a13a2d4df7d00a07, user_id=8eb8460542534711a8f4453d55334cc4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.391229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.413316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1733/3439] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:19 2022] PUT /identity/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07/users/8eb8460542534711a8f4453d55334cc4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:19.417161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.427539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c01b6-5f18-4ef1-aa0e-10f304eeccf1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.500124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:19.578292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.578811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.579335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.579617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.580275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.582040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaada02-3091-462e-a3a2-ab468bd75021 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.598304 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1707/3440] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:19.601561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.615654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c289c02-c51b-4edd-b3e8-3b2a77334e2b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.623142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.624097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.624619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.625044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] PATH_INFO: `/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07/users/8eb8460542534711a8f4453d55334cc4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.627755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30430b6ef0b843d9a13a2d4df7d00a07, user_id=8eb8460542534711a8f4453d55334cc4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.631154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.654150 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1734/3441] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:19 2022] PUT /identity/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07/users/8eb8460542534711a8f4453d55334cc4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:19.656591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.657032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.657417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.694003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] MFA Rules not processed for user `8eb8460542534711a8f4453d55334cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:19.695841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:19.805531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1708/3442] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:20.357868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:20.360262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:20.511110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bea3f-55aa-4243-a70a-1ffea53c16a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:20.517877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:20.518872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:20.519408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:20.519814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:20.521820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:20.537900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:20.543845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d67325-67f2-40b8-84e5-c62258729ccd service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:20.569393 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1735/3443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:20.932296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:20.962568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5f0a7-3ef7-45dc-b346-f58b9b9ee18d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:20.977282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:20.977918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:20.978194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:20.978462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:20.998193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:20.999806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47183e71-d9ae-4623-ae6e-0bedb51134f8 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:21.031890 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1709/3444] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:21.150191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:21.150805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:21.151158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:21.186444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] MFA Rules not processed for user `854e41184e0f4b06aa85a150fec89fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:21.190490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:21.283673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:21.360123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1736/3445] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:21.544974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:21.545283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:21.545535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:21.588577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:21.590020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:21.757214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1710/3446] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:21.774608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:21.783252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:21.985436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c95504-74ba-4031-b5d9-2f83d77346a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:22.005742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:22.006415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:22.006691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:22.006961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:22.036638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:22.038352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a9711-4884-48e2-9307-b5c3b8b5c0d2 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:22.087346 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1737/3447] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:23.162286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:23.163783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:23.301486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:23.371952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228c06-bb4b-44c2-8985-b1f2841a7e47 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:23.392547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:23.393416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:23.393874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:23.394242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] PATH_INFO: `/v3/users/4ec2ec5910404cc9aa621b4998b067bd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:23.396675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec2ec5910404cc9aa621b4998b067bd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:23.399467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:23.532874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec2ec5910404cc9aa621b4998b067bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:23.538140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec2ec5910404cc9aa621b4998b067bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:23.539987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec2ec5910404cc9aa621b4998b067bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:23.555350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec2ec5910404cc9aa621b4998b067bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:23.590734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec2ec5910404cc9aa621b4998b067bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:23.642550 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1711/3448] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:23 2022] DELETE /identity/v3/users/4ec2ec5910404cc9aa621b4998b067bd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:23.646876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:23.651363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:23.652027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:23.728688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:23.729962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:23.966588 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1738/3449] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:24.093187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:24.095007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:24.408157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767a86-315f-457e-89bb-3a301de7bd00 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:24.419998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:24.420640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:24.420940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:24.421214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:24.452763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:24.457439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:24.513387 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1712/3450] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:26.791427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:26.793888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:26.956410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:26.958883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:26.994574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63164962-8a55-4eef-8c0d-5a7287835747 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:26.996725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2d53-514e-4068-b597-c190b9453053 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:27.016732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:27.022411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.027158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.027365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:27.030309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.036604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:27.040413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.041769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.046080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] PATH_INFO: `/v3/projects/fd976570de164b69b58bfae7d4379e26` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.052704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd976570de164b69b58bfae7d4379e26)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:27.061680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:27.091509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:27.184151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd976570de164b69b58bfae7d4379e26', 'request_id': 'req-365ca5ec-1397-4b17-b374-c95c40588883'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.193297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd976570de164b69b58bfae7d4379e26', 'request_id': 'req-365ca5ec-1397-4b17-b374-c95c40588883'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.195880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:27.219921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd976570de164b69b58bfae7d4379e26', 'request_id': 'req-365ca5ec-1397-4b17-b374-c95c40588883'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.253949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] The token cache is being invalidate because project fd976570de164b69b58bfae7d4379e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:27.254675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.255929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-365ca5ec-1397-4b17-b374-c95c40588883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.258784 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1713/3451] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:26 2022] DELETE /identity/v3/projects/fd976570de164b69b58bfae7d4379e26 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:27.265430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b0eb-53c5-40f0-b87a-a751bfef973e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.267658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b0eb-53c5-40f0-b87a-a751bfef973e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.268297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b0eb-53c5-40f0-b87a-a751bfef973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.269795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:27.271570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:27.307466 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1739/3452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:26 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:27.324945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:27.327015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:27.367586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8e77b0eb-53c5-40f0-b87a-a751bfef973e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:27.369328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b2ce3-f2fe-4c8f-bcae-f6495c30e3e2 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:27.374675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8e77b0eb-53c5-40f0-b87a-a751bfef973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:27.609264 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1714/3453] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:27.619456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.620124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.620851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.675283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:27.676638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.677185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.677677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] PATH_INFO: `/v3/users/debe6f28a9304322a95fa91f62e6663f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.679075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=debe6f28a9304322a95fa91f62e6663f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:27.683021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:27.696968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:27.698878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:27.750991 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1715/3454] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:27.757354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:27.805527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2624a0-b838-4a2f-804c-9ac1a2576f68 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:27.812894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debe6f28a9304322a95fa91f62e6663f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.814229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debe6f28a9304322a95fa91f62e6663f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.829440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debe6f28a9304322a95fa91f62e6663f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.834792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:27.837730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.839666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.841039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.843170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:27.846571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:27.848595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debe6f28a9304322a95fa91f62e6663f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.850915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-92783d6b-f6bb-4953-bc7b-bb8b276de0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debe6f28a9304322a95fa91f62e6663f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:27.852871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:27.890266 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1716/3455] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:27.894585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:27.911118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:27.936786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1740/3456] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:27 2022] DELETE /identity/v3/users/debe6f28a9304322a95fa91f62e6663f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:27.941256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:27.941939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:27.942442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:27.978122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62878-7b31-4b29-9369-8afbb4edef43 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.009093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:28.010708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:28.087979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:28.198066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.198682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.198962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.199234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.199881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.201850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.244223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1741/3457] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:28.267421 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1717/3458] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:27 2022] POST /identity/v3/projects => generated 371 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:28.272089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:28.272269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:28.274429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:28.299700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784bf4-9d75-405f-8713-925b861c8da6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.470982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3164627-3e61-4a8c-85cb-20d4e8cadc24 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.481747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.482388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.482673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.482954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.488896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:28.551417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.555998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.558589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.558985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.564936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.571838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.617914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1742/3459] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:28 2022] POST /identity/v3/users => generated 286 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:28.618688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.618688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.620139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:28.647936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ae8b-4937-4da5-9489-243e9fa26863 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.649255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1718/3460] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:28.662140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.665095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.667438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.668496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.669727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.673330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.703237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1743/3461] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:28.704860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:28.715315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737adeba-a144-4667-9b56-5d28dc49df94 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.731382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.733328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.734229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.735212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.736570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.738997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5db1a-dde0-4dab-846f-c3795c761af2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.781186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1719/3462] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:28.782674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:28.795202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb5c6-2e89-4c65-aeae-dc8408da2617 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:28.800081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:28.800766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.806304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.806907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] PATH_INFO: `/v3/projects/36e12e5f8a5f4c32a72e14ca507993cd/users/6f37af6296ca45f98272703bc7d38fc6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.838168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e12e5f8a5f4c32a72e14ca507993cd, user_id=6f37af6296ca45f98272703bc7d38fc6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:28.840992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:28.880618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1744/3463] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:28 2022] PUT /identity/v3/projects/36e12e5f8a5f4c32a72e14ca507993cd/users/6f37af6296ca45f98272703bc7d38fc6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:28.882799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:28.883124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:28.883955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:28.942566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] MFA Rules not processed for user `6f37af6296ca45f98272703bc7d38fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:28.943821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:29.090966 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1720/3464] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:29.333274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:29.335055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:29.530512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704f6bd-001e-476a-b52b-ff84d32193bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:29.548477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:29.551175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:29.551863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:29.552152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:29.578894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:29.603269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:29.631281 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1745/3465] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:30.877501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:30.880402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:31.094356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d92846-d739-4035-bdc3-5d4204a81216 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:31.137466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:31.139968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:31.143280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:31.144053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] PATH_INFO: `/v3/projects/d9d393e04ca84c6085aaec0188815d7b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:31.147754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d393e04ca84c6085aaec0188815d7b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:31.153546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:31.240730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:31.365978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d393e04ca84c6085aaec0188815d7b', 'request_id': 'req-d65e5a29-1aef-4c63-b634-5d28c665335a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.386434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d393e04ca84c6085aaec0188815d7b', 'request_id': 'req-d65e5a29-1aef-4c63-b634-5d28c665335a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.406461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d393e04ca84c6085aaec0188815d7b', 'request_id': 'req-d65e5a29-1aef-4c63-b634-5d28c665335a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.447496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] The token cache is being invalidate because project d9d393e04ca84c6085aaec0188815d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:31.448122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.451687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.462004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1721/3466] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:30 2022] DELETE /identity/v3/projects/d9d393e04ca84c6085aaec0188815d7b => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:31.463783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:31.483311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3d54-a71e-44e0-9396-263a8d6bd7a1 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:31.506119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:31.696999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:31.697728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:31.698012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:31.698285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] PATH_INFO: `/v3/users/8eb8460542534711a8f4453d55334cc4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:31.700679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb8460542534711a8f4453d55334cc4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:31.705160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:31.843215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb8460542534711a8f4453d55334cc4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.846532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb8460542534711a8f4453d55334cc4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.867191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb8460542534711a8f4453d55334cc4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.887169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb8460542534711a8f4453d55334cc4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.888386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e150b9af-e111-476a-bf3b-9bf845a91479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb8460542534711a8f4453d55334cc4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:31.938602 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1746/3467] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:31 2022] DELETE /identity/v3/users/8eb8460542534711a8f4453d55334cc4 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:33.244851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:33.246710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:33.271575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5a29-1aef-4c63-b634-5d28c665335a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:33.463980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:33.465954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:33.467436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:33.468115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] PATH_INFO: `/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:33.473515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30430b6ef0b843d9a13a2d4df7d00a07)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:33.475900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:33.722659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30430b6ef0b843d9a13a2d4df7d00a07', 'request_id': 'req-4a950c1f-73e9-4b47-99f6-166f3004f6d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:33.788747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30430b6ef0b843d9a13a2d4df7d00a07', 'request_id': 'req-4a950c1f-73e9-4b47-99f6-166f3004f6d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:33.820279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30430b6ef0b843d9a13a2d4df7d00a07', 'request_id': 'req-4a950c1f-73e9-4b47-99f6-166f3004f6d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:33.859864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] The token cache is being invalidate because project 30430b6ef0b843d9a13a2d4df7d00a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:33.861366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:33.864199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a950c1f-73e9-4b47-99f6-166f3004f6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:33.871984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1722/3468] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:33 2022] DELETE /identity/v3/projects/30430b6ef0b843d9a13a2d4df7d00a07 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:33.874335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:33.874831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:33.874925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:33.965957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:33.968692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:34.214875 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1747/3469] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:34.216925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:34.217215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:34.217487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:34.288918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:34.295313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:34.329732 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1723/3470] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:34.331429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:34.359969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a2f6a-c76f-409c-adf1-f545e37c51b5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:34.373838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:34.374880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:34.375451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:34.376109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:34.377145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:34.377700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:34.379759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:34.432573 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1748/3471] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:34.438441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:34.469453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9b4bb-4fae-444d-abdb-778e711a5348 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:34.490953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:34.491681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:34.492023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:34.492316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:34.493157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:34.506351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:34.678541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1724/3472] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:34 2022] POST /identity/v3/projects => generated 395 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:01:34.680811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:34.701469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e968-ece6-4842-8283-ea8de2d7e445 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:34.761748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:34.943255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:34.947327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:34.948338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:34.951022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:34.951743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:34.962446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:35.071401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1749/3473] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:34 2022] POST /identity/v3/users => generated 298 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:35.075428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:35.096195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aaba8-2c36-4d2f-9b91-6bcf4f3a9645 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:35.134503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:35.135829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:35.148814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:35.149224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:35.150292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:35.156955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:35.177452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1725/3474] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:35.182123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:35.218107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834894-e829-4f7d-9ea4-f2e416b1006f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:35.247542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:35.248175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:35.248464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:35.248735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:35.258541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:35.276075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5acbe8-2bb9-477d-9497-edf9e5f8f280 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:35.351215 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1750/3475] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:01:35.353467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:35.363252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:35.399723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29c9e-925f-40af-94f0-56ca11000368 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:35.426512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:35.427219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:35.430021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:35.430316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] PATH_INFO: `/v3/projects/e46a2770ac60460a80d864c3509993c7/users/6c9c810e151c4260813d98f0d679fa58/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:35.503540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46a2770ac60460a80d864c3509993c7, user_id=6c9c810e151c4260813d98f0d679fa58, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:35.518297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:35.568099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1726/3476] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:35 2022] PUT /identity/v3/projects/e46a2770ac60460a80d864c3509993c7/users/6c9c810e151c4260813d98f0d679fa58/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:35.574077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:35.574786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:35.576160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:35.646360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:35.647972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:35.936956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1751/3477] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:35.950185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:35.953801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:36.125367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182af2-a1bd-436b-8f5f-7c6f40a3dff4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:36.130757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:36.131806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:36.132255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:36.132683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:36.150836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:36.152489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722f390-e33d-4838-bba3-9521c263ac24 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:36.188032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1727/3478] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:36.604290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:36.605921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:36.639414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b86d98-c75e-4492-a101-1181a9af7bdc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:36.660870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:36.661568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:36.661848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:36.664740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] PATH_INFO: `/v3/users/6f37af6296ca45f98272703bc7d38fc6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:36.670459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f37af6296ca45f98272703bc7d38fc6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:36.673705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:36.778700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f37af6296ca45f98272703bc7d38fc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:36.779462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f37af6296ca45f98272703bc7d38fc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:36.791390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f37af6296ca45f98272703bc7d38fc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:36.804608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f37af6296ca45f98272703bc7d38fc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:36.805970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-851e3d63-7f6c-44b0-9bb6-6e02afd47459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f37af6296ca45f98272703bc7d38fc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:36.856889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1752/3479] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:36 2022] DELETE /identity/v3/users/6f37af6296ca45f98272703bc7d38fc6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:36.862042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:36.863010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:36.863555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:36.898491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:36.899652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:36.956186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06fd7b-0358-42bb-bd52-8754c88c04a6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:36.957053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06fd7b-0358-42bb-bd52-8754c88c04a6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:36.957542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06fd7b-0358-42bb-bd52-8754c88c04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:36.978928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:37.005725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ef06fd7b-0358-42bb-bd52-8754c88c04a6 None None] MFA Rules not processed for user `28313b7c89184dd683e3479d23be489d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:37.008268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ef06fd7b-0358-42bb-bd52-8754c88c04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.008881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1728/3480] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:37.029741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:37.031454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.121923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505f5da-1081-4844-97e6-06dc2bfcd146 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:37.130585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:37.134046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:37.134654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:37.134843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:37.158335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1753/3481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:37.160103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:37.160519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:37.160949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:37.175978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:37.183443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:37.201495 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1729/3482] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:37.228685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] MFA Rules not processed for user `28313b7c89184dd683e3479d23be489d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:37.230157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.255433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1754/3483] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:37.275826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:37.279200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.371911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:37.490729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f915c-12d0-4ff5-bc4d-99f7735d36aa service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:37.499532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:37.500729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:37.501260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:37.501767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:37.515144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:37.519308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:37.548706 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1730/3484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:38.573117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:38.575780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:38.613586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db42d01-0103-4dad-9bc6-bacdb89b0e1e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:38.627332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:38.628817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:38.629273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:38.629720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:38.635565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:38.647939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:38.650340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4cf5d-c7b3-4084-8943-ded8c2196070 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:38.674005 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1755/3485] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:38.997444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:38.999499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:39.027018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a138d-87b4-4d86-b2fe-fe0f8fe2424e service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:39.044854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:39.045568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.045850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.046679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] PATH_INFO: `/v3/projects/36e12e5f8a5f4c32a72e14ca507993cd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.051392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e12e5f8a5f4c32a72e14ca507993cd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:39.058704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:39.147413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e12e5f8a5f4c32a72e14ca507993cd', 'request_id': 'req-85283b82-bdbb-475e-bc12-363b39d78140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:39.156562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e12e5f8a5f4c32a72e14ca507993cd', 'request_id': 'req-85283b82-bdbb-475e-bc12-363b39d78140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:39.177642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e12e5f8a5f4c32a72e14ca507993cd', 'request_id': 'req-85283b82-bdbb-475e-bc12-363b39d78140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:39.213963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] The token cache is being invalidate because project 36e12e5f8a5f4c32a72e14ca507993cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:39.214357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:39.216832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85283b82-bdbb-475e-bc12-363b39d78140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:39.221331 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1731/3486] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:38 2022] DELETE /identity/v3/projects/36e12e5f8a5f4c32a72e14ca507993cd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:39.226006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.226285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.227266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.255665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:39.275492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:39.468267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.468596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.468986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.474277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1756/3487] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:39.500113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:39.501291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:39.518573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:39.526244 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1732/3488] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:39.533640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d758f-ec0b-465e-8926-eb150d2222ec None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:39.541142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:39.542112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.542617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.543325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.544203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:39.544715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:39.546975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:39.574608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:39.608046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1757/3489] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:39.612011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ae234-4d2b-48b9-abe4-2cbb31a5ac1e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:39.619080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:39.619983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.620429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.621095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.623733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:39.626718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:39.680677 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1733/3490] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:39 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:39.685300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:39.701266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c8230-bc57-4fe4-a7e8-742715313c9f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:39.888722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:39.889779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.890235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.891231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.892358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:39.902553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:39.945129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:39.969815 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1758/3491] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:39 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:39.974242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:40.012827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e638-cd37-46d4-b1ed-2f8dca577405 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:40.046118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:40.046811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.047095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.047368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.051342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:40.061947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.117298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1734/3492] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:40.118513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:40.134704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac7b3-6876-4f6d-bc79-ad72af02027e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:40.173491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:40.174076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.174381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.174608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.175270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:40.181512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0755ef-b1c8-4e7e-b274-ca76d1671e84 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.238356 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1759/3493] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:40.243579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:40.269106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ad77-04dc-472d-96c5-5322879dcc4a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:40.279167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:40.291077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.291802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.293358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] PATH_INFO: `/v3/projects/df53541958e04236a8562ae864611a5e/users/3a0bd464585c4dab92c840bc3893b027/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.358760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df53541958e04236a8562ae864611a5e, user_id=3a0bd464585c4dab92c840bc3893b027, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:40.363929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.402378 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1735/3494] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:40 2022] PUT /identity/v3/projects/df53541958e04236a8562ae864611a5e/users/3a0bd464585c4dab92c840bc3893b027/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:40.407606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.408026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.408429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.440343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:40.443317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:40.563426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1760/3495] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:40.575919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:40.578395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:40.633617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:40.704806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9949c1e-2b18-47a6-b35c-5d72eae0027a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:40.713375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:40.714505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.716527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.717257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.777492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:40.780672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc2d8-8088-4cbd-aa44-96cf6cf22e1a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.847838 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1736/3496] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:41.422306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:41.425962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:41.566700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff51cf-e06d-434a-98dc-29589f73bf6d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:41.578256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:41.583129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:41.583129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:41.583129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:41.587794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:41.719692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:41.722622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cb3b6-79e6-4cd2-897d-0f74c103361c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:41.768142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1761/3497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:41.803598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:41.806517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:41.807360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:41.841037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] MFA Rules not processed for user `10535d8981ed4c3c908f2d3325052c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:41.843124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:41.947665 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1737/3498] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:50.157593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda4dc-d674-4ef6-b190-33a204fa0e6c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:50.158045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda4dc-d674-4ef6-b190-33a204fa0e6c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:50.158136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda4dc-d674-4ef6-b190-33a204fa0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:50.193257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-86eda4dc-d674-4ef6-b190-33a204fa0e6c None None] MFA Rules not processed for user `6c9c810e151c4260813d98f0d679fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:50.195988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-86eda4dc-d674-4ef6-b190-33a204fa0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:50.204637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:50.293943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1762/3499] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:50.986917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:50.990237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.012678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be440-21fd-4b54-bc40-1f1c329c9b60 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:51.034016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:51.035060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:51.035495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:51.035942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:51.049770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:51.055008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:51.081556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1738/3500] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:50 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:53.514053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:53.514499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:53.514603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:53.605759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:53.608960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:53.772130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:53.774388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:53.784349 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1763/3501] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:01:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:53.808824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:53.819381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:53.820062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca6e0-fd8d-4163-960a-09e0d0af0297 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:53.842560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:53.843224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:53.843506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:53.843779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] PATH_INFO: `/v3/users/0db24bba973f4b52b0c1409fd80daf74` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:53.845824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db24bba973f4b52b0c1409fd80daf74)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:53.847789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:53.966816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db24bba973f4b52b0c1409fd80daf74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:53.967696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db24bba973f4b52b0c1409fd80daf74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:53.968575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db24bba973f4b52b0c1409fd80daf74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:53.986863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db24bba973f4b52b0c1409fd80daf74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:54.000454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db24bba973f4b52b0c1409fd80daf74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:54.035191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684d4b-9c5e-4341-a614-8f6cf646878c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:54.055157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:54.056094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:54.056668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:54.057082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:54.067405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1739/3502] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:53 2022] DELETE /identity/v3/users/0db24bba973f4b52b0c1409fd80daf74 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:54.068447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:54.069440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:54.077677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:54.092681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:54.096596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:54.138955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1764/3503] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:54.184705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:54.276670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07ab30-8be1-4dd2-9644-d8bd48e107f2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:54.287800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:54.288472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:54.288728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:54.289071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:54.294981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:54.574421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:54.590780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66a415-e639-4100-b32a-92e89405b6b5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:54.618804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1740/3504] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:55.357242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:55.358708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:55.387797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5693b4-8ee6-4eaa-ab71-80866fda217d service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:55.398110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:55.399034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:55.399492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:55.399900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] PATH_INFO: `/v3/projects/9a1eb6ee53b0459b9ba5a61dec5108e0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:55.402993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1eb6ee53b0459b9ba5a61dec5108e0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:55.409760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:55.483814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:55.502573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'request_id': 'req-534e242a-a0b2-452a-99b5-6d3d39185f47'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:55.513830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'request_id': 'req-534e242a-a0b2-452a-99b5-6d3d39185f47'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:55.532285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'request_id': 'req-534e242a-a0b2-452a-99b5-6d3d39185f47'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:55.550564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] The token cache is being invalidate because project 9a1eb6ee53b0459b9ba5a61dec5108e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:55.550869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:55.552534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-534e242a-a0b2-452a-99b5-6d3d39185f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:55.561479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1765/3505] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:55 2022] DELETE /identity/v3/projects/9a1eb6ee53b0459b9ba5a61dec5108e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:55.563343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:55.563821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:55.563903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:55.611506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:55.613354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:55.712996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1741/3506] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:55.720543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:55.721097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:55.721518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:55.748271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:55.749856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:55.764212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:55.770492 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1766/3507] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:55.777950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e832ab-6baa-4f4f-a4b4-089afb5804f9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:55.786513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:55.787520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:55.788011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:55.788577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:55.790206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:55.790724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:55.792586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:55.813818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:55.818951 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1742/3508] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:55.838342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73bbf4-2414-4892-bd26-3733bff57c89 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:55.861976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:55.862611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:55.863041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:55.863362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:55.863811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:55.865804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:55.948434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:55.954795 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1767/3509] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:55 2022] POST /identity/v3/projects => generated 397 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:55.967248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39c602-b757-4cd5-a569-b67ecf61529b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:56.050501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:56.053262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.053703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.054128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.055015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:56.061334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:56.092588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1743/3510] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:55 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:56.096633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:56.114073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64713d-d520-48a9-88a5-e1bbab18cd27 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:56.126948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:56.127518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.127831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.128100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.129209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:56.131177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:56.150295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1768/3511] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:01:56.153771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:56.160491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:56.171515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af806524-f859-4b73-bdd5-595e359878b1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:56.179496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:56.180421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.180774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.181262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.181995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:56.184013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8d585-0903-447b-8267-e831a2ac094e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:56.205707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:56.209782 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1744/3512] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:56.233280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a02e-d9ce-46f3-944e-6e0f99f18c31 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:56.242138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:56.242760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.243096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.243663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] PATH_INFO: `/v3/projects/1389c5372a9a42faa7aae2d03ea2787b/users/52459d9276c94241ba4dd63403ce3a13/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.273050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389c5372a9a42faa7aae2d03ea2787b, user_id=52459d9276c94241ba4dd63403ce3a13, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:56.276701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:56.314387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1769/3513] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:56 2022] PUT /identity/v3/projects/1389c5372a9a42faa7aae2d03ea2787b/users/52459d9276c94241ba4dd63403ce3a13/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:56.317198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25a1a-c040-4f73-ad90-bc9fd30cb77b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.317486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25a1a-c040-4f73-ad90-bc9fd30cb77b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.318911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25a1a-c040-4f73-ad90-bc9fd30cb77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.373972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-aec25a1a-c040-4f73-ad90-bc9fd30cb77b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:56.377890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aec25a1a-c040-4f73-ad90-bc9fd30cb77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:56.577389 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1745/3514] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:56.602119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:56.604087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:56.683916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a3ab-9639-44e8-9bb9-bbcdedfdfcf1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:56.688840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:56.690252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:56.690561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:56.692818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:56.708461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:56.710607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:56.723945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1770/3515] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:58.440591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:58.441107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:58.441222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:58.499593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] MFA Rules not processed for user `3a0bd464585c4dab92c840bc3893b027`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:58.501106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:58.655641 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1746/3516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:01:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:58.918325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:58.920446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:59.047821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:59.078690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8608cf-9f4b-4c92-b4a8-77456139b7f0 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:59.098477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:59.099316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:59.099756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:59.100882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:59.120153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:59.121802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:59.143067 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1771/3517] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:04.490168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:04.492853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:04.518872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fdac-8cb5-4371-98e0-06c2ab1a8027 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:04.534323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:04.534922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:04.535918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:04.536373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] PATH_INFO: `/v3/users/6c9c810e151c4260813d98f0d679fa58` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:04.541284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9c810e151c4260813d98f0d679fa58)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:04.543870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:04.629237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9c810e151c4260813d98f0d679fa58'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:04.630180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9c810e151c4260813d98f0d679fa58'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:04.631015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9c810e151c4260813d98f0d679fa58'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:04.643066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9c810e151c4260813d98f0d679fa58'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:04.654617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e4164728-e9b1-487b-96ca-f8fead234011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9c810e151c4260813d98f0d679fa58'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:04.666714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:04.684408 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1747/3518] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:04 2022] DELETE /identity/v3/users/6c9c810e151c4260813d98f0d679fa58 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:05.072372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:05.088501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16030-cc81-482c-a46c-52799fd7373f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:05.208485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:05.209248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.209710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.210032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] PATH_INFO: `/v3/projects/e46a2770ac60460a80d864c3509993c7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.211910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46a2770ac60460a80d864c3509993c7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:05.214048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:05.330588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46a2770ac60460a80d864c3509993c7', 'request_id': 'req-0c57109d-ca31-4b7d-8347-6dbff7cc5857'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:05.339588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46a2770ac60460a80d864c3509993c7', 'request_id': 'req-0c57109d-ca31-4b7d-8347-6dbff7cc5857'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:05.352331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46a2770ac60460a80d864c3509993c7', 'request_id': 'req-0c57109d-ca31-4b7d-8347-6dbff7cc5857'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:05.376316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] The token cache is being invalidate because project e46a2770ac60460a80d864c3509993c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:05.376966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:05.377310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c57109d-ca31-4b7d-8347-6dbff7cc5857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:05.385374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.386250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.386250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.389149 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1772/3519] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:05 2022] DELETE /identity/v3/projects/e46a2770ac60460a80d864c3509993c7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:05.410334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:05.411316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:05.520802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.521142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.521424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.526576 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1748/3520] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:05.545506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:05.546743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:05.555719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1773/3521] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:05.561027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:05.575430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f550c0-057d-4208-b788-22fc8aef2fd9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:05.583593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:05.584608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.588398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.588988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.591166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:05.592438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:05.598587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:05.631599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:05.638382 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1749/3522] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:05.642135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dd2a1-d1b8-4c79-9ab6-bf9686a751f1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:05.658816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:05.659712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.660176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.660603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.661451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:05.663538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:05.722880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1774/3523] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:05 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:02:05.725253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:05.739183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd596-e703-4eee-ad07-52afa533df36 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:05.907239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:05.907813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:05.908096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:05.908373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:05.909036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:05.912076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:05.979791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1750/3524] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:05 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:05.984145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:06.000105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101caf-8c35-441a-b3ba-0fcadffe1a22 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:06.016064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:06.016811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:06.017220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:06.018910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:06.019724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:06.021527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:06.055401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1775/3525] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:06.058783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:06.074629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71741fa-8c83-4fb3-b19e-1a8bbef4985c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:06.082559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:06.083414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:06.085187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:06.085694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:06.087160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:06.089494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f385b6-63b2-4c5a-9d5f-3cd1243a514a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:06.109694 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1751/3526] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:06.110360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:06.135555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9bab6-2082-41fe-818e-e64b58ace7c0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:06.150479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:06.151584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:06.152110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:06.153692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] PATH_INFO: `/v3/projects/2fc42ddeb5cd4170a5d01683e0605a87/users/78e6fe2e79b54462b20619cf36ffadf0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:06.194760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc42ddeb5cd4170a5d01683e0605a87, user_id=78e6fe2e79b54462b20619cf36ffadf0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:06.200075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:06.243581 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1776/3527] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:06 2022] PUT /identity/v3/projects/2fc42ddeb5cd4170a5d01683e0605a87/users/78e6fe2e79b54462b20619cf36ffadf0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:06.249393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:06.249934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:06.250624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:06.305688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:06.312643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:06.474428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:06.497932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1752/3528] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:06.538670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:06.539875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:06.576660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:06.662340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630901-a3fe-4982-ae0a-4369284400ea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:06.666534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:06.667264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:06.667551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:06.667948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:06.680551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:06.682809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164640f-0bf8-4342-a136-726130571d23 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:06.706610 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1777/3529] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:07.499131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:07.531960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59816a24-dabb-4ebb-867b-048830282ff7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:07.537460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:07.538354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:07.538817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:07.539875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:07.546236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:07.572233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:07.583746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e8c54-b93f-44f4-b3db-5833ac72d60c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:07.629516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1753/3530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:09.947798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:09.948744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:09.949425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:10.031557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:10.033350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:10.219415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229af58-436f-4a63-94ff-c73067cb19dc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:10.220281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229af58-436f-4a63-94ff-c73067cb19dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:10.220736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229af58-436f-4a63-94ff-c73067cb19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:10.233409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1778/3531] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:10.262127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c229af58-436f-4a63-94ff-c73067cb19dc None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:10.263417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c229af58-436f-4a63-94ff-c73067cb19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:10.280213 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1754/3532] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:11.124389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:11.125928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:11.381687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2fb1c-5897-47f8-b22f-2daa298b9c9d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:11.409726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:11.412877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:11.413226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:11.413470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:11.435400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:11.439741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:11.471584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1779/3533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:20.045830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:20.046366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:20.046550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:20.094929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] MFA Rules not processed for user `78e6fe2e79b54462b20619cf36ffadf0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:20.096279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:20.218561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1755/3534] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:20.401174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:20.403403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:20.445681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:20.447934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:20.483681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d76a-5cfb-4b7a-b476-49a3b9897037 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:20.490610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:20.491085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:20.492675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:20.494379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:20.494886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] PATH_INFO: `/v3/users/52e08cff441e4fb0b01886d81a7b5ad6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:20.497129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e08cff441e4fb0b01886d81a7b5ad6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:20.499396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:20.581273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c639804-bf79-4709-a441-2d31d66913a0 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:20.586898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e08cff441e4fb0b01886d81a7b5ad6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:20.589464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e08cff441e4fb0b01886d81a7b5ad6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:20.591096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e08cff441e4fb0b01886d81a7b5ad6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:20.602367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e08cff441e4fb0b01886d81a7b5ad6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:20.603645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:20.604814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:20.604814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:20.605126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:20.607188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:20.622122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e08cff441e4fb0b01886d81a7b5ad6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:20.638007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:20.639870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:20.663735 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1756/3535] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:20 2022] DELETE /identity/v3/users/52e08cff441e4fb0b01886d81a7b5ad6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:20.665070 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1780/3536] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:21.824031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:21.826847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:21.952555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:22.040491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7186c-bf18-47e0-a2bb-e4b7d05cf24c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:22.048010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:22.049821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:22.050495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:22.050940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] PATH_INFO: `/v3/projects/a563769bd6e84594b3837db9d0fdafd4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:22.052761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a563769bd6e84594b3837db9d0fdafd4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:22.055768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:22.184931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a563769bd6e84594b3837db9d0fdafd4', 'request_id': 'req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.193571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a563769bd6e84594b3837db9d0fdafd4', 'request_id': 'req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.205118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a563769bd6e84594b3837db9d0fdafd4', 'request_id': 'req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.222176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] The token cache is being invalidate because project a563769bd6e84594b3837db9d0fdafd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:22.222659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.223346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.228434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1757/3537] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:21 2022] DELETE /identity/v3/projects/a563769bd6e84594b3837db9d0fdafd4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:22.229235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:22.256787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56687-8755-4f52-ad77-8dbc708cfbce service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:22.358863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:22.359893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:22.360383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:22.360864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] PATH_INFO: `/v3/users/35d39c6d11d946f7b2bfc041d7a949b1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:22.363121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d39c6d11d946f7b2bfc041d7a949b1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:22.365382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:22.483149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d39c6d11d946f7b2bfc041d7a949b1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.483994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d39c6d11d946f7b2bfc041d7a949b1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.506871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d39c6d11d946f7b2bfc041d7a949b1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.516328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d39c6d11d946f7b2bfc041d7a949b1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.518208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d39c6d11d946f7b2bfc041d7a949b1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.599199 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1781/3538] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:22 2022] DELETE /identity/v3/users/35d39c6d11d946f7b2bfc041d7a949b1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:22.613876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:22.615386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:22.798786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6ddfc-90c1-4d8c-b2e4-27ab8aff7547 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:22.962769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:22.964295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:22.964689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:22.965098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:22.983710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:23.004825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:23.182734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:23.191398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170620a-ced2-487e-b60f-e77608a250f1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:23.228831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1758/3539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:24.013616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.020293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.151787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:24.191204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7a9d7-a932-4133-94c5-d8a8e7f30437 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.199230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.199912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.200240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.201756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] PATH_INFO: `/v3/projects/f48609889f6f4df38e301223dbd1ed62` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.204176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48609889f6f4df38e301223dbd1ed62)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.206156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.340386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48609889f6f4df38e301223dbd1ed62', 'request_id': 'req-231249f7-e855-410c-837a-ddaf3de78675'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:24.364645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48609889f6f4df38e301223dbd1ed62', 'request_id': 'req-231249f7-e855-410c-837a-ddaf3de78675'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:24.388335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48609889f6f4df38e301223dbd1ed62', 'request_id': 'req-231249f7-e855-410c-837a-ddaf3de78675'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:24.449347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] The token cache is being invalidate because project f48609889f6f4df38e301223dbd1ed62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:24.449667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:24.452574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-231249f7-e855-410c-837a-ddaf3de78675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:24.460089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1782/3540] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:24 2022] DELETE /identity/v3/projects/f48609889f6f4df38e301223dbd1ed62 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:24.466312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.467159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.467602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.524480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:24.540633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.706411 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1759/3541] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:24.718236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.718531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.718877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.761998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:24.764015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.787176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1783/3542] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:24.789485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.812978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b20cc-ef3e-4faf-bc41-7a00e97ceac8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.824334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.825011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.825292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.825560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.826251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:24.826569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.828236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.864141 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1760/3543] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:24.865511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.876389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c8027-d895-44d8-87ca-b1147d8e4c45 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.896963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.896963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.896963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.896963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.897362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.905213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.971317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1784/3544] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:24.972586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.004011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd167-150d-4868-aee1-47395a297989 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.237754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.238785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.238968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.239203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.239850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:25.247927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:25.288534 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1761/3545] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:25.293905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.310670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4118f-da99-4f30-b58c-67e054037eea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.318039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.319835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.322015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.322628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.323812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:25.327229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:25.351167 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1785/3546] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:25.352795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.405790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde81d-8bbb-48f4-8c31-982469ef4066 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.418978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.420004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.420641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.421041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.422114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:25.424039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ade312-0a56-4c43-bbb1-6765d26b677c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:25.442767 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1762/3547] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:25.447069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.459811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54cab-0dd1-4b32-bfd7-a18ddf490ffe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.484083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.484867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.485166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.485433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] PATH_INFO: `/v3/projects/2414b143e25042a19c8645b96235f985/users/72141a19aa484ad9b466792ab782ec52/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.520371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2414b143e25042a19c8645b96235f985, user_id=72141a19aa484ad9b466792ab782ec52, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:25.523208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:25.545604 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1786/3548] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:25 2022] PUT /identity/v3/projects/2414b143e25042a19c8645b96235f985/users/72141a19aa484ad9b466792ab782ec52/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:25.559395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.564072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.565068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.687677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:25.700120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] MFA Rules not processed for user `72141a19aa484ad9b466792ab782ec52`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:25.703867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:25.868363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1763/3549] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:25.873219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.989726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8eb6-5656-45e3-b06d-cf520fe4a361 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.996139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.997085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.997342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.997612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.998268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.003411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.020276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:26.052457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1787/3550] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:25 2022] POST /identity/v3/projects => generated 395 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:26.056743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:26.074808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2edf93-dec8-40f0-a748-553906fd583d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:26.158087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:26.158714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.158990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.159259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.160014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.162612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.209263 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1764/3551] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:26 2022] POST /identity/v3/users => generated 304 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:26.210246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:26.223549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c5b5-faef-4338-bdf9-5f685335f207 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:26.232051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:26.233935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.234184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.234507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.235486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.239168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.258890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:26.265319 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1788/3552] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:26.274402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e323dd-9824-44a8-bc0d-c00d9c4a494a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:26.283985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:26.285169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.285707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.286134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] PATH_INFO: `/v3/projects/bb617425eab747a88959c48904f0bec4/users/74e67ddfae1b4df1b5639dc36114363f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.310623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb617425eab747a88959c48904f0bec4, user_id=74e67ddfae1b4df1b5639dc36114363f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.314599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.338864 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1765/3553] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:26 2022] PUT /identity/v3/projects/bb617425eab747a88959c48904f0bec4/users/74e67ddfae1b4df1b5639dc36114363f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:26.340409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:26.355065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7914-4b5b-48ce-810f-a7ec1a660bfe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:26.437351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:26.438636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.439012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.439381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.440804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.442651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db3613-7742-4715-a610-0ddb75a2c857 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.458329 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1789/3554] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:26.462523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:26.479467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366acfe-c6d2-46cb-bf5b-07bbdc8b17bd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:26.488456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:26.489206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.489487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.489759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] PATH_INFO: `/v3/projects/bb617425eab747a88959c48904f0bec4/users/74e67ddfae1b4df1b5639dc36114363f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.493465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb617425eab747a88959c48904f0bec4, user_id=74e67ddfae1b4df1b5639dc36114363f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:26.497043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f471e6-248a-4e09-b667-676577576766 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:26.522113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1766/3555] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:26 2022] PUT /identity/v3/projects/bb617425eab747a88959c48904f0bec4/users/74e67ddfae1b4df1b5639dc36114363f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:26.523304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.523745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.524021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.588748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] MFA Rules not processed for user `74e67ddfae1b4df1b5639dc36114363f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:26.591095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:26.739237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1790/3556] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:26.742741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1deba-0b13-4235-af69-ad298c47a322 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:26.743549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1deba-0b13-4235-af69-ad298c47a322 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:26.743987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1deba-0b13-4235-af69-ad298c47a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:26.790674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74c1deba-0b13-4235-af69-ad298c47a322 None None] MFA Rules not processed for user `72141a19aa484ad9b466792ab782ec52`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:26.792070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74c1deba-0b13-4235-af69-ad298c47a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:26.865617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:26.881853 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1767/3557] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:27.159823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:27.161751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:27.228200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:27.259862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff602436-1249-44e4-a28f-01ecba5ebf31 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:27.267618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:27.268500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:27.269040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:27.269298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:27.291605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:27.294648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca5836-e07f-42e6-9450-dbfbc6893166 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:27.311391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1791/3558] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:27.876557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb38b6-ddbd-415c-a57d-81c84ddbafaf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:27.877099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb38b6-ddbd-415c-a57d-81c84ddbafaf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:27.877099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb38b6-ddbd-415c-a57d-81c84ddbafaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:27.909752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b2eb38b6-ddbd-415c-a57d-81c84ddbafaf None None] MFA Rules not processed for user `78e6fe2e79b54462b20619cf36ffadf0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:27.911561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2eb38b6-ddbd-415c-a57d-81c84ddbafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:28.034986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1768/3559] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:31.570214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b89e-e473-412a-9b6a-3f36b8614d3a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:31.570889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b89e-e473-412a-9b6a-3f36b8614d3a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:31.570889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b89e-e473-412a-9b6a-3f36b8614d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:31.620258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d646b89e-e473-412a-9b6a-3f36b8614d3a None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:31.621871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d646b89e-e473-412a-9b6a-3f36b8614d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:31.703309 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1792/3560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:32.177923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.178617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.178617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.222164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:32.224225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.238271 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1769/3561] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:32.363688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973b20-a04b-4f75-9f01-5a7ebe456081 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.364027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973b20-a04b-4f75-9f01-5a7ebe456081 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.364217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973b20-a04b-4f75-9f01-5a7ebe456081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.390051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-53973b20-a04b-4f75-9f01-5a7ebe456081 None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:32.391635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53973b20-a04b-4f75-9f01-5a7ebe456081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.401727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:32.410436 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1793/3562] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:32.412170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.448051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0cd75-a462-4e4d-b95a-52001177eb65 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.448355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0cd75-a462-4e4d-b95a-52001177eb65 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.448646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0cd75-a462-4e4d-b95a-52001177eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.487963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8a0cd75-a462-4e4d-b95a-52001177eb65 None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:32.490038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8a0cd75-a462-4e4d-b95a-52001177eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.501775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1794/3563] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:32.540984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea477d-7bc7-4b47-aff4-7ac70c3b300f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.541344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea477d-7bc7-4b47-aff4-7ac70c3b300f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.542033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea477d-7bc7-4b47-aff4-7ac70c3b300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.562993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-abea477d-7bc7-4b47-aff4-7ac70c3b300f None None] MFA Rules not processed for user `52459d9276c94241ba4dd63403ce3a13`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:32.564614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-abea477d-7bc7-4b47-aff4-7ac70c3b300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.571934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6628-e7f3-440b-9e41-54313ef4efdc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:32.573341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1795/3564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:32.588106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:32.588770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.591073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.591073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] PATH_INFO: `/v3/users/10535d8981ed4c3c908f2d3325052c6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.591073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=10535d8981ed4c3c908f2d3325052c6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:32.595198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:32.729440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10535d8981ed4c3c908f2d3325052c6a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:32.730986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10535d8981ed4c3c908f2d3325052c6a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:32.732257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10535d8981ed4c3c908f2d3325052c6a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:32.743695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10535d8981ed4c3c908f2d3325052c6a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:32.754114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10535d8981ed4c3c908f2d3325052c6a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:32.791324 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1770/3565] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:32 2022] DELETE /identity/v3/users/10535d8981ed4c3c908f2d3325052c6a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:32.795822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:32.796356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:32.796805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:32.828220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:32.830252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:32.928638 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1796/3566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:32.984996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:32.987899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:33.011964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:33.057976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7faa4a-c64b-454c-8f14-a7de1300f5db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:33.063248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:33.064027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:33.064305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:33.064582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:33.078024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:33.080447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:33.095679 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1771/3567] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:02:33.574360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:33.576273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:33.614715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd71e4-c8be-44ea-b048-57509ab87615 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:33.628070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:33.628448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:33.628724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:33.629097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] PATH_INFO: `/v3/projects/6dcc2826ba6d4a1a9e5534cf94edd809` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:33.630245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcc2826ba6d4a1a9e5534cf94edd809)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:33.632637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:33.692968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcc2826ba6d4a1a9e5534cf94edd809', 'request_id': 'req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.699218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcc2826ba6d4a1a9e5534cf94edd809', 'request_id': 'req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.707620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcc2826ba6d4a1a9e5534cf94edd809', 'request_id': 'req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.710149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:33.725503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] The token cache is being invalidate because project 6dcc2826ba6d4a1a9e5534cf94edd809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:33.725927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.727336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.730536 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1797/3568] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:33 2022] DELETE /identity/v3/projects/6dcc2826ba6d4a1a9e5534cf94edd809 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:33.734674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:33.745619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878b55-4a0a-40b2-986c-c55a934af350 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:33.811181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:33.811824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:33.812117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:33.812391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] PATH_INFO: `/v3/users/3522ce5a8a9b4eb68f5323342fb96c28` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:33.813564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3522ce5a8a9b4eb68f5323342fb96c28)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:33.815473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:33.869028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3522ce5a8a9b4eb68f5323342fb96c28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.870371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3522ce5a8a9b4eb68f5323342fb96c28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.871216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3522ce5a8a9b4eb68f5323342fb96c28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.880549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3522ce5a8a9b4eb68f5323342fb96c28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.889302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e52bee83-edb4-4deb-99cf-6e269eb4e400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3522ce5a8a9b4eb68f5323342fb96c28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:33.910573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1772/3569] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:33 2022] DELETE /identity/v3/users/3522ce5a8a9b4eb68f5323342fb96c28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:34.154427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:34.155965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:34.184712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4df68-1e64-4d6a-a921-5ac9e72493f4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:34.290147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:34.290842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.291130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.291399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] PATH_INFO: `/v3/projects/3807951fd06940f4aeb74425c22415a2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.292803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3807951fd06940f4aeb74425c22415a2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:34.295032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:34.384148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3807951fd06940f4aeb74425c22415a2', 'request_id': 'req-0e359989-9300-4f6f-a3a9-6c40693a3a61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:34.392197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3807951fd06940f4aeb74425c22415a2', 'request_id': 'req-0e359989-9300-4f6f-a3a9-6c40693a3a61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:34.404359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3807951fd06940f4aeb74425c22415a2', 'request_id': 'req-0e359989-9300-4f6f-a3a9-6c40693a3a61'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:34.430503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] The token cache is being invalidate because project 3807951fd06940f4aeb74425c22415a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:34.431449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:34.432399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e359989-9300-4f6f-a3a9-6c40693a3a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:34.435162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1798/3570] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:34 2022] DELETE /identity/v3/projects/3807951fd06940f4aeb74425c22415a2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:34.441393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.442038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.442628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.485971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:34.488261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:34.563368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:34.606061 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1773/3571] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:34.614688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.615289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.615289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.638163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:34.639443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:34.652223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1799/3572] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:34.653312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:34.664509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cd3ee-2220-4223-a473-8eae66b029fc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:34.669537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:34.677212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.677553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.677832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.678638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:34.678948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:34.681741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:34.697497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1774/3573] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:34.702194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:34.713318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c714581-e063-477c-9920-813f92cff7a1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:34.719063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:34.719776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.720125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.721153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.721869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:34.723853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:34.787605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1800/3574] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:34 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:02:34.791953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:34.822781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73883-ec01-4189-aa11-15b021bf7af3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:34.946189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:34.947328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:34.947798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:34.949034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:34.949864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:34.953904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:34.996515 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1775/3575] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:34 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:34.996983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.017340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e76a7-26fd-4f8a-ab8d-5a7751473009 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.029689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.030325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.030609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.030883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.031546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.043141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.062837 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1801/3576] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:35.066523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.083982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca1d3-e878-4766-8804-351a35e6d2f3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.101767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.102362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.103025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.103899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.104574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.111628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733145a-87bc-47cf-846f-fc7d0b66486a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.139720 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1776/3577] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:35.143488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.157445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1f13-f5d6-41fe-a5c8-c8d58c4a86b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.168778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.169741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.170194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.170612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] PATH_INFO: `/v3/projects/5c1a6c93007a40639b3156bead850370/users/4a0a255c26c24d4b9b69fda77d50fa07/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.211042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a6c93007a40639b3156bead850370, user_id=4a0a255c26c24d4b9b69fda77d50fa07, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.214101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.237141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1802/3578] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:35 2022] PUT /identity/v3/projects/5c1a6c93007a40639b3156bead850370/users/4a0a255c26c24d4b9b69fda77d50fa07/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:35.248861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.249334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.249732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.287880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] MFA Rules not processed for user `4a0a255c26c24d4b9b69fda77d50fa07`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:35.291628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:35.391769 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1777/3579] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:35.392376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.430460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:35.536703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03ef7-a87c-418c-91ee-e1011fcc0a00 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.551904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.552815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.553345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.553771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.555145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.560451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.624260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1803/3580] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:35 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:35.630099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.652616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f29483-2c1e-4c95-93a0-fe0eba673a94 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.747202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:35.808876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.809537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.809807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.810093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.810720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.814521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.850351 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1778/3581] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:35 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:35.852655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.866772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377de9a7-d12a-434e-9400-cb79ec46e912 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.872639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.873606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.873982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.874328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.875035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.876710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.893548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1804/3582] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:35.895062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.907373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18f35-cc1c-43d5-aefb-1de12668b83c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.913188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.914600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.915136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.915507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] PATH_INFO: `/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd/users/5806aefbaae840bbb2180aa9d9965e26/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.934257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a9f5cc519f45b3bf28013d75723fdd, user_id=5806aefbaae840bbb2180aa9d9965e26, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.937208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.956384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1779/3583] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:35 2022] PUT /identity/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd/users/5806aefbaae840bbb2180aa9d9965e26/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:35.960388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.970930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf85ec-bfb9-4268-9fa2-8c91e5d23f44 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.075378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.076006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.076302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.076719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.078109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.082084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc864c-93e3-4c34-aa62-cc6e583b4f90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.132188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.133725 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1805/3584] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:36.153233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c72164-7d88-4536-b294-f14396e6ff2f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.167395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.168407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.168790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.169189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] PATH_INFO: `/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd/users/5806aefbaae840bbb2180aa9d9965e26/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.178494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a9f5cc519f45b3bf28013d75723fdd, user_id=5806aefbaae840bbb2180aa9d9965e26, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.181578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.232558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.232846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.233146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.245506 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1780/3585] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:36 2022] PUT /identity/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd/users/5806aefbaae840bbb2180aa9d9965e26/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:36.301043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] MFA Rules not processed for user `5806aefbaae840bbb2180aa9d9965e26`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:36.303442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:36.486326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1806/3586] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:36.816425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.819657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:36.938912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229a30a-a385-4569-8fb0-564137b116d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.954457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.955795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.956236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.956666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.968551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.970504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc4df8-09ea-47af-9556-c5510ad55f2c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.988525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1781/3587] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:38.157782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:38.196347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:38.309000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b4ce-06b7-42c8-9fa9-659248b5dd97 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:38.315492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:38.316462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:38.317481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:38.318764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] PATH_INFO: `/v3/users/4a0a255c26c24d4b9b69fda77d50fa07` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:38.323142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0a255c26c24d4b9b69fda77d50fa07)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:38.327175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:38.517409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0a255c26c24d4b9b69fda77d50fa07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.518444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0a255c26c24d4b9b69fda77d50fa07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.532480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0a255c26c24d4b9b69fda77d50fa07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.550164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0a255c26c24d4b9b69fda77d50fa07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.551930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0a255c26c24d4b9b69fda77d50fa07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.590884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1807/3588] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:38 2022] DELETE /identity/v3/users/4a0a255c26c24d4b9b69fda77d50fa07 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:38.595613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:38.596109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:38.596201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:38.639757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:38.648925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:38.855197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1782/3589] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:38.882112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:38.883678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:38.994811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606efb-29e1-4e5d-ac72-dc93555c0333 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.004819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.005492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.005772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.006047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.017458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.018944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.030982 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1808/3590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:40.678284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:40.680440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:40.703640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b97925-63ed-4aaa-87d1-2a87770f9347 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:40.727177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:40.729346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:40.729949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:40.730445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] PATH_INFO: `/v3/projects/5c1a6c93007a40639b3156bead850370` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:40.732634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1a6c93007a40639b3156bead850370)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:40.736680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:40.753146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:40.890107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1a6c93007a40639b3156bead850370', 'request_id': 'req-5a6661c9-79ce-47bd-a018-245d45ef4084'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:40.910583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1a6c93007a40639b3156bead850370', 'request_id': 'req-5a6661c9-79ce-47bd-a018-245d45ef4084'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:40.932329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1a6c93007a40639b3156bead850370', 'request_id': 'req-5a6661c9-79ce-47bd-a018-245d45ef4084'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:40.971291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] The token cache is being invalidate because project 5c1a6c93007a40639b3156bead850370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:40.971583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:40.974833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:40.985719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:40.988632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1783/3591] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:40 2022] DELETE /identity/v3/projects/5c1a6c93007a40639b3156bead850370 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:41.001428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b03b6-1d42-440b-a4eb-5b4f13d345a0 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.107890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:41.161529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.163452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.164412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.164930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] PATH_INFO: `/v3/users/5806aefbaae840bbb2180aa9d9965e26` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.166397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5806aefbaae840bbb2180aa9d9965e26)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.168735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.247497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5806aefbaae840bbb2180aa9d9965e26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:41.248192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5806aefbaae840bbb2180aa9d9965e26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:41.263173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5806aefbaae840bbb2180aa9d9965e26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:41.272762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5806aefbaae840bbb2180aa9d9965e26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:41.274256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5806aefbaae840bbb2180aa9d9965e26'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:41.310435 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1809/3592] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:40 2022] DELETE /identity/v3/users/5806aefbaae840bbb2180aa9d9965e26 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:42.501559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:42.503687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:42.527387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6661c9-79ce-47bd-a018-245d45ef4084 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:42.574819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:42.576862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:42.621794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:42.623467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:42.623923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:42.624340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] PATH_INFO: `/v3/users/3a0bd464585c4dab92c840bc3893b027` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:42.626057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0bd464585c4dab92c840bc3893b027)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:42.628287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:42.711639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4376b1c-6586-4d44-b010-d56481e4fe60 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:42.728124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:42.729625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:42.730738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0bd464585c4dab92c840bc3893b027'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.731162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:42.731504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] PATH_INFO: `/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:42.732420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0bd464585c4dab92c840bc3893b027'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.734028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a9f5cc519f45b3bf28013d75723fdd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:42.734478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0bd464585c4dab92c840bc3893b027'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.740372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:42.750660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0bd464585c4dab92c840bc3893b027'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.767121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88644a38-a2fb-4488-ab58-3128e6bcd7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0bd464585c4dab92c840bc3893b027'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.826658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1784/3593] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:42 2022] DELETE /identity/v3/users/3a0bd464585c4dab92c840bc3893b027 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:42.871632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a9f5cc519f45b3bf28013d75723fdd', 'request_id': 'req-3369e0de-1adb-40a2-a0ec-715a85e222e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.884085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a9f5cc519f45b3bf28013d75723fdd', 'request_id': 'req-3369e0de-1adb-40a2-a0ec-715a85e222e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.888321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:42.901933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a9f5cc519f45b3bf28013d75723fdd', 'request_id': 'req-3369e0de-1adb-40a2-a0ec-715a85e222e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.927385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] The token cache is being invalidate because project f6a9f5cc519f45b3bf28013d75723fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:42.927960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.928769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3369e0de-1adb-40a2-a0ec-715a85e222e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:42.931088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1810/3594] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:42 2022] DELETE /identity/v3/projects/f6a9f5cc519f45b3bf28013d75723fdd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:42.937719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:42.938005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:42.938475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:42.959902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:42.962043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:42.974990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:43.076341 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1785/3595] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:43.077066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.077351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.077627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.102810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:43.104117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:43.125129 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1811/3596] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:43.127287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.145393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400d18-27ee-4f71-9dfe-e830be29f321 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.153227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.154227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.154734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.155223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.156133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:43.156669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.159476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.178293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1786/3597] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:43.179146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.192743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663bce6-0562-41d9-aa23-c354b0ab0a59 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.199665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.200288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.200608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.200933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.201939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.204193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.259355 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1812/3598] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:43 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:43.260568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.273757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375674e-200e-4e3c-a30b-b16bd1474598 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.425668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.428752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.429939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.431053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.432018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.435673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.467945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1787/3599] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:43 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:43.471741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.486243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2eed1-386c-450a-b4ce-74c5fe055ebf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.521448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.523477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.523765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.524577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.525797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.531881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.559954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1813/3600] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:43.564091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.578573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85de7-c4dc-48c4-a59c-039f70100085 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.587198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.588849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.589607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.590036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.590937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.611715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.630715 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1788/3601] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:43.635249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.647080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:43.654524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b4fbd-4620-4caf-a1cb-94832e6ceb1c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.655515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:43.666588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.667394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.667765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.669070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] PATH_INFO: `/v3/projects/74485b211f854132b59f02e4decdf998/users/67ece33b583c4baeb46ac278aa60ae4f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.686584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec610a-1ab9-473d-b804-fe2874966612 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:43.698747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:43.699387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.699664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.699934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] PATH_INFO: `/v3/projects/df53541958e04236a8562ae864611a5e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.701618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df53541958e04236a8562ae864611a5e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.702304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74485b211f854132b59f02e4decdf998, user_id=67ece33b583c4baeb46ac278aa60ae4f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:43.703532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.706180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c892d7b-f674-4d44-b9a1-c309bbe4cb35 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:43.739406 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1814/3602] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:43 2022] PUT /identity/v3/projects/74485b211f854132b59f02e4decdf998/users/67ece33b583c4baeb46ac278aa60ae4f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:43.747572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee68477-70db-46b6-badc-255afa46e75a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.747885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee68477-70db-46b6-badc-255afa46e75a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.748262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee68477-70db-46b6-badc-255afa46e75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.813108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3ee68477-70db-46b6-badc-255afa46e75a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:43.818572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ee68477-70db-46b6-badc-255afa46e75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:43.840159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df53541958e04236a8562ae864611a5e', 'request_id': 'req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:43.855607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df53541958e04236a8562ae864611a5e', 'request_id': 'req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:43.871852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df53541958e04236a8562ae864611a5e', 'request_id': 'req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:43.916765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] The token cache is being invalidate because project df53541958e04236a8562ae864611a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:43.917452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:43.918363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a89d0a33-5d67-4fd1-a2b4-f53cbce066f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:43.924597 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1789/3603] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:43 2022] DELETE /identity/v3/projects/df53541958e04236a8562ae864611a5e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:43.934154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:43.934495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:43.934580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:43.962972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:43.993798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:43.999079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.002182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1815/3604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:44.024329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.024632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.024879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.030615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1790/3605] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:44.039733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.043138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.063250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:44.064532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.077769 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1816/3606] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:44.078782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.089935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15e716-62cb-45ed-9411-d9678c5ca0f1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.096105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.097123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.097407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.097817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.098495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:44.099488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.100619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.120503 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1817/3607] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:44.121503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.132711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902173-ea48-4c6c-a8e5-6b174607c540 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.139165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.139805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.140068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.140356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.141174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.144444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.176648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f28e-5f3e-4ba3-a473-75f093c59063 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.183141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.184952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.185246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.185519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.201585 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1818/3608] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:44.203881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.209522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.213217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.241388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1791/3609] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:44.304694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:44.377809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dd17-f3ed-4c61-9b55-56a1851903df admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.394147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.395114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.395565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.395983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.396880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.405043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.457482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1819/3610] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:44.461952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.480736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a3bc-1371-4a33-8c64-728fb2ff8aaf service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.499988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.500683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.501144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.501426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.502291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.503928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.531251 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1792/3611] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:44.531650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.543965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f97f9-f275-45da-8e7a-1214cf878f52 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.560502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.562602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.564282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.565183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.573145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.574944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f43f5f-474b-408c-b087-462831232226 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.615297 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1820/3612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:44.619528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.634599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47df6a2-5253-4165-b222-fe7726512aba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.643445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.644609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.645113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.645541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] PATH_INFO: `/v3/projects/9ebe8016f5094b2a856a520ad1e5d4cf/users/6859db32b98f4caba7379962eaef9de3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.669415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebe8016f5094b2a856a520ad1e5d4cf, user_id=6859db32b98f4caba7379962eaef9de3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.673987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.697484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1793/3613] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:44 2022] PUT /identity/v3/projects/9ebe8016f5094b2a856a520ad1e5d4cf/users/6859db32b98f4caba7379962eaef9de3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:44.704555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a13b-2f4c-491b-b0a7-f4d8fcd13aca None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.705395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a13b-2f4c-491b-b0a7-f4d8fcd13aca None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.705815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a13b-2f4c-491b-b0a7-f4d8fcd13aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.740095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad67a13b-2f4c-491b-b0a7-f4d8fcd13aca None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:44.741631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad67a13b-2f4c-491b-b0a7-f4d8fcd13aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.889056 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1821/3614] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:44.949691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.953051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:45.081386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ab57-75fd-446d-af19-c10c701d50f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:45.086977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:45.087882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:45.088933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:45.089222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:45.102406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:45.103565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:45.115283 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1794/3615] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:47.222546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:47.223845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:47.224288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:47.248519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] MFA Rules not processed for user `28313b7c89184dd683e3479d23be489d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:47.250108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:47.426116 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1822/3616] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:47.560581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:47.564650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:47.580857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97960eaa-4c26-4f4c-80d4-6abf1e96ee37 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:47.587288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:47.588025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:47.588793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:47.588793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] PATH_INFO: `/v3/users/854e41184e0f4b06aa85a150fec89fd4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:47.589981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854e41184e0f4b06aa85a150fec89fd4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:47.593178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:47.693940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854e41184e0f4b06aa85a150fec89fd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:47.695849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854e41184e0f4b06aa85a150fec89fd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:47.696706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854e41184e0f4b06aa85a150fec89fd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:47.709844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854e41184e0f4b06aa85a150fec89fd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:47.726503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-85b25e04-7756-441f-9234-aa62e87cebd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854e41184e0f4b06aa85a150fec89fd4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:47.729834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:47.784298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1795/3617] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:47 2022] DELETE /identity/v3/users/854e41184e0f4b06aa85a150fec89fd4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:48.452391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:48.520160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ce6f-0738-4fd5-88fc-1dcf3114988e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:48.698963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:48.699905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:48.700339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:48.700811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] PATH_INFO: `/v3/projects/0c49ee1d5d5642749e3e90fb9d596636` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:48.702848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c49ee1d5d5642749e3e90fb9d596636)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:48.707905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:48.728249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:48.803451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c49ee1d5d5642749e3e90fb9d596636', 'request_id': 'req-22175682-d6b8-41c1-9731-2d7809a56706'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:48.814172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c49ee1d5d5642749e3e90fb9d596636', 'request_id': 'req-22175682-d6b8-41c1-9731-2d7809a56706'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:48.829464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c49ee1d5d5642749e3e90fb9d596636', 'request_id': 'req-22175682-d6b8-41c1-9731-2d7809a56706'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:48.847497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] The token cache is being invalidate because project 0c49ee1d5d5642749e3e90fb9d596636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:48.848528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:48.849427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:48.859114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea4f7-3c9f-4e0a-b95d-ada504cf9f3d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:48.859675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1823/3618] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:48 2022] DELETE /identity/v3/projects/0c49ee1d5d5642749e3e90fb9d596636 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:48.859782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea4f7-3c9f-4e0a-b95d-ada504cf9f3d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:48.859782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea4f7-3c9f-4e0a-b95d-ada504cf9f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:48.899162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a1dea4f7-3c9f-4e0a-b95d-ada504cf9f3d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:48.900566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a1dea4f7-3c9f-4e0a-b95d-ada504cf9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:49.049312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.052019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:49.070891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1796/3619] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:49.079311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.079871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.080232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.148088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:49.150935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:49.172423 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1797/3620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:49.176278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.188993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b571d-8df9-4c9f-8f85-7bd6cb0cccfb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.202296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.202987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.205691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.206188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.206891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:49.207195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.208841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.255986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1798/3621] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:02:49.257169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.278896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175682-d6b8-41c1-9731-2d7809a56706 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.285373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b4f1-4b19-46b4-8254-4c63b725d652 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.298391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.299803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.301319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.302648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.302919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] PATH_INFO: `/v3/users/52459d9276c94241ba4dd63403ce3a13` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.305880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.314326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.314643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.314908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52459d9276c94241ba4dd63403ce3a13)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.315682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.317134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.318374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.365959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1799/3622] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:49 2022] POST /identity/v3/projects => generated 411 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:49.368019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.437727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52459d9276c94241ba4dd63403ce3a13'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:49.438727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52459d9276c94241ba4dd63403ce3a13'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:49.454369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52459d9276c94241ba4dd63403ce3a13'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:49.470177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52459d9276c94241ba4dd63403ce3a13'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:49.471490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52459d9276c94241ba4dd63403ce3a13'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:49.516325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1824/3623] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:49 2022] DELETE /identity/v3/users/52459d9276c94241ba4dd63403ce3a13 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:49.527003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25f47-8e04-43e6-b261-c2d00d251b9d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.683155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:49.719690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.720609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.720894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.721249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.721943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.727630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.795187 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1800/3624] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:49 2022] POST /identity/v3/users => generated 306 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:49.796974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.799050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:49.831381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b2e96-27a1-423f-8132-227d2371cff6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.843858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.844794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.845349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.845634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.846291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.850010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.877941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.889750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1825/3625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:49.891212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc83bd-e71a-43ce-90de-d313cb890d33 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.907937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.908443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.908796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.909097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.909891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:49.911563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c6e0f-df90-46c2-90f5-872df29ff32e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:49.933414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1801/3626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:49.937831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:49.967340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18555d-404d-4a8b-8150-f9422e05a12d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:49.981713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:49.982557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:49.982997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:49.983278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] PATH_INFO: `/v3/projects/cb09627a84e44334b45c8828d00f255a/users/7d34514faf454e7996cb87e2bc6847a2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:49.987434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:50.028937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb09627a84e44334b45c8828d00f255a, user_id=7d34514faf454e7996cb87e2bc6847a2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:50.036353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:50.068171 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1826/3627] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:49 2022] PUT /identity/v3/projects/cb09627a84e44334b45c8828d00f255a/users/7d34514faf454e7996cb87e2bc6847a2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:50.073647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:50.074241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:50.074808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:50.099254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:50.101415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:50.241776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1802/3628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:50.316489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:50.318421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:50.410945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf153b-9e7f-4bab-9b0b-b1c92f9e037e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:50.416284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:50.416777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:50.417100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:50.417368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:50.440041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:50.442165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b4f04-5b5c-4605-8529-015dd5ab1112 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:50.456455 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1827/3629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:50.890321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:50.891896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:50.925373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7af86-2255-49b6-9159-c6ad6cb9fc28 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:50.941762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:50.945741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:50.946825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:50.962841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] PATH_INFO: `/v3/projects/1389c5372a9a42faa7aae2d03ea2787b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:50.969075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1389c5372a9a42faa7aae2d03ea2787b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:50.993460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.139160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1389c5372a9a42faa7aae2d03ea2787b', 'request_id': 'req-b27af554-d14a-46da-bda7-aac69202336a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:51.158323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1389c5372a9a42faa7aae2d03ea2787b', 'request_id': 'req-b27af554-d14a-46da-bda7-aac69202336a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:51.186714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1389c5372a9a42faa7aae2d03ea2787b', 'request_id': 'req-b27af554-d14a-46da-bda7-aac69202336a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:51.207509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] The token cache is being invalidate because project 1389c5372a9a42faa7aae2d03ea2787b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:51.209098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:51.210954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b27af554-d14a-46da-bda7-aac69202336a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:51.215241 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1803/3630] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:50 2022] DELETE /identity/v3/projects/1389c5372a9a42faa7aae2d03ea2787b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:51.226113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.227321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.228523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.260444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:51.262020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:51.398324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1828/3631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:51.408181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.408822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.409353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.468978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:51.470139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:51.497458 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1804/3632] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:51.500423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.518017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d0e0-9f29-42b5-b6bd-01a84de19685 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:51.530566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:51.531199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.537419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.537812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.538605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:51.539469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:51.541159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.574067 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1829/3633] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:51.576357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.592074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff691-5e7c-4dda-b106-d3dfdc8e4774 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:51.604092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:51.606439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.606739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.607998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.608681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:51.614018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.695944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1805/3634] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:51 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:51.699926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.713657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ce556-336a-475d-8682-c4e9554f8831 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:51.829898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:51.830623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.830952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.831216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.831858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:51.833916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.865006 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1830/3635] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:51 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:51.866549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.879307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08f00-0ec1-4a1f-8def-4ef53d09aedc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:51.891914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:51.892687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.893096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.893487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.894252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:51.900891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.921595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1806/3636] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:51.925847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.931561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:51.940991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cc805-796f-417b-91dc-c00aa337399d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:51.946680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:51.947611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:51.948013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:51.948387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:51.949175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:51.950918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc135ad-13a6-4afc-94b8-98af1727bc98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:51.972694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1831/3637] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:51.977018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:51.996020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9bd2-38fb-40cc-bbde-1d9df27bfe60 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:52.001409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:52.002466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:52.002902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:52.003369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] PATH_INFO: `/v3/projects/07385b489b9140dc89df96c1f3edf670/users/ab81cb775afb4c4a9da03d28e6a0e155/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:52.007198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:52.035166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07385b489b9140dc89df96c1f3edf670, user_id=ab81cb775afb4c4a9da03d28e6a0e155, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:52.037968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f49db-8983-420a-8250-975a1b242dd8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:52.075558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:52.075940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:52.076220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:52.076969 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1807/3638] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:51 2022] PUT /identity/v3/projects/07385b489b9140dc89df96c1f3edf670/users/ab81cb775afb4c4a9da03d28e6a0e155/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:52.123419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] MFA Rules not processed for user `ab81cb775afb4c4a9da03d28e6a0e155`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:52.125782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:52.306264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1832/3639] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:52.310173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d222-7acd-4c9d-9adf-273228820006 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:52.310691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d222-7acd-4c9d-9adf-273228820006 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:52.311093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d222-7acd-4c9d-9adf-273228820006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:52.340214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3ce8d222-7acd-4c9d-9adf-273228820006 None None] MFA Rules not processed for user `ab81cb775afb4c4a9da03d28e6a0e155`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:52.341638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3ce8d222-7acd-4c9d-9adf-273228820006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:52.350082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1808/3640] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:52.364509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:52.366245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:52.481462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe42b-5076-49ca-b954-f38a9a0a3781 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:52.489059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6b806-112b-4722-af88-55a248580556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:52.490276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b806-112b-4722-af88-55a248580556 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:52.490653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b806-112b-4722-af88-55a248580556 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:52.491158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b806-112b-4722-af88-55a248580556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:52.504121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b806-112b-4722-af88-55a248580556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:52.506019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b806-112b-4722-af88-55a248580556 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:52.518180 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1833/3641] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:55.859915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:55.860472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:55.860695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:55.911355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] MFA Rules not processed for user `67ece33b583c4baeb46ac278aa60ae4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:55.912596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:56.138509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1809/3642] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:56.150592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:56.151788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:56.152216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:56.189438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] MFA Rules not processed for user `67ece33b583c4baeb46ac278aa60ae4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:56.193267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:56.206069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1834/3643] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:56.220691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:56.240845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcef24-467f-4bb8-821e-f923067db962 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:56.249403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:56.250390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:56.250854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:56.251322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:56.262405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:56.264749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a408c-49d8-456c-99f4-417f8c8e79c9 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:56.290293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1810/3644] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:56.652049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:56.653838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:56.730829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330052e-7cfb-4ef5-9c41-33c3492808ec None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:56.739612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:56.741292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:56.741879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:56.742987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] PATH_INFO: `/v3/users/72141a19aa484ad9b466792ab782ec52` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:56.745209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72141a19aa484ad9b466792ab782ec52)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:56.747826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:56.750275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:56.820890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72141a19aa484ad9b466792ab782ec52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:56.822069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72141a19aa484ad9b466792ab782ec52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:56.832395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72141a19aa484ad9b466792ab782ec52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:56.842934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72141a19aa484ad9b466792ab782ec52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:56.844779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72141a19aa484ad9b466792ab782ec52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:56.885464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:56.887349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:56.887880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:56.892219 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1835/3645] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:56 2022] DELETE /identity/v3/users/72141a19aa484ad9b466792ab782ec52 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:56.920474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:56.922426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:57.108277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1811/3646] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:57.133478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:57.136687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:57.282712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499187c-3eca-4cc4-b040-42815d37dc21 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:57.286576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:57.287342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:57.287624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:57.287896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:57.302105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:57.303618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:57.316146 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1836/3647] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:02:58.502462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:58.505061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:58.559704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3398a10-d875-4182-b804-a65fd0cecc9c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:58.565411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:58.567934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:58.568748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:58.570210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] PATH_INFO: `/v3/projects/2414b143e25042a19c8645b96235f985` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:58.574487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2414b143e25042a19c8645b96235f985)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:58.579380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:58.731756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2414b143e25042a19c8645b96235f985', 'request_id': 'req-31b395f3-cb70-42bf-8ca6-c2da1814e324'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:58.735751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:58.750562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2414b143e25042a19c8645b96235f985', 'request_id': 'req-31b395f3-cb70-42bf-8ca6-c2da1814e324'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:58.809612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2414b143e25042a19c8645b96235f985', 'request_id': 'req-31b395f3-cb70-42bf-8ca6-c2da1814e324'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:58.852221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] The token cache is being invalidate because project 2414b143e25042a19c8645b96235f985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:58.852512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:58.857570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-31b395f3-cb70-42bf-8ca6-c2da1814e324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:58.860042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1812/3648] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:58 2022] DELETE /identity/v3/projects/2414b143e25042a19c8645b96235f985 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:58.863868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:58.877777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381013-59b7-4451-975c-aad9b5a21d71 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:59.073143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:59.073840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:59.074129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:59.074411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] PATH_INFO: `/v3/users/74e67ddfae1b4df1b5639dc36114363f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:59.078823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e67ddfae1b4df1b5639dc36114363f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:59.086175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:59.186986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:59.256364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e67ddfae1b4df1b5639dc36114363f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:59.259507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e67ddfae1b4df1b5639dc36114363f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:59.281527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e67ddfae1b4df1b5639dc36114363f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:59.302046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e67ddfae1b4df1b5639dc36114363f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:59.304991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e67ddfae1b4df1b5639dc36114363f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:59.370630 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1837/3649] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:58 2022] DELETE /identity/v3/users/74e67ddfae1b4df1b5639dc36114363f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:00.815075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c88c7-7582-4d89-9ceb-ba7f4842788e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:00.816026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c88c7-7582-4d89-9ceb-ba7f4842788e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:00.816491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c88c7-7582-4d89-9ceb-ba7f4842788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:00.875900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-159c88c7-7582-4d89-9ceb-ba7f4842788e None None] MFA Rules not processed for user `f864f72343c84ff4a54ef0467bf34c04`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:00.889423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-159c88c7-7582-4d89-9ceb-ba7f4842788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:01.062738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1813/3650] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:02.153670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:02.155758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:02.353266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bc762-45c1-4c9e-82c8-7d8c27237e4a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:02.363980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:02.364635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:02.364924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:02.365248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] PATH_INFO: `/v3/projects/bb617425eab747a88959c48904f0bec4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:02.369753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb617425eab747a88959c48904f0bec4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:02.387913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:02.510466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb617425eab747a88959c48904f0bec4', 'request_id': 'req-717a4f02-1087-4bf6-9830-b45ed2d66855'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:02.536994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb617425eab747a88959c48904f0bec4', 'request_id': 'req-717a4f02-1087-4bf6-9830-b45ed2d66855'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:02.558754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb617425eab747a88959c48904f0bec4', 'request_id': 'req-717a4f02-1087-4bf6-9830-b45ed2d66855'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:02.612580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] The token cache is being invalidate because project bb617425eab747a88959c48904f0bec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:03:02.612882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:02.623454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-717a4f02-1087-4bf6-9830-b45ed2d66855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:02.626411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1838/3651] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:02 2022] DELETE /identity/v3/projects/bb617425eab747a88959c48904f0bec4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:02.631557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:02.636728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:02.637183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:02.671557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:02.673054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:02.810359 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1814/3652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:02.819041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:02.819518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:02.821258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:02.852249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:02.854732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:02.873334 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1839/3653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:03:02.874636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:02.888839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60145b50-caa9-432d-a187-a39c15bf4194 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:02.894250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:02.894876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:02.895158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:02.895432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:02.896270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:03:02.896576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:02.898329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:02.913166 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1815/3654] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:03:02.917417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:02.928149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaeb2a-cb0b-4b4c-ac7c-845c78a5ade0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:02.935742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:02.937019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:02.937505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:02.937931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:02.938778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:02.941358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.004800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1840/3655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:03:02 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:03:03.009768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:03.025015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2ea4-dca3-4ac2-8bb8-002a22634d88 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:03.189019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:03.189799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.190166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.190480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.191918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:03.201054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.235602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:03.246304 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1816/3656] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:03:03 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:03:03.250292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:03.257775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:03.267312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3e61-4407-4c26-a225-7c716548c262 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:03.276306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:03.277483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.277974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.278856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.279748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:03.283311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.303904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1841/3657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:03.308459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:03.323326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6050-7916-4934-8992-7d1d6adfcbc8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:03.332696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:03.356183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.356183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.356183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.358949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:03.361744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c045a4d-49fa-4544-b65f-cdbfc6fa6b76 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.395753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1817/3658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:03:03.396261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:03.433406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bee87-f9ba-4d5d-9788-94e3c31ffb3a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:03.442114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:03.442800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.443590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.443590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] PATH_INFO: `/v3/projects/cd6225eaaa5f4d4db1afcb9c6ffeeb3a/users/90aefa22b02749e8a6b03d16378a0a6c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.472791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6225eaaa5f4d4db1afcb9c6ffeeb3a, user_id=90aefa22b02749e8a6b03d16378a0a6c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:03.476967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.500847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1842/3659] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:03:03 2022] PUT /identity/v3/projects/cd6225eaaa5f4d4db1afcb9c6ffeeb3a/users/90aefa22b02749e8a6b03d16378a0a6c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:03:03.503364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddda38-4f05-4630-bcba-e9588b317c3f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.503947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddda38-4f05-4630-bcba-e9588b317c3f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.504245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddda38-4f05-4630-bcba-e9588b317c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.542854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d4ddda38-4f05-4630-bcba-e9588b317c3f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:03.544109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d4ddda38-4f05-4630-bcba-e9588b317c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:03.640199 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1818/3660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:03.678140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:03.680028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:03.765341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833b270-f283-4294-a412-11186d2970dd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:03.770160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:03.770943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:03.771358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:03.771757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:03.800924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:03.802875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f115c1-993c-40f3-a967-cbdc78cb5b65 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:03.838246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1843/3661] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:09.890622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:09.891113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:09.891278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:09.942790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:09.944542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:10.093704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1819/3662] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:10.094472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bad71-758a-432b-9b8e-69c3513c6c6b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:10.094924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bad71-758a-432b-9b8e-69c3513c6c6b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:10.094924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bad71-758a-432b-9b8e-69c3513c6c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:10.140126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-678bad71-758a-432b-9b8e-69c3513c6c6b None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:10.141689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-678bad71-758a-432b-9b8e-69c3513c6c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:10.160984 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1844/3663] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:10.363205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:10.364570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:10.476463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e871-d1e4-466d-8b98-3ee0d81bcbed None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:10.483122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:10.484242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:10.484811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:10.485568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:10.498233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:10.499807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f40b92-db85-4273-b420-c0a7505ac98c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:10.512613 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1820/3664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:16.858553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:16.859407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:16.859686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:16.907370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] MFA Rules not processed for user `7d34514faf454e7996cb87e2bc6847a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:16.909953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:16.996782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1845/3665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:17.007381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336dadd-0d7f-40be-9a7f-9d728fda4775 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:17.008431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336dadd-0d7f-40be-9a7f-9d728fda4775 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:17.008979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336dadd-0d7f-40be-9a7f-9d728fda4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:17.021715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:17.041844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4336dadd-0d7f-40be-9a7f-9d728fda4775 None None] MFA Rules not processed for user `7d34514faf454e7996cb87e2bc6847a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:17.044614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4336dadd-0d7f-40be-9a7f-9d728fda4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:17.057353 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1821/3666] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:17.068310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:17.070068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:17.093893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761ddc7-ed3b-46ea-b830-0e5f44829d4d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:17.110635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:17.113174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:17.113790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:17.114339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:17.129116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:17.131650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccb7e7-1743-4eee-a843-354713ff2bba service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:17.145544 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1846/3667] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:17 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:17.541055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:17.541346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:17.541624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:17.608213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:17.612757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:17.765061 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1822/3668] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:17.765315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07298e6d-af81-412f-b6e9-622b9df6625a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:17.765958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07298e6d-af81-412f-b6e9-622b9df6625a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:17.766368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07298e6d-af81-412f-b6e9-622b9df6625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:17.791148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-07298e6d-af81-412f-b6e9-622b9df6625a None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:17.793920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07298e6d-af81-412f-b6e9-622b9df6625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:17.814541 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1847/3669] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:18.278895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:18.302982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e5966-3235-4e43-aa1f-595b4f2ae5e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:18.318460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:18.319297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:18.319639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:18.320499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:18.346466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:18.350260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:18.380175 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1823/3670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:25.403966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31e19-f082-44af-815c-e22b0ae8d7b6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:25.404455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31e19-f082-44af-815c-e22b0ae8d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:25.404537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31e19-f082-44af-815c-e22b0ae8d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:25.424864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-97c31e19-f082-44af-815c-e22b0ae8d7b6 None None] MFA Rules not processed for user `28313b7c89184dd683e3479d23be489d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:25.426117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-97c31e19-f082-44af-815c-e22b0ae8d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:25.467380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:25.508985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1848/3671] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:26.413202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:26.415602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:26.527235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a60-4750-44e7-a952-14267b266ce0 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:26.534633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:26.535727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:26.536190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:26.536785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:26.539819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:26.557624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:26.559988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:26.587080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1824/3672] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:35.501244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:36.568147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=71 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:36.744841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:36.745448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:36.745757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:36.771226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:36.772949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:36.787662 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1849/3673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:38.919149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:38.920834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:38.944565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5bd65-8391-40fd-b823-c41c491b8d2b service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:38.954003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:38.955848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:38.956680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:38.957310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] PATH_INFO: `/v3/users/67ece33b583c4baeb46ac278aa60ae4f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:38.961282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ece33b583c4baeb46ac278aa60ae4f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:38.963920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.051074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ece33b583c4baeb46ac278aa60ae4f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.052026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ece33b583c4baeb46ac278aa60ae4f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.052405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ece33b583c4baeb46ac278aa60ae4f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.064254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ece33b583c4baeb46ac278aa60ae4f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.096424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7584a96b-ac4d-4d0b-9d96-60aa3f2a6810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ece33b583c4baeb46ac278aa60ae4f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.165273 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1825/3674] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:03:38 2022] DELETE /identity/v3/users/67ece33b583c4baeb46ac278aa60ae4f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:39.368041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.380507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798fc0-25ae-4b90-a098-4212df824f65 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:39.446300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:39.446932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.447204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.447492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] PATH_INFO: `/v3/projects/74485b211f854132b59f02e4decdf998` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.448672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74485b211f854132b59f02e4decdf998)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:39.450810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.517900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74485b211f854132b59f02e4decdf998', 'request_id': 'req-0d4577f8-1b0c-4297-844a-78c092468fc3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.525555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74485b211f854132b59f02e4decdf998', 'request_id': 'req-0d4577f8-1b0c-4297-844a-78c092468fc3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.535702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74485b211f854132b59f02e4decdf998', 'request_id': 'req-0d4577f8-1b0c-4297-844a-78c092468fc3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.548599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] The token cache is being invalidate because project 74485b211f854132b59f02e4decdf998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:03:39.548892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.549572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d4577f8-1b0c-4297-844a-78c092468fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:39.551464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1850/3675] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:39 2022] DELETE /identity/v3/projects/74485b211f854132b59f02e4decdf998 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:03:39.556625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827812f-db96-4115-8010-69f8b3991523 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.556955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827812f-db96-4115-8010-69f8b3991523 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.557207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827812f-db96-4115-8010-69f8b3991523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.588819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c827812f-db96-4115-8010-69f8b3991523 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:39.590176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c827812f-db96-4115-8010-69f8b3991523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:39.668259 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1826/3676] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:39.677318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.677606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.677875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.699796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:39.701077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:39.709584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1851/3677] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:39.714433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827812f-db96-4115-8010-69f8b3991523 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.724442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827812f-db96-4115-8010-69f8b3991523 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:39.730177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:39.730795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.731066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.731335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.731981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:03:39.732273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:39.733881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.747221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1827/3678] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:03:39.751616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.762337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68bf5f-b83b-4080-9412-45a855b3389e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:39.767362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:39.768053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.768270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.768536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.769192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:39.771324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.810839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1852/3679] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:03:39 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:03:39.811624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.823076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6c35-f541-44e9-888a-46714f3dc386 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:39.901634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:39.902278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.902666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.903038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.903912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:39.906052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.915273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:39.932307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1828/3680] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:03:39 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:03:39.936707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.950628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97476b9e-861e-4e99-8836-0bf65c62d4b4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:39.955913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:39.956413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:39.956688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:39.956980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:39.957618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:39.968738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:39.980509 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1853/3681] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:39.985431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:39.997325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398d1a-805d-4604-ab1b-9fdb87150fa6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:40.002968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:40.003908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.004258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.004600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.005437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:40.008295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba225-7593-4c6f-bb35-f857a7e7b882 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:40.020878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1829/3682] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:40.026914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:40.043946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5020d4d-bb0a-4fd3-82a9-cfb912706b41 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:40.053012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:40.053729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.054435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.054753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] PATH_INFO: `/v3/projects/2e1adf828480437ea6595561c912d9bf/users/b125e9d6136447169f052690eeaab064/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.076139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1adf828480437ea6595561c912d9bf, user_id=b125e9d6136447169f052690eeaab064, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:40.080005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:40.114673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1854/3683] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:03:40 2022] PUT /identity/v3/projects/2e1adf828480437ea6595561c912d9bf/users/b125e9d6136447169f052690eeaab064/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:40.117012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.117301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.117580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.152350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:40.153894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:40.255022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:40.258007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:40.273018 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1830/3684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:40.290259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:40.292158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:40.305864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:40.398871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b36-eea1-4cdd-a65c-c5741bed2fc6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:40.407713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:40.408933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.409798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.412417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] PATH_INFO: `/v3/users/ab81cb775afb4c4a9da03d28e6a0e155` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.414395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab81cb775afb4c4a9da03d28e6a0e155)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:40.419468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:40.454890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8860a97-278e-436e-b5ce-723a68e44e74 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:40.461897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:40.462521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.463413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.463413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.478153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:40.479752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19375a24-fb05-4ebb-b31b-270d0c85d236 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:40.502663 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1831/3685] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:40.505397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab81cb775afb4c4a9da03d28e6a0e155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:40.506448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab81cb775afb4c4a9da03d28e6a0e155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:40.520819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab81cb775afb4c4a9da03d28e6a0e155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:40.540625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab81cb775afb4c4a9da03d28e6a0e155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:40.541892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab81cb775afb4c4a9da03d28e6a0e155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:40.570462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.570748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.571701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.574249 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1855/3686] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:03:40 2022] DELETE /identity/v3/users/ab81cb775afb4c4a9da03d28e6a0e155 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:40.594848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:40.596181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:40.726509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1832/3687] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:40.752796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:40.754583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:40.838773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34f70-6b68-479b-9a96-77f3cc2d8a21 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:40.843629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:40.844051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:40.844392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:40.844746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:40.857213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:40.858779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794464b-da83-4965-95a2-473159c34578 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:40.870970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1856/3688] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:03:41.474599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:41.476111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:41.504342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0285b8-fbfb-43a6-8de2-cba68c52f3e2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:41.517721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:41.518554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:41.518970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:41.519236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] PATH_INFO: `/v3/projects/07385b489b9140dc89df96c1f3edf670` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:41.521239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07385b489b9140dc89df96c1f3edf670)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:41.524133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:41.548770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:41.606567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07385b489b9140dc89df96c1f3edf670', 'request_id': 'req-5f820546-b741-4865-92c8-e8e5ca704f55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:41.613780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07385b489b9140dc89df96c1f3edf670', 'request_id': 'req-5f820546-b741-4865-92c8-e8e5ca704f55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:41.624800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07385b489b9140dc89df96c1f3edf670', 'request_id': 'req-5f820546-b741-4865-92c8-e8e5ca704f55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:41.647304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] The token cache is being invalidate because project 07385b489b9140dc89df96c1f3edf670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:03:41.647600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:41.648834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5f820546-b741-4865-92c8-e8e5ca704f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:41.653742 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1833/3689] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:41 2022] DELETE /identity/v3/projects/07385b489b9140dc89df96c1f3edf670 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:41.656142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:41.656617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:41.656761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:41.677615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:41.679027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:41.735013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:41.774298 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1857/3690] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:41.775962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:41.776309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:41.776642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:41.798155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:41.799796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:41.815255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1834/3691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:03:41.822212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:41.833526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77285-a49e-4651-8aec-03ec93f2cb7c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:41.840401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:41.841060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:41.841484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:41.841762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:41.849990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:03:41.850672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:41.853557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:41.892867 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1858/3692] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:03:41.897949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:41.912164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8fac-8bed-40e4-a2a4-b0cbc323afa8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:41.921019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:41.922429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:41.922816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:41.923238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:41.924148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:41.926870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:41.984705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1835/3693] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:03:41 2022] POST /identity/v3/projects => generated 405 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:03:41.988956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:42.001171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791efbd2-87d5-4330-98cb-b9a38613db5e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:42.144703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:42.145937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.146431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.146789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.147673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:42.149857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:42.188763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:42.189002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1859/3694] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:03:41 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:03:42.200773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da26e6b-0af4-4f23-8b89-59c65e159687 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:42.205842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:42.206456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.206729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.207305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.208150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:42.210167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:42.223771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1836/3695] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:03:42.228114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:42.246896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d18f-3eeb-47ea-93f7-dcced10e6f1b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:42.252804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:42.253921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.254431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.254901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.255795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:42.258544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2749b-39af-4646-9a5b-3bf9074d0139 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:42.273956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1860/3696] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:42.277944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:42.296021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa9dd-c799-4d70-8b7b-6ff9b2587700 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:42.303820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:42.306547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.307198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.309254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] PATH_INFO: `/v3/projects/478a5b85b2154eae946434f0de92780e/users/d1aa2ecfe6334fdeb302c761dd404d2d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.332496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=478a5b85b2154eae946434f0de92780e, user_id=d1aa2ecfe6334fdeb302c761dd404d2d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:42.338400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:42.365090 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1837/3697] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:03:42 2022] PUT /identity/v3/projects/478a5b85b2154eae946434f0de92780e/users/d1aa2ecfe6334fdeb302c761dd404d2d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:42.370923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0166ffd-6832-4f0e-935c-83713f63afac None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.370923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0166ffd-6832-4f0e-935c-83713f63afac None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.371484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0166ffd-6832-4f0e-935c-83713f63afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.395292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e0166ffd-6832-4f0e-935c-83713f63afac None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:42.396756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0166ffd-6832-4f0e-935c-83713f63afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:42.508433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1861/3698] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:42.520130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:42.523997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:42.623632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ac0c-1d50-403c-a34e-01d82230b63b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:42.628189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:42.628815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:42.629550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:42.629829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:42.643360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:42.644669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e3069-abf1-4ae2-a9ea-f1621d07edd6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:42.688287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1838/3699] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:03:48.912511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:48.913137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:48.913229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:48.982435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] MFA Rules not processed for user `b125e9d6136447169f052690eeaab064`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:48.986114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:49.093539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:49.140374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1862/3700] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:49.150619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:49.151174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:49.151174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:49.195187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:49.200763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:49.279479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:49.281261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:49.314039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:49.381126 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1839/3701] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:03:49.444001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87f6c-1b76-43db-9cf2-027a48f67093 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:49.450967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:49.451580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:49.451862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:49.452130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:49.456549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:49.458020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:49.462410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:49.464276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce927504-8feb-48fb-acdc-1b5a29dedf18 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:49.480043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1863/3702] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:03:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:03:49.591170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dbdc8-36a0-4eb2-a962-a023868979b9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:49.597425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:49.598069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:49.598345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:49.598616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:49.608629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:49.611113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dde84c-9aed-405b-a38a-e1fe25acdf11 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:49.623176 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1840/3703] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:03:55.542193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:55.543268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:55.543855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:55.603455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] MFA Rules not processed for user `b125e9d6136447169f052690eeaab064`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:55.604896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:55.653705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1864/3704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:58.874745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:58.883109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:58.883883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:58.957224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] MFA Rules not processed for user `d1aa2ecfe6334fdeb302c761dd404d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:03:58.958767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:59.143769 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1841/3705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:03:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:59.144555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:59.169235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae95e-1040-45ee-b2e0-bb3e1869d6ae None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:59.184148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:59.187153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:59.187935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:59.193268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:59.194483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:59.201437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:59.273333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:59.286962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1865/3706] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:03:59 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:03:59.291068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366d3d5-e117-4950-a214-8df0ca48d3b5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:59.438827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:59.441210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:59.442009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:59.443204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:59.445428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:59.451073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:59.518462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:59.535105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1842/3707] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:03:59 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:03:59.539470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:59.571627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b5e8a-e3c7-4daf-a041-733787105ce4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:59.586529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:59.586529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:59.586529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:59.586529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:59.587043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:59.588393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:59.612221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:59.612469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1866/3708] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:59.624530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fd9d-63b2-42a7-8244-3c231efa386f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:59.640148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:59.640789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:59.645869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:59.646186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:59.646877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:59.662056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:59.688714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1843/3709] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:03:59.690024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:59.707684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359afa5-1ce6-4a09-97fc-9289ba8f06fd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:59.718040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:59.718856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:59.719417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:59.719698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] PATH_INFO: `/v3/projects/67ae6c8347d44182b83f7fd0d69eb786/users/90339f9db1484706836ed509927a209e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:59.771077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ae6c8347d44182b83f7fd0d69eb786, user_id=90339f9db1484706836ed509927a209e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:59.774557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:59.803556 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1867/3710] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:03:59 2022] PUT /identity/v3/projects/67ae6c8347d44182b83f7fd0d69eb786/users/90339f9db1484706836ed509927a209e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:06.040573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:06.046650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:06.071379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154a91-df51-45b2-a519-e9897b175c6e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:06.255056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:06.255727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:06.256052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:06.256283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] PATH_INFO: `/v3/users/28313b7c89184dd683e3479d23be489d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:06.259852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28313b7c89184dd683e3479d23be489d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:06.265555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:06.381171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28313b7c89184dd683e3479d23be489d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:06.381976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28313b7c89184dd683e3479d23be489d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:06.390238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28313b7c89184dd683e3479d23be489d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:06.404697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28313b7c89184dd683e3479d23be489d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:06.420845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cb9e731a-0425-4550-ba4e-ff7e569e0526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28313b7c89184dd683e3479d23be489d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:06.501370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1844/3711] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:06 2022] DELETE /identity/v3/users/28313b7c89184dd683e3479d23be489d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:06.995541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:06.997479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:07.020693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a611d85-f432-4ec8-a962-df45049f5295 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:07.178245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:07.179236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:07.179672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:07.180097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] PATH_INFO: `/v3/projects/3be0ab02a95a48628dd5f9f1ac2f4596` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:07.202601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be0ab02a95a48628dd5f9f1ac2f4596)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:07.210094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:07.214138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:07.396130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be0ab02a95a48628dd5f9f1ac2f4596', 'request_id': 'req-8abf3806-0690-4c27-aedd-773ce532898e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:07.413240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be0ab02a95a48628dd5f9f1ac2f4596', 'request_id': 'req-8abf3806-0690-4c27-aedd-773ce532898e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:07.429207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be0ab02a95a48628dd5f9f1ac2f4596', 'request_id': 'req-8abf3806-0690-4c27-aedd-773ce532898e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:07.450632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] The token cache is being invalidate because project 3be0ab02a95a48628dd5f9f1ac2f4596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:07.453549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:07.454424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8abf3806-0690-4c27-aedd-773ce532898e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:07.468130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1868/3712] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:06 2022] DELETE /identity/v3/projects/3be0ab02a95a48628dd5f9f1ac2f4596 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:07.471024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:07.471539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:07.472137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:07.557587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:07.568665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:07.869070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1845/3713] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:07.877769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:07.878057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:07.878311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:07.938266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:07.939437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:07.982581 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1869/3714] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:07.994542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.016420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1f43b-fe3d-4358-94c9-e5bb42707c3a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.042479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.043113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.043372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.045038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.045643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:04:08.045955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.047680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.049486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:08.093300 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1846/3715] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:04:08.095962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.110034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275027-b2ed-451c-b963-2e9e8029585e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.125549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.126181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.126459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.126728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.135924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.145535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.220044 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1870/3716] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:04:08 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:08.224351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.238775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e11d0-5d5c-4a95-89f0-df5c27e1376b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.416092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.416734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.417070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.417321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.417961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.419920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.460796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1847/3717] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:04:08 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:08.465061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.481980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0e45-2a43-412f-bcb6-5723cfe91352 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.495585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.496514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.497094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.497574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.498228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.501577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.530335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1871/3718] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:08.532718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.559766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd258-34ef-4353-9169-ce409588a773 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.572335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.573182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.573630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.574051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.574852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.576613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a425a-bf72-4468-a4f9-500e4a1db4eb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.613278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1848/3719] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:04:08.614439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:08.630143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb76e9-7f50-4ec9-bc89-168f5611ab6d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:08.649572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:08.663020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.663348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.663629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] PATH_INFO: `/v3/projects/6bbc01e308ae49a3b71a6483021afeaa/users/f19af7f3e233433db9a4812fe34f458e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.713607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbc01e308ae49a3b71a6483021afeaa, user_id=f19af7f3e233433db9a4812fe34f458e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:08.716208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:08.770297 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1872/3720] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:08 2022] PUT /identity/v3/projects/6bbc01e308ae49a3b71a6483021afeaa/users/f19af7f3e233433db9a4812fe34f458e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:08.772058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:08.772575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:08.772871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:08.825008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:08.826336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:09.025069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1849/3721] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:09.031982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:09.036725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:09.267426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab8c0-9537-4348-a9a5-74468986b2e6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:09.295686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:09.299433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:09.299802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:09.301949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:09.348896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:09.355485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b36096-0900-4537-8d2d-2200c62a7226 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:09.415999 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1873/3722] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:09.511583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:09.513254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:09.755067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca7ace-5196-48cd-8afb-8926bf236b8d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:09.775130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:09.775776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:09.776055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:09.776330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:09.784603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:09.824455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:09.826029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b251f4-8dca-4aad-9fe4-8adb64e2749f service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:09.882558 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1850/3723] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:17.911924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adf1f-d08b-446d-aad8-7fe30abe5510 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:17.912877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adf1f-d08b-446d-aad8-7fe30abe5510 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:17.913495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adf1f-d08b-446d-aad8-7fe30abe5510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:17.970731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1e2adf1f-d08b-446d-aad8-7fe30abe5510 None None] MFA Rules not processed for user `90339f9db1484706836ed509927a209e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:17.972367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e2adf1f-d08b-446d-aad8-7fe30abe5510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.039021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:18.215774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1874/3724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:18.216436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:18.216892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:18.217021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:18.225463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:18.269005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] MFA Rules not processed for user `d1aa2ecfe6334fdeb302c761dd404d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:18.270238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.398079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:18.398358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:18.398648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:18.450979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:18.452135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1851/3725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:18.452277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.453526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:18.455085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.675777 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1875/3726] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:04:18.676920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:18.678855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.698216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2905-1295-4407-beb1-aaa01b0c2b48 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:18.707216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:18.707966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:18.708083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:18.708365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:18.711076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:18.743620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:18.745472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bf41-5c94-4b4a-a256-3e5b766a82db service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:18.769592 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1852/3727] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:18 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:18.926981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa642-adb2-4d64-86ca-d35e1c4a419d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:18.954893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:18.955758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:18.956188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:18.956528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:18.985924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:18.988493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca51402-b605-4960-bd89-305b4d825b1b service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:19.013235 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1876/3728] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:20.037474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6eb2-bd7b-46c4-ad35-4620ac9ec2ba None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:20.038886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6eb2-bd7b-46c4-ad35-4620ac9ec2ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:20.039183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6eb2-bd7b-46c4-ad35-4620ac9ec2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:20.080434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c43f6eb2-bd7b-46c4-ad35-4620ac9ec2ba None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:20.086042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c43f6eb2-bd7b-46c4-ad35-4620ac9ec2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:20.229363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1853/3729] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:28.398691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.401950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.402886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.490577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] MFA Rules not processed for user `f19af7f3e233433db9a4812fe34f458e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:28.493271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:28.560620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:28.625339 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1877/3730] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:28.636952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.637898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.638426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.670269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] MFA Rules not processed for user `f19af7f3e233433db9a4812fe34f458e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:28.672047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:28.691975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1854/3731] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:28.699366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:28.723967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf402-4a17-432b-8609-65e4e0f89f52 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:28.767588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:28.771052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.771439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.774315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.804196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:28.807555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:28.847535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1878/3732] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:32.319472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:32.321545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:32.347528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982af41-4c40-49b8-9d0c-cad0c057ac03 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:32.353837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:32.354961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:32.360250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:32.360984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] PATH_INFO: `/v3/users/7d34514faf454e7996cb87e2bc6847a2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:32.362789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d34514faf454e7996cb87e2bc6847a2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:32.366042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:32.450240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:32.493143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d34514faf454e7996cb87e2bc6847a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:32.495139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d34514faf454e7996cb87e2bc6847a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:32.495996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d34514faf454e7996cb87e2bc6847a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:32.520533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d34514faf454e7996cb87e2bc6847a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:32.549074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-df6a0f31-ad6e-4185-95f8-c525795fa6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d34514faf454e7996cb87e2bc6847a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:32.593354 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1855/3733] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:32 2022] DELETE /identity/v3/users/7d34514faf454e7996cb87e2bc6847a2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:33.589435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:33.605850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0b8fb-f309-4ba6-bbd1-630893e8dd98 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:33.735244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:33.735903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:33.736180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:33.736474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] PATH_INFO: `/v3/projects/cb09627a84e44334b45c8828d00f255a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:33.741144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb09627a84e44334b45c8828d00f255a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:33.763564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:33.911461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb09627a84e44334b45c8828d00f255a', 'request_id': 'req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:33.929734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb09627a84e44334b45c8828d00f255a', 'request_id': 'req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:33.946516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb09627a84e44334b45c8828d00f255a', 'request_id': 'req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:33.972291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] The token cache is being invalidate because project cb09627a84e44334b45c8828d00f255a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:33.972968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:33.974002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57a58cf1-7a01-43dd-bdde-d6d8ac19cf9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:33.976616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1879/3734] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:33 2022] DELETE /identity/v3/projects/cb09627a84e44334b45c8828d00f255a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:33.981543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:33.982732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:33.983285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.040880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:34.042121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:34.176782 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1856/3735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:34.188640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.188971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.189218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.213304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:34.214875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:34.227135 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1880/3736] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:34.231162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.245552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a77fd9-6b8c-4075-838f-2cfeaa8d10f7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.253395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.254247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.254697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.255106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.255985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:04:34.257464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.260009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.287522 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1857/3737] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:04:34.292361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.306734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece516f-ea8d-402a-872d-41e73c7478e6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.315067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.315743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.316024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.316295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.317243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.319223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.396853 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1881/3738] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:04:34 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:34.401707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.422516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244d93-b890-4929-bc23-15f7f7d086b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.512073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.513181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.513684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.514172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.518493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.521975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.554078 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1858/3739] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:04:34 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:34.557791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.572815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd898-a49f-4a1c-aa88-66bd6a3c42d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.578214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.579291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.579638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.579979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.581284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.583766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.606564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1882/3740] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:34.609706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.622775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7afa-c229-4f85-9821-0de4418e67f8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.641208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.642008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.644009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.644305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.646077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.649463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484dcd-3819-4e28-87c4-7d28d2d558ad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.675097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1859/3741] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:34.680581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:34.697763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ed9c-49f8-4324-a9d2-a58201235725 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:34.708145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:34.709461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.709856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.710299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] PATH_INFO: `/v3/projects/24e6c82706674dd89e73ffdf04ac5ffd/users/904c635190724109b5e3d6742f3f17c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.736762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e6c82706674dd89e73ffdf04ac5ffd, user_id=904c635190724109b5e3d6742f3f17c1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:34.741609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:34.745199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:34.783154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1883/3742] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:34 2022] PUT /identity/v3/projects/24e6c82706674dd89e73ffdf04ac5ffd/users/904c635190724109b5e3d6742f3f17c1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:34.796523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:34.797524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:34.798082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:34.827950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:34.849184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] MFA Rules not processed for user `904c635190724109b5e3d6742f3f17c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:34.852036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:34.977877 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1860/3743] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:35.058922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:35.061529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:35.145923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:35.148627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:35.246961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba177-51f2-42d7-ac1b-dd38c80f5ece admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:35.255492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:35.257845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:35.258391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:35.258766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:35.270653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:35.272586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:35.288575 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1884/3744] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:35.308821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feb431-3d00-4298-8f7f-d9920aba1e74 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:35.329659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:35.330383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:35.330661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:35.331035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] PATH_INFO: `/v3/users/78e6fe2e79b54462b20619cf36ffadf0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:35.332351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e6fe2e79b54462b20619cf36ffadf0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:35.334677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:35.489486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e6fe2e79b54462b20619cf36ffadf0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:35.493082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e6fe2e79b54462b20619cf36ffadf0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:35.494823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e6fe2e79b54462b20619cf36ffadf0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:35.512105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e6fe2e79b54462b20619cf36ffadf0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:35.535796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f2e09bb0-138f-4a5f-abcd-356c5a66a828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e6fe2e79b54462b20619cf36ffadf0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:35.602430 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1861/3745] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:35 2022] DELETE /identity/v3/users/78e6fe2e79b54462b20619cf36ffadf0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:36.173312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:36.194960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb53e7-1697-43ae-9f7b-2f615a8578fc service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:36.300229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:36.300870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:36.301274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:36.302331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] PATH_INFO: `/v3/projects/2fc42ddeb5cd4170a5d01683e0605a87` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:36.303712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc42ddeb5cd4170a5d01683e0605a87)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:36.306302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:36.410255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc42ddeb5cd4170a5d01683e0605a87', 'request_id': 'req-8b53f052-950e-4f12-a749-6c2dc8978866'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:36.421395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc42ddeb5cd4170a5d01683e0605a87', 'request_id': 'req-8b53f052-950e-4f12-a749-6c2dc8978866'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:36.439150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc42ddeb5cd4170a5d01683e0605a87', 'request_id': 'req-8b53f052-950e-4f12-a749-6c2dc8978866'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:36.493689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] The token cache is being invalidate because project 2fc42ddeb5cd4170a5d01683e0605a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:36.494274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:36.496050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b53f052-950e-4f12-a749-6c2dc8978866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:36.498897 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1885/3746] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:36 2022] DELETE /identity/v3/projects/2fc42ddeb5cd4170a5d01683e0605a87 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:36.504466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:36.504971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:36.505262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:36.537077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:36.539006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:36.555701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:36.659897 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1862/3747] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:04:36.668045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:36.668550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:36.668836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:36.693477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:36.695482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:36.712732 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1886/3748] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:36.713319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:36.727167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5139f-c23b-4312-b434-d5f7f2068998 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:36.745730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:36.746417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:36.746739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:36.746981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:36.747711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:04:36.748017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:36.749738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:36.783977 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1863/3749] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:04:36.786309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:36.796582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:36.806265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4fd5-0f34-4290-a693-2527ad64397d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:36.819149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:36.820440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:36.821026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:36.821542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:36.822410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:36.826929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:36.946155 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1887/3750] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:04:36 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:36.950904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:36.970436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8dee-e7b9-4da0-a594-482e69c15ab0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:37.152024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:37.158728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.158936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.159516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.160889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:37.174238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:37.221272 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1864/3751] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:04:36 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:37.225272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.245875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590940c-44fa-4d71-8574-76c5652febe0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:37.260565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:37.261540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.262634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.262634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.264110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:37.278735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:37.305181 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1888/3752] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:04:37.309337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.337979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.338468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc91811-cb0a-49a5-be01-3cbfa59b3d4c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:37.350484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:37.356030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:37.357826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.359237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.359666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.362066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:37.368271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:37.375625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e2b7-0bb8-41d6-a88e-66659a300ef4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:37.385752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:37.386411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.386695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.386968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] PATH_INFO: `/v3/users/904c635190724109b5e3d6742f3f17c1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.388148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904c635190724109b5e3d6742f3f17c1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:37.389940 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1865/3753] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:04:37.390829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:37.394974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.423280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a733-9d5d-46d4-aff4-c50e67b10161 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:37.438065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:37.439404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.445161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.445357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] PATH_INFO: `/v3/projects/7db61a6ccbee4a298909d79faabc004d/users/45369fea2a654d1d88145db9677a53fb/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.468296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db61a6ccbee4a298909d79faabc004d, user_id=45369fea2a654d1d88145db9677a53fb, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:37.471528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857effd-3f36-4fab-8d14-8fdaee2a9e11 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:37.506756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1866/3754] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:37 2022] PUT /identity/v3/projects/7db61a6ccbee4a298909d79faabc004d/users/45369fea2a654d1d88145db9677a53fb/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:37.507413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904c635190724109b5e3d6742f3f17c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:37.507873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904c635190724109b5e3d6742f3f17c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:37.512568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.517409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.517682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.536416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904c635190724109b5e3d6742f3f17c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:37.559894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904c635190724109b5e3d6742f3f17c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:37.560988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17807335-51c8-4b20-87ba-a0e752d12fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904c635190724109b5e3d6742f3f17c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:37.599055 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1889/3755] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:37 2022] DELETE /identity/v3/users/904c635190724109b5e3d6742f3f17c1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:37.603862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:37.604494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:37.605015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:37.664420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:37.666611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:37.844442 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1890/3756] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:37.867941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.870745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:37.876318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:37.880989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:37.930062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1867/3757] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:37.940363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:37.943859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:37.989303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:38.018431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e9985-9d44-49d0-b626-2c9f087146ce None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:38.023705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:38.024603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:38.025128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:38.025642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:38.055730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:38.057228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:38.058344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6b2a-f63f-4bbd-a985-5593d47613d8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:38.063614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:38.064446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:38.064681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:38.065003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:38.067828 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1891/3758] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:38.076126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:38.079015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:38.080735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dd26-eea6-4b41-80c0-aa134a4dfb7b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:38.094203 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1868/3759] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:04:39.644871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:39.646475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:39.671332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0452a2-cbac-461c-8e6e-fb917988e0b4 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:39.679469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:39.680849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:39.703413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:39.704156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] PATH_INFO: `/v3/projects/24e6c82706674dd89e73ffdf04ac5ffd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:39.708129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e6c82706674dd89e73ffdf04ac5ffd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:39.721150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:39.832584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e6c82706674dd89e73ffdf04ac5ffd', 'request_id': 'req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:39.850403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e6c82706674dd89e73ffdf04ac5ffd', 'request_id': 'req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:39.868284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e6c82706674dd89e73ffdf04ac5ffd', 'request_id': 'req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:39.887190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] The token cache is being invalidate because project 24e6c82706674dd89e73ffdf04ac5ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:39.887517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:39.890379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d40ee01c-60ca-49de-8d37-8d7406dd6a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:39.895387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1892/3760] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:39 2022] DELETE /identity/v3/projects/24e6c82706674dd89e73ffdf04ac5ffd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:39.905837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:39.907268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:39.907906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:39.946386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:39.949587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:40.141096 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1869/3761] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:40.142555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.142555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.142909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.186710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:40.188044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:40.201804 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1893/3762] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:40.206121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.217324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5ae9d-50ad-4155-8fc2-8cf9255f91ca None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.227046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.227928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.228382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.228789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.233494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:04:40.233938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.238381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.268372 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1870/3763] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:04:40.280299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.308871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cd036-1cbe-441e-8414-e3ea46bef2f8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.314952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.315873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.317056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.317499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.318388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.332253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.396645 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1894/3764] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:04:40 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:40.397758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.409803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db03-8dbc-4671-a09e-c1bd8120753a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.577676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.578351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.578787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.579123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.579769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.581874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.612085 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1871/3765] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:04:40 2022] POST /identity/v3/users => generated 303 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:04:40.616108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.630108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332755e-167d-428c-99a9-a8e4068e0511 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.637367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.638328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.638862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.639526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.641491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.644189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.670422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1895/3766] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:40.673718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.696635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01982-3941-4149-9e9a-4eb3f40f1532 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.704403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.705382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.705903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.706553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.707435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.709484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446410-84a5-4187-9a7b-0384cce4f320 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.746709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1872/3767] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:40.750983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:40.763124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e859c-c2eb-41e5-856c-f42cfbeee495 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:40.768603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:40.769610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.770114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.770616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] PATH_INFO: `/v3/projects/464468c4eb514931ac21cf728e28fd50/users/0207c4170e35470385869f18e09828d0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.788046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=464468c4eb514931ac21cf728e28fd50, user_id=0207c4170e35470385869f18e09828d0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:40.791968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:40.812591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1896/3768] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:40 2022] PUT /identity/v3/projects/464468c4eb514931ac21cf728e28fd50/users/0207c4170e35470385869f18e09828d0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:40.817902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc62b4-97a3-40b7-9111-6c7f3a84056c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.818671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc62b4-97a3-40b7-9111-6c7f3a84056c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.819197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc62b4-97a3-40b7-9111-6c7f3a84056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.844096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-49fc62b4-97a3-40b7-9111-6c7f3a84056c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:40.846449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-49fc62b4-97a3-40b7-9111-6c7f3a84056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:40.994978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1873/3769] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:41.095303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:41.097462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:41.224247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c6c0-9a5e-4096-8c26-1b8b501e78ca admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:41.233778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:41.234672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:41.234954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:41.235224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:41.263415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:41.265115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:41.287143 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1897/3770] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:42.583376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:42.584549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:42.585627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:42.599409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:42.623608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:42.625089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:42.803020 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1874/3771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:45.247294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:45.249822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:45.268558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:45.430343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a84d3-a208-4501-8998-677c73bcd308 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:45.447276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:45.448254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:45.448818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:45.449316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:45.451623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:45.542460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:45.544154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ee934-fa47-48c3-8e71-104d04b9d696 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:45.557191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1898/3772] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:49.487803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:49.522359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c03cb-1c74-4859-a9bb-28e1d4418e20 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:49.530233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:49.531603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:49.532698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:49.533257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:49.537454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:49.654573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:49.660020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:49.674748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1875/3773] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:51.796682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:51.797313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:51.797313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:51.838909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] MFA Rules not processed for user `45369fea2a654d1d88145db9677a53fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:51.841145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:52.037150 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1899/3774] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:52.039132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.044037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:52.063843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337b0bc-8310-4e83-9988-794f4e16638b service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.071275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.072540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.072950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.073841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.074602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.076727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.140397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1876/3775] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:04:52.144284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.160580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeb2d-c050-496e-9e6f-0a28cfbd9687 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.224052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:52.274619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.275572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.276183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.276812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.277755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.279998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.334185 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1900/3776] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:04:52 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:04:52.338834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.366059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2940-0dc2-425d-8c70-dcadb634f608 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.385832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.389261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.389801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.390566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.392537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.397395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.429516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1877/3777] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:52.432704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.446424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed920-2b15-435f-99c4-ffb5af17b7a4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.452327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.453047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.453333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.453607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] PATH_INFO: `/v3/projects/4c42188ca4884c69a81f234374d78de3/users/2510d0928e5a4bd7bc40e8e2433b5072/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.473234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c42188ca4884c69a81f234374d78de3, user_id=2510d0928e5a4bd7bc40e8e2433b5072, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.476854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.502211 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1901/3778] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:52 2022] PUT /identity/v3/projects/4c42188ca4884c69a81f234374d78de3/users/2510d0928e5a4bd7bc40e8e2433b5072/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:52.507510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.551016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09263-d840-4e40-9106-76cc9b2f3ce6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.639530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.640400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.640677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.641031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.641659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.644116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767fc63-7fe6-4b7e-b516-8df57ac96219 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.659700 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1878/3779] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:04:52.663763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:52.675460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d6f1-ff1b-420f-ba83-19b742c0cec7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:52.682852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:52.683214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:52.683494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:52.683766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] PATH_INFO: `/v3/projects/4c42188ca4884c69a81f234374d78de3/users/2510d0928e5a4bd7bc40e8e2433b5072/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:52.685840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c42188ca4884c69a81f234374d78de3, user_id=2510d0928e5a4bd7bc40e8e2433b5072, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:52.689084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4967edf-cb0d-4952-a870-794a13f53285 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:52.709400 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1902/3780] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:04:52 2022] PUT /identity/v3/projects/4c42188ca4884c69a81f234374d78de3/users/2510d0928e5a4bd7bc40e8e2433b5072/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:53.495139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:53.495595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:53.495785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:53.553178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:53.559635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:53.576147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:53.672521 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1879/3781] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:58.378948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e0007-5b67-4a2e-a57a-e8cd704ada44 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:58.379464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e0007-5b67-4a2e-a57a-e8cd704ada44 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:58.380185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e0007-5b67-4a2e-a57a-e8cd704ada44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:58.423318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0b4e0007-5b67-4a2e-a57a-e8cd704ada44 None None] MFA Rules not processed for user `0207c4170e35470385869f18e09828d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:58.424885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b4e0007-5b67-4a2e-a57a-e8cd704ada44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:58.604684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1903/3782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:58.778475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:58.917465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9812-4d03-4e09-96cb-248e62929aa5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:58.958600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:58.959267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:58.959849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:58.961182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:58.982198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:58.983817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:59.023120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1880/3783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:58 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:05.856082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387593-3fa4-4fa4-ae90-8f28cbb9d91d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:05.856581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387593-3fa4-4fa4-ae90-8f28cbb9d91d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:05.856852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387593-3fa4-4fa4-ae90-8f28cbb9d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:05.905845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2387593-3fa4-4fa4-ae90-8f28cbb9d91d None None] MFA Rules not processed for user `2510d0928e5a4bd7bc40e8e2433b5072`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:05.907676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2387593-3fa4-4fa4-ae90-8f28cbb9d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:06.117840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1904/3784] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:06.124417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:06.126703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:06.291098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7da1-933a-4dff-9bff-fd4cf195ed90 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:06.304284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:06.306217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:06.307096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:06.310201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:06.497626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:06.513182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:06.514642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:06.535412 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1881/3785] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:11.256457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:11.260961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:11.261741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:11.269795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:11.292047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:11.294022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:11.444292 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1905/3786] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:11.469065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:11.474602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:11.642294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2783-e9c8-4ef1-b322-5db547d37b4e service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:11.657977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:11.658832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:11.659240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:11.659371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:11.689068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:11.691949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:11.706321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1882/3787] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:05:11.910029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:12.023489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe127-7a0c-4a81-b111-323694845bb5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:12.027437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:12.028071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:12.028399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:12.028705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:12.030616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:12.057265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:12.059895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:12.102202 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1906/3788] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:13.432099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:13.433606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:13.644674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a408-3a71-496a-9512-05eb4d6b96b7 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:13.657480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:13.657480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:13.657480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:13.657480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] PATH_INFO: `/v3/users/f19af7f3e233433db9a4812fe34f458e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:13.658155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19af7f3e233433db9a4812fe34f458e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:13.661564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:13.769553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19af7f3e233433db9a4812fe34f458e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:13.770271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19af7f3e233433db9a4812fe34f458e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:13.773561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19af7f3e233433db9a4812fe34f458e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:13.792628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19af7f3e233433db9a4812fe34f458e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:13.805910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19af7f3e233433db9a4812fe34f458e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:13.854944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1883/3789] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:13 2022] DELETE /identity/v3/users/f19af7f3e233433db9a4812fe34f458e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:14.557026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:14.573117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f9c86-44da-4153-a069-26ebea8bb27a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:14.840323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:14.841495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:14.844214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:14.844576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] PATH_INFO: `/v3/projects/6bbc01e308ae49a3b71a6483021afeaa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:14.849060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbc01e308ae49a3b71a6483021afeaa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:14.854475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:15.055408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbc01e308ae49a3b71a6483021afeaa', 'request_id': 'req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.060158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:15.070219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbc01e308ae49a3b71a6483021afeaa', 'request_id': 'req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.110271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbc01e308ae49a3b71a6483021afeaa', 'request_id': 'req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.121972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:15.123695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:15.153269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:15.160132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9e03-c30d-4722-a466-0ea8cb06d05f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:15.161708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] The token cache is being invalidate because project 6bbc01e308ae49a3b71a6483021afeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:15.161946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.163291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7776e560-8ae4-49d1-9a8f-174f6cc2cf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.166512 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1907/3790] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:14 2022] DELETE /identity/v3/projects/6bbc01e308ae49a3b71a6483021afeaa => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:15.176561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6cd-3da0-49df-a294-5b4143df9c58 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.177188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6cd-3da0-49df-a294-5b4143df9c58 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.179550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6cd-3da0-49df-a294-5b4143df9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.211144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-61d8f6cd-3da0-49df-a294-5b4143df9c58 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:15.212369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-61d8f6cd-3da0-49df-a294-5b4143df9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:15.305226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:15.307543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.307821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.308090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] PATH_INFO: `/v3/users/d1aa2ecfe6334fdeb302c761dd404d2d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.314904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1aa2ecfe6334fdeb302c761dd404d2d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:15.318790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:15.364469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1908/3791] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:05:15.372188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.372494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.372925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.429351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:15.430672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:15.476795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1aa2ecfe6334fdeb302c761dd404d2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.477884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1aa2ecfe6334fdeb302c761dd404d2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.478608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1aa2ecfe6334fdeb302c761dd404d2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.489140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1909/3792] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:15.495767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:15.502306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1aa2ecfe6334fdeb302c761dd404d2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.527587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1aa2ecfe6334fdeb302c761dd404d2d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:15.531621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef68b4-17ff-42fe-a207-5231ff90a726 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:15.548499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:15.550042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.550431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.550802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.551637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:05:15.552043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:15.556866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:15.615706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1910/3793] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:15.617900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:15.619901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:15.622825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1884/3794] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:15 2022] DELETE /identity/v3/users/d1aa2ecfe6334fdeb302c761dd404d2d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:05:15.638487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd1db-9423-49e0-a802-e01df59f374f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:15.768637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:15.770596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.771111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.772444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.773542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:15.778949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:15.855642 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1911/3795] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:05:15 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:15.858465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:15.875776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3759-fb16-4ba0-9d24-42788b77e9e2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.020092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.022134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:16.078461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.081405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.081780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.082629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.085929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.089674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.127168 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1885/3796] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:05:15 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:16.129273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.142183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:16.144323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c578b5-2dcd-4bb8-b023-6be3c3d5c1a5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.156315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.157057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.157688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.158069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.159244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.161643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.174185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:16.175694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2809-cca4-49c3-a285-7d06a601a2a3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.182488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.183411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.188234 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1886/3797] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:16.188700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.189545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] PATH_INFO: `/v3/projects/478a5b85b2154eae946434f0de92780e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.189868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.191245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478a5b85b2154eae946434f0de92780e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.193887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.221736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372d51-c328-4d40-9528-03cd17ec66b7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.238543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.238543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.238543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.244145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.246905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.250383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.279840 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1887/3798] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:16.283090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.298032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7728db-3ef1-4871-b039-e406d49dba3d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.300078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478a5b85b2154eae946434f0de92780e', 'request_id': 'req-3e3a0352-7000-47de-b349-1588967a5042'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.310808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478a5b85b2154eae946434f0de92780e', 'request_id': 'req-3e3a0352-7000-47de-b349-1588967a5042'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.331759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478a5b85b2154eae946434f0de92780e', 'request_id': 'req-3e3a0352-7000-47de-b349-1588967a5042'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.378954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] The token cache is being invalidate because project 478a5b85b2154eae946434f0de92780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:16.379249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.381326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.387149 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1912/3799] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:16 2022] DELETE /identity/v3/projects/478a5b85b2154eae946434f0de92780e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:05:16.388180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.395891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:16.420152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.421169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.424855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.425189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] PATH_INFO: `/v3/projects/cdec51986d2644d6a667908a6fa34da2/users/8c89b4a51ce649389bbff589d10e1585/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.452702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdec51986d2644d6a667908a6fa34da2, user_id=8c89b4a51ce649389bbff589d10e1585, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.457086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f765d23-f133-4da7-9482-2673ee06e832 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.518881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1888/3800] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:05:16 2022] PUT /identity/v3/projects/cdec51986d2644d6a667908a6fa34da2/users/8c89b4a51ce649389bbff589d10e1585/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:16.524991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.525294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.525668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.534255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a0352-7000-47de-b349-1588967a5042 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:16.567789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:16.569059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:16.654905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:16.655612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:16.655875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:16.656146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] PATH_INFO: `/v3/users/90339f9db1484706836ed509927a209e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:16.662175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90339f9db1484706836ed509927a209e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:16.665881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:16.719761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:16.731484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1889/3801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:16.734395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:16.738615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:16.763848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90339f9db1484706836ed509927a209e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.766207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90339f9db1484706836ed509927a209e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.784464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90339f9db1484706836ed509927a209e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.801525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90339f9db1484706836ed509927a209e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.803751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90339f9db1484706836ed509927a209e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:16.845900 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1913/3802] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:16 2022] DELETE /identity/v3/users/90339f9db1484706836ed509927a209e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:16.906457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad55ff-ee79-4010-a290-d4cf78b0b6fa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:17.004990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:17.049903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:17.050919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.051358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.051801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.054781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:17.221968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:17.226090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:17.229423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e799d8-a94e-4c14-aa9b-3676e4997f6b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:17.230746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:17.260859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1890/3803] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:17.304198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37affa67-6aba-4fe8-be9f-fcfc40439a98 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:17.328706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:17.329143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.329432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.329715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] PATH_INFO: `/v3/projects/67ae6c8347d44182b83f7fd0d69eb786` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.333852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ae6c8347d44182b83f7fd0d69eb786)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:17.337770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:17.472418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ae6c8347d44182b83f7fd0d69eb786', 'request_id': 'req-3b6e04fb-04fa-4387-8657-f6169a105f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:17.489155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ae6c8347d44182b83f7fd0d69eb786', 'request_id': 'req-3b6e04fb-04fa-4387-8657-f6169a105f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:17.519404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ae6c8347d44182b83f7fd0d69eb786', 'request_id': 'req-3b6e04fb-04fa-4387-8657-f6169a105f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:17.546270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] The token cache is being invalidate because project 67ae6c8347d44182b83f7fd0d69eb786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:17.546490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:17.552421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b6e04fb-04fa-4387-8657-f6169a105f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:17.557405 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1914/3804] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:17 2022] DELETE /identity/v3/projects/67ae6c8347d44182b83f7fd0d69eb786 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:05:17.562118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.562876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.563341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.617786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:17.619392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:17.714104 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1891/3805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:17.721799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.722372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.722372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.771840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:17.776054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:17.792031 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1915/3806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:17.796401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:17.807592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9b9ce-0b93-4ff0-8a5b-98bd89f6683e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:17.827794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:17.828216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.828337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.828513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.829204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:05:17.829509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:17.831126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:17.871684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1892/3807] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:17.877181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:17.895530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431e5ce-0ff3-4aba-bf1e-e3fd02ef46cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:17.908077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:17.911254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:17.911755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:17.913883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:17.919599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:17.932006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:18.015549 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1916/3808] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:05:17 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:05:18.019963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:18.045224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390bd0-c049-4887-9842-f67a1f0f7958 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:18.236639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:18.237338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:18.237554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:18.237824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:18.240583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:18.244668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:18.290681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:18.346767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:18.354399 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1893/3809] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:05:18 2022] POST /identity/v3/users => generated 282 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:18.378105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6efad-2311-4926-8807-e4cc474b88b5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:18.406351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:18.408120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:18.408411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:18.408687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:18.409375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:18.411981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:18.453945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1917/3810] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:05:18.456949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:18.479358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d02e-69e0-4b2e-b12d-8064646ea142 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:18.531592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:18.533850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:18.535656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:18.537530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:18.540322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:18.545014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad3792-1593-4a09-91fe-9e39454952e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:18.592938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1894/3811] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:18.595770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:18.628452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f47-2a9f-44c2-98dd-e94eb65269c2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:18.645398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:18.646093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:18.646372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:18.646643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6/users/1db8a85614994d2387f62cabf2b26fcc/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:18.701730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2064f7889d354c3f975786fbf4c90be6, user_id=1db8a85614994d2387f62cabf2b26fcc, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:18.704468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:18.755263 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1918/3812] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:05:18 2022] PUT /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6/users/1db8a85614994d2387f62cabf2b26fcc/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:18.766969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c85d2-6afc-4044-ba26-3626a499a5ee None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:18.767268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c85d2-6afc-4044-ba26-3626a499a5ee None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:18.767516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c85d2-6afc-4044-ba26-3626a499a5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:18.860833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-437c85d2-6afc-4044-ba26-3626a499a5ee None None] MFA Rules not processed for user `1db8a85614994d2387f62cabf2b26fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:18.864259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-437c85d2-6afc-4044-ba26-3626a499a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:19.004522 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1895/3813] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:19.204075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:19.212451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:19.314765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:19.443202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec344c3-0230-4d43-88b2-9bfbe541491f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:19.458374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:19.459006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:19.459282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:19.459639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:19.479674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:19.481578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:19.507909 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1919/3814] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:19.528730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5190f-2ed6-42f9-8b3f-5563c8cfcca6 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:19.529407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5190f-2ed6-42f9-8b3f-5563c8cfcca6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:19.529519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5190f-2ed6-42f9-8b3f-5563c8cfcca6 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:19.531866 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1896/3815] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:05:19.543921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:05:19.566129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:19.588503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018b1f-2474-464a-b40c-7a674e2542d7 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:19.602411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db8a85614994d2387f62cabf2b26fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064f7889d354c3f975786fbf4c90be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:19.603177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:19.603615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:19.603971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:19.606971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorizing `identity:get_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:19.609853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:19.629039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1920/3816] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:05:19 2022] GET /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 363 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:20.060518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55eec1-bdac-4741-b069-4a1ef9dfa1c4 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:20.060972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55eec1-bdac-4741-b069-4a1ef9dfa1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:20.061255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55eec1-bdac-4741-b069-4a1ef9dfa1c4 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:20.062873 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1897/3817] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:05:20.068161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:05:20.107319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:20.120299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e27549-2bf6-469d-aa30-5a93e67baa1e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:20.126996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db8a85614994d2387f62cabf2b26fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064f7889d354c3f975786fbf4c90be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:20.127930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:20.128815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:20.129280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:20.131779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorizing `identity:get_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:20.135163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:20.149443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1921/3818] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:05:20 2022] GET /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 363 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:20.206075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0d12c-b207-4dd8-b6af-487e7f5fe7ba None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:20.207055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0d12c-b207-4dd8-b6af-487e7f5fe7ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:20.207548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0d12c-b207-4dd8-b6af-487e7f5fe7ba None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:20.210819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1898/3819] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:05:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:05:20.220170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:05:20.256059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:20.269193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c86c5-280b-4683-b70d-b9616eda176e tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:20.274951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db8a85614994d2387f62cabf2b26fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064f7889d354c3f975786fbf4c90be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:20.275863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:20.276357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:20.276822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:20.279211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorizing `identity:get_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:20.287458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:20.294824 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1922/3820] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:05:20 2022] GET /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 363 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:05:21.652624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204036c-a531-494b-8c6c-4af9c4424958 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:21.653287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204036c-a531-494b-8c6c-4af9c4424958 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:21.653287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204036c-a531-494b-8c6c-4af9c4424958 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:21.658060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1899/3821] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:05:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:05:21.664565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:05:21.702982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:21.736073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9f8d-365a-4e63-995c-6320c7f5084b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:21.772933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db8a85614994d2387f62cabf2b26fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064f7889d354c3f975786fbf4c90be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:21.773865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:21.775034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:21.775709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:21.777334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorizing `identity:get_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:21.780189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:21.796641 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1923/3822] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:05:21 2022] GET /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 363 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:22.718600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0fc4e-bfaf-4840-94ed-4e2a2c964b50 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:22.719550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0fc4e-bfaf-4840-94ed-4e2a2c964b50 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:22.719550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0fc4e-bfaf-4840-94ed-4e2a2c964b50 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:22.720736 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1900/3823] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:05:22.730534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating service token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:05:22.752547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:22.774076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed644c-05a8-4a6d-8140-f1b004fd2452 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:22.791160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db8a85614994d2387f62cabf2b26fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064f7889d354c3f975786fbf4c90be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:22.794079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:22.796664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:22.797314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:22.800165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorizing `identity:get_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:22.802295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e7a2-9331-40a4-951c-e5eeed7dd1f6 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:22.808750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1924/3824] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:05:22 2022] GET /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 363 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:22.917270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0fc4e-bfaf-4840-94ed-4e2a2c964b50 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:23.136012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0fc4e-bfaf-4840-94ed-4e2a2c964b50 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:23.145642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:23.147100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:23.148379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:23.149092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] PATH_INFO: `/v3/users/1db8a85614994d2387f62cabf2b26fcc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:23.155288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db8a85614994d2387f62cabf2b26fcc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:23.159499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:23.281912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db8a85614994d2387f62cabf2b26fcc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:23.282983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db8a85614994d2387f62cabf2b26fcc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:23.283798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db8a85614994d2387f62cabf2b26fcc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:23.311036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db8a85614994d2387f62cabf2b26fcc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:23.335746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db8a85614994d2387f62cabf2b26fcc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:23.374476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:23.390910 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1901/3825] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:22 2022] DELETE /identity/v3/users/1db8a85614994d2387f62cabf2b26fcc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:23.394062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:23.394442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:23.394773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:23.434383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:23.436679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:23.664703 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1925/3826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:23.706619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:23.709605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:23.852130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1880-fd30-4f3c-8bbb-e89acd50842b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:23.858836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:23.861026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:23.863037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:23.864037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:23.922890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:23.936749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:23.969657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1902/3827] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:25.401973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:25.405560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:25.436330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d566eb-429a-4ac6-8ac7-d3aad9c3ed2d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:25.449600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:25.452216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:25.453196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:25.455124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] PATH_INFO: `/v3/users/0207c4170e35470385869f18e09828d0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:25.457795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0207c4170e35470385869f18e09828d0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:25.463732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:25.619427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0207c4170e35470385869f18e09828d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:25.620741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0207c4170e35470385869f18e09828d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:25.645001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0207c4170e35470385869f18e09828d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:25.674679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:25.685331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0207c4170e35470385869f18e09828d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:25.709830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36a7dd8c-62a2-4881-9012-6d8cf87b5dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0207c4170e35470385869f18e09828d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:25.772324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1926/3828] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:25 2022] DELETE /identity/v3/users/0207c4170e35470385869f18e09828d0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:26.330352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:26.332105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:26.364311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aef786-49ab-457d-959a-89b18566f2eb service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:26.597670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:26.611870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:26.612522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:26.617560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] PATH_INFO: `/v3/projects/2064f7889d354c3f975786fbf4c90be6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:26.619294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2064f7889d354c3f975786fbf4c90be6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:26.626996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:26.813365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2064f7889d354c3f975786fbf4c90be6', 'request_id': 'req-e9004237-d4d8-413a-a8a5-0725e1ccd683'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:26.838942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2064f7889d354c3f975786fbf4c90be6', 'request_id': 'req-e9004237-d4d8-413a-a8a5-0725e1ccd683'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:26.855751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2064f7889d354c3f975786fbf4c90be6', 'request_id': 'req-e9004237-d4d8-413a-a8a5-0725e1ccd683'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:26.877942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] The token cache is being invalidate because project 2064f7889d354c3f975786fbf4c90be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:26.878238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:26.878930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:26.880478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1903/3829] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:26 2022] DELETE /identity/v3/projects/2064f7889d354c3f975786fbf4c90be6 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:26.887752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853cf3-6029-480f-a83d-59a0579f2398 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:26.888434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853cf3-6029-480f-a83d-59a0579f2398 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:26.888549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853cf3-6029-480f-a83d-59a0579f2398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:26.958733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e853cf3-6029-480f-a83d-59a0579f2398 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:26.961729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e853cf3-6029-480f-a83d-59a0579f2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:26.963039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:26.964598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.048547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:27.103135 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1927/3830] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:27.110880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.111168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.111438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.115071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004237-d4d8-413a-a8a5-0725e1ccd683 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:27.122183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:27.123047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.123512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.124216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] PATH_INFO: `/v3/projects/464468c4eb514931ac21cf728e28fd50` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.125965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464468c4eb514931ac21cf728e28fd50)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:27.130312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:27.152785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:27.157097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.206078 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1928/3831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:27.207247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:27.240761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464468c4eb514931ac21cf728e28fd50', 'request_id': 'req-f373c19c-2567-4230-916d-a115a2a5c9e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:27.244174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8299-750e-4677-92ab-2c613d369baf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:27.257864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464468c4eb514931ac21cf728e28fd50', 'request_id': 'req-f373c19c-2567-4230-916d-a115a2a5c9e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:27.287826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464468c4eb514931ac21cf728e28fd50', 'request_id': 'req-f373c19c-2567-4230-916d-a115a2a5c9e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:27.325422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] The token cache is being invalidate because project 464468c4eb514931ac21cf728e28fd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:27.325755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:27.332111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f373c19c-2567-4230-916d-a115a2a5c9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:27.335971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1904/3832] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:26 2022] DELETE /identity/v3/projects/464468c4eb514931ac21cf728e28fd50 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:27.344019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb1c2-64dc-43e0-ae43-0e2ba63c81ec None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.344307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb1c2-64dc-43e0-ae43-0e2ba63c81ec None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.345309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb1c2-64dc-43e0-ae43-0e2ba63c81ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.376095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-90bbb1c2-64dc-43e0-ae43-0e2ba63c81ec None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:27.377668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-90bbb1c2-64dc-43e0-ae43-0e2ba63c81ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.457721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:27.458347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.458623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.458891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.461117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:05:27.466767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:27.470883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:27.518969 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1929/3833] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:27.522478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:27.526034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.579726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2faf4-5b2a-4059-8c32-7c35ab70a8ca admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:27.618970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:27.623263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.624020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.625365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.630011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:27.638960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002b336-bf4d-4d87-9f04-4fc27d811beb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:27.677420 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1905/3834] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:27.679599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.683009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.683515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.729528 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1930/3835] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:27.731450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:27.733060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:27.738358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:27.743149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:27.745025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.775256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:27.776478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:27.838182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1906/3836] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:27.838182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:27.854699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:27.900551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:27.981601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1931/3837] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:27.984810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.000468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65784-de13-4ba6-aeea-34352509c3f0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.005058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e26c-4407-457a-8fcd-0ce3877b8cff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.016634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.017996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.018454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.018906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.021227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.024070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.024704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.025003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.025271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.025916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:05:28.026219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.028113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.029154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.059711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1932/3838] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:05:28.060766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.089011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b3d4a-950d-40dc-b3bf-a585b4f7e231 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.095226 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1907/3839] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:05:27 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:28.099037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.104957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6885-9449-493c-9738-46407b78309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.106401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6885-9449-493c-9738-46407b78309c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.111847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6885-9449-493c-9738-46407b78309c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.112212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6885-9449-493c-9738-46407b78309c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.113826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f6885-9449-493c-9738-46407b78309c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.115872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f6885-9449-493c-9738-46407b78309c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.131588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168650d-be60-4806-b8fe-a20b6c8cd94f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.145054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.145985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.146427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.146887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.148075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.150163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.168821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1908/3840] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:28.172759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.188680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1933/3841] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:05:28 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:28.189796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6885-9449-493c-9738-46407b78309c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.213337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a0d59-e4c4-4201-bb3e-1f1a602c5601 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.385458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.387094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.387748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.389602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.392401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.395603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.403172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6885-9449-493c-9738-46407b78309c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.413028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1909/3842] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:28.417151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.429790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.430421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.430700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.430970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.431605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.438728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.444946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b23fd1-1ef9-4edc-b2e1-0f65a29f784b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.450601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.451382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.451939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.452286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] PATH_INFO: `/v3/projects/93cd90bbd4f14a4c982608b9977bfb5e/users/53825000d25148b5b6ed23dc2d13f584/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.485799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1934/3843] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:05:28 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:28.488080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.513624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cd90bbd4f14a4c982608b9977bfb5e, user_id=53825000d25148b5b6ed23dc2d13f584, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.517017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f870-e206-4fd5-9ceb-3c5b466c4c20 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.523760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78020660-2e57-4798-8f2b-ad130adb0d98 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.544059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.545341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.545720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.546111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.546853 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1910/3844] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:05:28 2022] PUT /identity/v3/projects/93cd90bbd4f14a4c982608b9977bfb5e/users/53825000d25148b5b6ed23dc2d13f584/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:28.549360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.552750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.558668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.559212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.559697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.602726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1935/3845] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:28.607414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.633317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6f06f-628e-47e1-9961-e5927224d962 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.669642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] MFA Rules not processed for user `53825000d25148b5b6ed23dc2d13f584`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:28.672503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:28.776017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:28.796537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.797314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.797602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.797876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.798602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.801016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28b22f-2192-4cc8-989f-32298f18fa5b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.821977 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1911/3846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:05:28.846149 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1936/3847] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:28.848806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:28.867896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc99e-6159-404e-bf07-b29afd54cdce None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:28.877498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:28.879045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.879350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.879618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] PATH_INFO: `/v3/projects/26e212a668cf47d38ef3b363ce7dbba4/users/1f95d3b5d2334eefb1b5386fb8580780/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:28.912779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e212a668cf47d38ef3b363ce7dbba4, user_id=1f95d3b5d2334eefb1b5386fb8580780, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:28.918313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:28.959162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1912/3848] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:05:28 2022] PUT /identity/v3/projects/26e212a668cf47d38ef3b363ce7dbba4/users/1f95d3b5d2334eefb1b5386fb8580780/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:28.964381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596e9a-5cc8-4aed-a416-b6eb5110803f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:28.964944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596e9a-5cc8-4aed-a416-b6eb5110803f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:28.966707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596e9a-5cc8-4aed-a416-b6eb5110803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:29.023288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a3596e9a-5cc8-4aed-a416-b6eb5110803f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:29.024977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a3596e9a-5cc8-4aed-a416-b6eb5110803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:29.056059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:29.150331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1937/3849] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:29.163102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:29.165305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:29.272813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3cdcd-53e4-4183-b163-7d40905cc861 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:29.277373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:29.277997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:29.278279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:29.278543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:29.296328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:29.298439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:29.336653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1913/3850] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:29.993329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c3af-c628-4dba-91b3-04e681ed3451 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:29.994407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c3af-c628-4dba-91b3-04e681ed3451 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:29.995039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c3af-c628-4dba-91b3-04e681ed3451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:30.047633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:30.049198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:30.081008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3b19c3af-c628-4dba-91b3-04e681ed3451 None None] MFA Rules not processed for user `8c89b4a51ce649389bbff589d10e1585`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:30.092180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3b19c3af-c628-4dba-91b3-04e681ed3451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:30.195946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f2ca-049b-4e58-81c8-03bf06717050 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:30.209752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:30.210977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:30.211256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:30.211578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:30.216399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:30.399716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1938/3851] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:30.403081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ec84-a405-453f-aa9c-a5fcc0bb08e7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:30.403848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ec84-a405-453f-aa9c-a5fcc0bb08e7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:30.404629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ec84-a405-453f-aa9c-a5fcc0bb08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:30.431972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:30.433622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:30.458453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-87b0ec84-a405-453f-aa9c-a5fcc0bb08e7 None None] MFA Rules not processed for user `8c89b4a51ce649389bbff589d10e1585`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:30.461937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87b0ec84-a405-453f-aa9c-a5fcc0bb08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:30.475932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1914/3852] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:05:30.487929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1939/3853] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:31.151498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:31.153368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:31.163936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:31.182559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953b80-0312-4cf8-b8ea-82396c9843fa service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:31.216842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:31.220167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:31.222186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:31.223859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:31.252119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:31.253774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:31.277797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:31.278665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:31.278950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:31.294789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1915/3854] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:31.331533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:31.339539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:31.505408 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1940/3855] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:05:31.547910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:31.549779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:31.877250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281ff8-55eb-46ce-a1b1-a08d24897dc1 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:31.894817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:31.895404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:31.898811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:31.899115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:31.934124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:31.941755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0132b2-c0aa-440e-bdce-f0a25dfc2774 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:31.977454 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1916/3856] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:05:37.565738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:37.588456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205ce0-caab-45a8-af40-b714ac3cb9a3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:37.616765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:37.617788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:37.618246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:37.619065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] PATH_INFO: `/v3/users/53825000d25148b5b6ed23dc2d13f584` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:37.625423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53825000d25148b5b6ed23dc2d13f584)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:37.627830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:37.644781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:37.645809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:37.646371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:37.691748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:37.699438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:37.749525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1917/3857] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:37.769124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:37.769374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:37.774801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53825000d25148b5b6ed23dc2d13f584'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:37.777418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53825000d25148b5b6ed23dc2d13f584'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:37.799854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba775e-3ad3-4b86-9826-28dac994fada None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:37.802916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53825000d25148b5b6ed23dc2d13f584'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:37.819909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:37.820564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:37.821182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:37.821182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:37.830282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53825000d25148b5b6ed23dc2d13f584'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:37.832544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53825000d25148b5b6ed23dc2d13f584'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:37.840805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:37.844976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdbdd7-6b23-4ef5-89bc-b7797577bd7e service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:37.867707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1918/3858] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:05:37.896048 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1941/3859] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:37 2022] DELETE /identity/v3/users/53825000d25148b5b6ed23dc2d13f584 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:37.902614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1f4c-9e52-4b5b-883b-a37e46f4ab6f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:37.903186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1f4c-9e52-4b5b-883b-a37e46f4ab6f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:37.903186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1f4c-9e52-4b5b-883b-a37e46f4ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:37.948895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ef8a1f4c-9e52-4b5b-883b-a37e46f4ab6f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:37.954196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef8a1f4c-9e52-4b5b-883b-a37e46f4ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:38.160491 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1919/3860] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:38.204289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:38.207179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:38.490256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35fbd2-0c2e-470c-a7b4-a966662d560f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:38.521367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:38.521968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:38.522320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:38.530766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:38.565799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:38.571975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:38.630175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1942/3861] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:40.314059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26a691-ae96-40bf-974e-6aaf6d5e4e35 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:40.314661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26a691-ae96-40bf-974e-6aaf6d5e4e35 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:40.314998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26a691-ae96-40bf-974e-6aaf6d5e4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:40.375085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3d26a691-ae96-40bf-974e-6aaf6d5e4e35 None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:40.378606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d26a691-ae96-40bf-974e-6aaf6d5e4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:40.618785 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1920/3862] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:05:40.758130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:40.759686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:40.788471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c022-eca3-4034-9a38-e2179ccba4bb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:40.815502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:40.816168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:40.816446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:40.816720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] PATH_INFO: `/v3/projects/93cd90bbd4f14a4c982608b9977bfb5e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:40.823761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cd90bbd4f14a4c982608b9977bfb5e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:40.831103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:40.980858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cd90bbd4f14a4c982608b9977bfb5e', 'request_id': 'req-346efde6-6dee-44f4-94ad-c0a210d42cfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:41.003518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cd90bbd4f14a4c982608b9977bfb5e', 'request_id': 'req-346efde6-6dee-44f4-94ad-c0a210d42cfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:41.019266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cd90bbd4f14a4c982608b9977bfb5e', 'request_id': 'req-346efde6-6dee-44f4-94ad-c0a210d42cfa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:41.046331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] The token cache is being invalidate because project 93cd90bbd4f14a4c982608b9977bfb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:05:41.046632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:41.047744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-346efde6-6dee-44f4-94ad-c0a210d42cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:41.055709 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1943/3863] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:40 2022] DELETE /identity/v3/projects/93cd90bbd4f14a4c982608b9977bfb5e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:41.057640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:41.058172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:41.058691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:41.078086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:41.137356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:41.139447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:41.377996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1921/3864] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:41.380872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:41.381356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:41.382337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:41.408599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:41.409952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:41.426186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1944/3865] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:41.426386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:41.438746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba9ccb-b8d1-4e76-9665-028b711bcba7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:41.452579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:41.453327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:41.453748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:41.454096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:41.454825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:05:41.455261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:41.457218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:41.500548 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1922/3866] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:05:41.505593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:41.548693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec186a6b-7ab3-4086-8ded-c1e5addf2236 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:41.572324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:41.573403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:41.573842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:41.575093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:41.576188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:41.585666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:41.703307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1945/3867] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:05:41.708286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:41.730490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035976-0cdf-4fab-a534-39e34a5f1c9d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:41.984016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:41.985230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:41.986118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:41.987803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:41.988821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:42.003222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:42.095492 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1923/3868] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:05:41 2022] POST /identity/v3/users => generated 287 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:05:42.099605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:42.119764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53348-6ee2-46d4-9aa7-1e56f9738a17 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:42.138031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:42.138675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:42.138957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:42.139237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:42.145828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:42.153830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:42.197617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1946/3869] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:42.198879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:42.214095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0ea1b-5603-4fff-a70c-4d79262400cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:42.238893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:42.244431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:42.250055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:42.250526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:42.254248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:42.258488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286be5a3-ce2c-44d6-be6b-4a6f83a259f7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:42.315157 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1924/3870] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:05:42.316314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:42.343313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eb82-c5db-4a7e-be42-e91c06545f48 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:42.356453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:42.357156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:42.357631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:42.358073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] PATH_INFO: `/v3/projects/a2172b8f682b4096845ddd570838466c/users/835e7d7fae5749f49a53beab143fdc43/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:42.378854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:42.427210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2172b8f682b4096845ddd570838466c, user_id=835e7d7fae5749f49a53beab143fdc43, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:42.431047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be72029-59be-4f6b-9fda-fbeb80c35d19 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:42.472366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1947/3871] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:05:42 2022] PUT /identity/v3/projects/a2172b8f682b4096845ddd570838466c/users/835e7d7fae5749f49a53beab143fdc43/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:42.500587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:42.501467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:42.501903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:42.602125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] MFA Rules not processed for user `835e7d7fae5749f49a53beab143fdc43`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:42.604032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:42.908931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:42.918513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1925/3872] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:43.773701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:43.774199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:43.774199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:43.864446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] MFA Rules not processed for user `1f95d3b5d2334eefb1b5386fb8580780`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:43.867411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:44.160623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1948/3873] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:44.234115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:44.236293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:44.390065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a8e6-92c6-4eee-8737-3dc8d26a91bc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:44.401848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:44.403254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:44.404384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:44.404827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:44.420656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:44.426338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:44.428611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:44.442116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1926/3874] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:44.446789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7c70-b0b2-4283-ab44-111dc3e67da5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:44.469299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:44.469299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:44.469299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:44.469299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:44.481831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:44.495020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:44.503615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:44.548638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:44.555118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:44.596475 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1949/3875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:44.815333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c167-3443-49df-bc80-82e7ee3ea233 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:44.842910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:44.843560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:44.846586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:44.846911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:44.882136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:44.887223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:44.917069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1927/3876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:47.421402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:47.441226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f049-2831-45dd-b04c-4bcd80ce3f0d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:47.458372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:47.459005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:47.460264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:47.460264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:47.474394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:47.565820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:47.572104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656705af-3dda-4b06-bbb6-260691bcf6b1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:47.616856 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1950/3877] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:54.906836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=60 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:56.187812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:56.383408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bdd4-cb1c-44d9-a9cf-9d46d6566853 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:56.401642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:56.402837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:56.402837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:56.403072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] PATH_INFO: `/v3/users/835e7d7fae5749f49a53beab143fdc43` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:56.404791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835e7d7fae5749f49a53beab143fdc43)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:56.412054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:56.517474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835e7d7fae5749f49a53beab143fdc43'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:56.518165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835e7d7fae5749f49a53beab143fdc43'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:56.518799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835e7d7fae5749f49a53beab143fdc43'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:56.533819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835e7d7fae5749f49a53beab143fdc43'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:56.549823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835e7d7fae5749f49a53beab143fdc43'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:05:56.588765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1928/3878] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:05:56 2022] DELETE /identity/v3/users/835e7d7fae5749f49a53beab143fdc43 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:05:56.590386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514af2-403a-4c7d-9192-e1b9dd0f6aa0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:56.590916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514af2-403a-4c7d-9192-e1b9dd0f6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:56.591318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514af2-403a-4c7d-9192-e1b9dd0f6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:56.626947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b4514af2-403a-4c7d-9192-e1b9dd0f6aa0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:56.628182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4514af2-403a-4c7d-9192-e1b9dd0f6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:56.786088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1951/3879] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:05:56.864810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:56.867009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:57.048720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473b481-1fd2-4cf1-857d-42d88f48b496 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:57.060965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:57.061791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:57.063533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:57.064477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:57.099190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:57.101202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:57.133707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1929/3880] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:57.407031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd24c-9c67-46de-af33-1f697f2b8027 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:57.407605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd24c-9c67-46de-af33-1f697f2b8027 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:57.408061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd24c-9c67-46de-af33-1f697f2b8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:57.449234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-654fd24c-9c67-46de-af33-1f697f2b8027 None None] MFA Rules not processed for user `1f95d3b5d2334eefb1b5386fb8580780`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:57.450692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-654fd24c-9c67-46de-af33-1f697f2b8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:57.577366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:57.621732 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1952/3881] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:01.077265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:01.079078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:01.115659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2182911-07ae-44d4-9539-36d83f8dbd85 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:01.126122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:01.126765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:01.127045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:01.127310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] PATH_INFO: `/v3/projects/a2172b8f682b4096845ddd570838466c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:01.128441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2172b8f682b4096845ddd570838466c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:01.130383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:01.176213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:01.253640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2172b8f682b4096845ddd570838466c', 'request_id': 'req-098139b2-406a-4a94-9d78-28f94539ceb7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:01.262201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2172b8f682b4096845ddd570838466c', 'request_id': 'req-098139b2-406a-4a94-9d78-28f94539ceb7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:01.275927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2172b8f682b4096845ddd570838466c', 'request_id': 'req-098139b2-406a-4a94-9d78-28f94539ceb7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:01.297333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] The token cache is being invalidate because project a2172b8f682b4096845ddd570838466c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:01.297862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:01.299674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-098139b2-406a-4a94-9d78-28f94539ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:01.302776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1930/3882] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:01 2022] DELETE /identity/v3/projects/a2172b8f682b4096845ddd570838466c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:01.308189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:01.308731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:01.308859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:01.398520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:01.400429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:01.702782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1953/3883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:01.709023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:01.709023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:01.709314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:01.742678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:01.743897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:01.773167 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1931/3884] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:01.779121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:01.802257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6461-7d6b-47a4-8f37-cc6b817c877f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:01.827727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:01.828367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:01.828651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:01.828958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:01.829613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:01.829913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:01.846076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:01.888156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1954/3885] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:01.892247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:01.904782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1150-2f0b-4091-9859-994462625eb8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:01.926811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:01.927651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:01.929305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:01.929840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:01.930651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:01.947220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.070746 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1932/3886] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:01 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:02.075274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.093936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.096597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:02.099865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23def83-9fec-4401-9bd0-92fe03fb99e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.249342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.253583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.253959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.254239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.254909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.263522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.309929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1955/3887] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:02 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:02.314219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.327763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda0a77-5820-46e4-ae00-b12f27c4c8e6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.328001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e85ece-2ad8-4b85-a73d-12a4e8e1b1ac admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.333553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.335083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.335643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.336088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.336995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.339037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.344971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.346101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.346101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.346600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.354650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:02.357418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1956/3888] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:02.363273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.375394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ba95-6889-49ca-b9da-69a50a9e7a1c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.382705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.383756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.384133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.384497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.385273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.386088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.386459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0393-ca7b-4819-bb75-d828dae7e2d7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.388739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.402405 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1957/3889] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:02.406671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.417955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faf819-36cf-4f1c-8d15-b2796a800c9a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.423719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.423928 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1933/3890] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:06:02.424761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.425241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.425688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] PATH_INFO: `/v3/projects/57e932b8e2864469899193fdd147bb83/users/d587d2363a154515867dd1fdb315c4d2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.444823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e932b8e2864469899193fdd147bb83, user_id=d587d2363a154515867dd1fdb315c4d2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.447917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.477268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1958/3891] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:02 2022] PUT /identity/v3/projects/57e932b8e2864469899193fdd147bb83/users/d587d2363a154515867dd1fdb315c4d2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:02.488372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155db05-e55e-4f95-9654-2cc455a9b77c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.488777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155db05-e55e-4f95-9654-2cc455a9b77c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.489185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155db05-e55e-4f95-9654-2cc455a9b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.554882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6155db05-e55e-4f95-9654-2cc455a9b77c None None] MFA Rules not processed for user `d587d2363a154515867dd1fdb315c4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:02.556246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6155db05-e55e-4f95-9654-2cc455a9b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:02.661362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:02.721014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1934/3892] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:02.732551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:02.734814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:02.776000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:02.814901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4392c5c-64d9-4c08-a169-1f97175fb27a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:02.819709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:02.820341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:02.820622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:02.820923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:02.831866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:02.832552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42c7f4-60bf-4200-96aa-f8c65ad065b3 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:02.843990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1959/3893] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:12.702161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:12.839535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=15 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:13.653201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:13.653762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:13.654197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:13.736171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] MFA Rules not processed for user `45369fea2a654d1d88145db9677a53fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:13.739030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:13.924954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1935/3894] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:13.936158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:13.936643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:13.936747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:13.980533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] MFA Rules not processed for user `45369fea2a654d1d88145db9677a53fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:13.990192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.020510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1960/3895] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:14.417082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:14.418757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.511181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953044f9-2a37-45f1-bc72-419ccbecb815 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:14.522309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:14.524939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:14.525452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:14.526842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:14.531793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.690918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:14.692776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:14.712847 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1936/3896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:14.824943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:14.828187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.934532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37bb1-3898-496e-a58f-42ddc99bb24b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:14.938974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:14.939675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:14.939884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:14.940156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:14.942737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.954758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:14.956725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:14.967668 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1961/3897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:15.218222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:15.232606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c61e7-35d4-47b3-a039-703601fa116a service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:15.237075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:15.238111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:15.238620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:15.239112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:15.241829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:15.262295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:15.264127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:15.278414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1937/3898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:15.418393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:15.419820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:15.496395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143caadf-8925-47f1-8ee7-eb2a16936126 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:15.502640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:15.503636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:15.504147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:15.504581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:15.506609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:15.521345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:15.523938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:15.538332 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1962/3899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:18.322808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:18.324523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:18.337015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef104feb-5818-41ed-bbe7-caff1a15fcdb service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:18.342559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:18.343456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:18.343936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:18.344409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:18.346651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:18.366330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:18.368145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8aa71-8518-472d-9a71-db1889618859 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:18.383275 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1938/3900] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:18.915044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:18.918205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:18.942796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8882-e24b-4ec7-86ab-7253c5f5afc7 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:18.958279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:18.960666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:18.962497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:18.962876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:18.967141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:18.991321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:18.993292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:19.036164 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1963/3901] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:20.073846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:20.074711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:20.075134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:20.102728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:20.104943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:20.124071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:20.223471 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1939/3902] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:20.241612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:20.243199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:20.388285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a658b-a4a2-48fb-a36e-cb6281b6f229 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:20.395417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:20.396406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:20.397098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:20.398240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:20.410965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:20.413618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1429caa-562b-4c51-ad17-78dc97b1ad49 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:20.440441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1964/3903] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:06:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:22.325863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:22.364864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd6ab0-748e-4e84-9df2-eb085240b7f0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:22.396733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:22.397393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:22.398173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:22.398603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:22.400709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:22.435518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:22.437896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:22.459932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1940/3904] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:23.907342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:23.907892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:23.907987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:23.925297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:23.979107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:23.992940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:24.021862 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1965/3905] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:24.067250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:24.094973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca8fb-6819-494b-9e42-93c338381d52 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:24.116654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:24.120624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:24.120938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:24.121250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:24.168997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:24.177106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:24.213932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1941/3906] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:06:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:29.700603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:29.722041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9df1e-fad0-46bf-a84d-c425e8aea8f3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:29.741999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:29.742993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:29.743507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:29.743974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:29.749641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:29.777609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:29.783449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:29.820789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:29.822257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:29.861043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1966/3907] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:29.991888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8968c-c9da-4a2b-b6cb-76e386a2eb77 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:29.998236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:29.999187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:29.999575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:29.999964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] PATH_INFO: `/v3/users/b125e9d6136447169f052690eeaab064` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:30.001804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b125e9d6136447169f052690eeaab064)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:30.005072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:30.090101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b125e9d6136447169f052690eeaab064'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:30.091722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b125e9d6136447169f052690eeaab064'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:30.092970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b125e9d6136447169f052690eeaab064'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:30.106817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b125e9d6136447169f052690eeaab064'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:30.144155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8fc44376-76be-41c8-a51b-ea956f4d7b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b125e9d6136447169f052690eeaab064'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:30.235449 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1942/3908] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:29 2022] DELETE /identity/v3/users/b125e9d6136447169f052690eeaab064 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:30.788594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:30.849606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ef5a-7850-4818-aacb-61c677599cbd service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:31.047085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:31.048179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:31.058673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:31.059698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] PATH_INFO: `/v3/projects/2e1adf828480437ea6595561c912d9bf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:31.061349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1adf828480437ea6595561c912d9bf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:31.064574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:31.247590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1adf828480437ea6595561c912d9bf', 'request_id': 'req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:31.280878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1adf828480437ea6595561c912d9bf', 'request_id': 'req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:31.305806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1adf828480437ea6595561c912d9bf', 'request_id': 'req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:31.325052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] The token cache is being invalidate because project 2e1adf828480437ea6595561c912d9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:31.325753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:31.326700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d2ee0e5-8bdc-4582-8c43-f395dad25e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:31.330110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1967/3909] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:30 2022] DELETE /identity/v3/projects/2e1adf828480437ea6595561c912d9bf => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:31.337510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:31.338052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:31.338152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:31.416661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:31.417951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:31.467773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:31.669070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1943/3910] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:31.675376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:31.675862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:31.676240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:31.745248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:31.748653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:31.809427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:31.809988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1968/3911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:31.828701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f855-3345-4935-8ed5-fffd1db11386 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:31.847281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:31.848474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:31.851880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:31.852688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:31.854852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:31.855546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:31.872706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:31.937037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:31.938512 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1944/3912] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:31.959320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949510ff-bbf4-449e-bb4e-3427fa2f545c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:32.002967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:32.005367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.010204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.021498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.023245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:32.027444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:32.171035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1969/3913] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:31 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:06:32.175259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:32.189516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d1c3-09a4-4c4d-ab11-8543d5e16793 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:32.399556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:32.400223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.400443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.403197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.404099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:32.406345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:32.488292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1945/3914] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:32 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:32.490032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:32.507310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264de96-be05-44d7-81c9-5cc56276bec8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:32.600409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:32.601630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.602145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.602651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.603523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:32.605527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:32.689860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1970/3915] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:06:32.694764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:32.723332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f527-a91d-419e-99a7-1d95414e3e88 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:32.737517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:32.738151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.738462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.738705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.739358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:32.741559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e96f-56f3-4393-97e9-382b9dc2cfcc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:32.769391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:32.769803 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1946/3916] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:32.786723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5275edf-7083-47e4-897d-9e205c71ad34 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:32.794171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:32.795114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.795572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.796021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] PATH_INFO: `/v3/projects/8fe652e1ff264b89938f9c5b4b9c09c6/users/46e60190fc7542aea2104d11446c2614/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.837881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe652e1ff264b89938f9c5b4b9c09c6, user_id=46e60190fc7542aea2104d11446c2614, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:32.841645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:32.871380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1971/3917] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:32 2022] PUT /identity/v3/projects/8fe652e1ff264b89938f9c5b4b9c09c6/users/46e60190fc7542aea2104d11446c2614/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:32.876751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:32.877060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:32.877337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:32.913793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:32.918893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:33.089277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1947/3918] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:33.097914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:33.100764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:33.120186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:33.298149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244497b-6771-4f62-a3e8-018861d726fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:33.320535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:33.321550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:33.322026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:33.322523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:33.348976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:33.351057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d1aa-dd3d-4fb3-abec-7fefb14c7a77 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:33.390635 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1972/3919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:06:36.701374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:36.703477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:36.722031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517182-dfed-4cd8-b14d-6a78ba1b1af1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:36.735550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:36.736428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:36.736911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:36.737404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] PATH_INFO: `/v3/users/d587d2363a154515867dd1fdb315c4d2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:36.745989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d587d2363a154515867dd1fdb315c4d2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:36.748299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:36.831695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:36.909444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd587d2363a154515867dd1fdb315c4d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:36.913450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd587d2363a154515867dd1fdb315c4d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:36.914137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd587d2363a154515867dd1fdb315c4d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:36.954114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd587d2363a154515867dd1fdb315c4d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:36.977657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd587d2363a154515867dd1fdb315c4d2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:37.035339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1948/3920] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:36 2022] DELETE /identity/v3/users/d587d2363a154515867dd1fdb315c4d2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:37.037058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:37.038104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:37.038214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:37.111831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:37.114790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:37.503920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1973/3921] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:37.630827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:37.634780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:37.856366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1645-a475-4c0c-9b7b-a985560c496b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:37.868711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:37.870576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:37.870576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:37.870576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:37.905982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:37.907507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2b206-beba-4b75-89fe-99055cd66529 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:37.942448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1949/3922] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:42.065191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:42.066722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:42.114539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef9d9a-ed68-4f95-8e79-6624487c90ce None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:42.138504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:42.139473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:42.139987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:42.140440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] PATH_INFO: `/v3/projects/57e932b8e2864469899193fdd147bb83` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:42.142681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e932b8e2864469899193fdd147bb83)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:42.144809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:42.259268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e932b8e2864469899193fdd147bb83', 'request_id': 'req-0b7d902d-f127-4ca0-b92b-563c23ec3396'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:42.284162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e932b8e2864469899193fdd147bb83', 'request_id': 'req-0b7d902d-f127-4ca0-b92b-563c23ec3396'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:42.304174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e932b8e2864469899193fdd147bb83', 'request_id': 'req-0b7d902d-f127-4ca0-b92b-563c23ec3396'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:42.334815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] The token cache is being invalidate because project 57e932b8e2864469899193fdd147bb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:42.335065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:42.338438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b7d902d-f127-4ca0-b92b-563c23ec3396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:42.342184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1974/3923] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:42 2022] DELETE /identity/v3/projects/57e932b8e2864469899193fdd147bb83 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:42.347787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:42.348339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:42.348339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:42.382361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:42.393389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:42.638601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1950/3924] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:42.647644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419aba-7902-433d-af98-d012041d7355 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:42.647644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419aba-7902-433d-af98-d012041d7355 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:42.648055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419aba-7902-433d-af98-d012041d7355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:42.734972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0c419aba-7902-433d-af98-d012041d7355 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:42.736389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c419aba-7902-433d-af98-d012041d7355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:42.780289 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1975/3925] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:42.784591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:42.810836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07181-199c-4fd2-a0ce-f88aed5302b6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:42.826997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:42.827773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:42.828162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:42.828554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:42.829354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:42.830234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:42.831517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:42.867294 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1951/3926] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:42.868958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419aba-7902-433d-af98-d012041d7355 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:42.880179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419aba-7902-433d-af98-d012041d7355 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:42.902577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:42.908971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:42.909611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:42.910671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:42.912273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:42.918924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:42.994653 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1976/3927] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:42 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:42.995909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:43.023270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435586c-a0f9-4686-ae02-cbecf48bda32 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:43.160198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:43.255440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:43.260634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:43.266356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:43.270883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:43.271987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:43.281714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:43.344536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:43.354867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1952/3928] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:42 2022] POST /identity/v3/users => generated 286 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:43.363085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8563c-11a6-4235-9ad9-6760b5cac348 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:43.386901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:43.392220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:43.392931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:43.393621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:43.394716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:43.405272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:43.412693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:43.450276 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1977/3929] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:43.450829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:43.463147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209c10-9eb8-430b-ab28-701958e725f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:43.495092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:43.496167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:43.496672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:43.508325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:43.510018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:43.512017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee86f4-cf22-43bd-b6bb-1d348e384a2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:43.558427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:43.570634 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1953/3930] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:06:43.578510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae306-6eae-46df-9180-fb65789968a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:43.604716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:43.610242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:43.610583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:43.611063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] PATH_INFO: `/v3/projects/7bd1a9a33df846b193a3fb043c52ed02/users/34dfd359f2c347b691d08ff889b4b082/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:43.701580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd1a9a33df846b193a3fb043c52ed02, user_id=34dfd359f2c347b691d08ff889b4b082, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:43.704311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:43.761101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1978/3931] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:43 2022] PUT /identity/v3/projects/7bd1a9a33df846b193a3fb043c52ed02/users/34dfd359f2c347b691d08ff889b4b082/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:43.773069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:43.774295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:43.774682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:43.879859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] MFA Rules not processed for user `34dfd359f2c347b691d08ff889b4b082`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:43.888386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:44.109595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1954/3932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:44.114093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:44.271175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b80a0-8054-4dba-a7ed-a5a32740064f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:44.285825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:44.286489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:44.286766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:44.287672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:44.288312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:44.290964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:44.386848 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1979/3933] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:44 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:44.390984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:44.420137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a826-bae3-4356-a561-5ffda1e5b2b4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:44.719378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:44.720119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:44.720462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:44.720806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:44.721549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:44.723761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:44.782717 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1955/3934] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:44 2022] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:44.786875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:44.807280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9360-850c-4d6f-8997-3fc557e2fc74 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:44.828838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:44.830881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:44.831336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:44.832459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:44.835206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:44.844659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:44.889002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1980/3935] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:44.892411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:44.909959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1042-2069-45e5-94ba-9a940e91cba5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:44.929770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:44.932393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:44.932893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:44.933461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] PATH_INFO: `/v3/projects/49232a9161f145b6ba910374f86484fb/users/3a0e0f7ea5c9421c8fe4524033aa1dd0/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.011334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49232a9161f145b6ba910374f86484fb, user_id=3a0e0f7ea5c9421c8fe4524033aa1dd0, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:45.023394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adb605-d47d-4262-a2b8-af52b57046b1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:45.059162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:45.081661 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1956/3936] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:44 2022] PUT /identity/v3/projects/49232a9161f145b6ba910374f86484fb/users/3a0e0f7ea5c9421c8fe4524033aa1dd0/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:45.085674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:45.104467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ceeeff-d198-4a98-bf65-5aefd87417c1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:45.241742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe78186-55d5-4637-b8d0-32fa473da445 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.242324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe78186-55d5-4637-b8d0-32fa473da445 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.242773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe78186-55d5-4637-b8d0-32fa473da445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.332966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4fe78186-55d5-4637-b8d0-32fa473da445 None None] MFA Rules not processed for user `46e60190fc7542aea2104d11446c2614`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:45.334478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4fe78186-55d5-4637-b8d0-32fa473da445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:45.401148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:45.401764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.402055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.402336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.403006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:45.404621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:45.467648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1981/3937] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:45.468577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:45.526504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc80c-8da8-4ba0-9997-1e1105dc7553 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:45.548470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:45.550118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.550416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.550702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] PATH_INFO: `/v3/projects/49232a9161f145b6ba910374f86484fb/users/3a0e0f7ea5c9421c8fe4524033aa1dd0/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.561373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49232a9161f145b6ba910374f86484fb, user_id=3a0e0f7ea5c9421c8fe4524033aa1dd0, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:45.576479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d334-4a83-4bd8-8877-f3060f15e44b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:45.614824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1957/3938] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:06:45.626361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.627086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.627086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.635405 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1982/3939] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:45 2022] PUT /identity/v3/projects/49232a9161f145b6ba910374f86484fb/users/3a0e0f7ea5c9421c8fe4524033aa1dd0/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:45.646152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.647431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.647939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.678172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] MFA Rules not processed for user `46e60190fc7542aea2104d11446c2614`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:45.681964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:45.721011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] MFA Rules not processed for user `3a0e0f7ea5c9421c8fe4524033aa1dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:45.724195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:45.754080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:45.836595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1983/3940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:06:45.841186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:45.844987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1958/3941] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:06:45.852660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800a9d5-0a5f-4d75-b84e-8748e52bfdc9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:45.857850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:45.858886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.859172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.859450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.862853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:45.863909 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:45.863909 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:45.863909 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:45.864888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:45.892999 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1984/3942] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:45 2022] POST /identity/v3/services => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:45.897692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:45.912554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbaa20-c4ff-435c-b582-33fcdd9e90d2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:45.961410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:45.962486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:45.962819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:45.963105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:45.965022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:45.966190 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:45.966190 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:45.966190 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:45.967394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:45.973169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:45.976207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:46.003386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1959/3943] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Oct 28 10:06:45 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:46.007650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.040509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda78ee-1c1c-4bb9-a0f5-0cd4148fcbb1 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.051924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.054646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.054951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.055233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.060433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.064945 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:46.064945 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:46.064945 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:46.068727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.118541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1960/3944] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:46 2022] POST /identity/v3/services => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:46.123190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.190820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a6014-6aba-4a25-8c16-1dccd2492005 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.203657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.206568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.206859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.207136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.207810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.215337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd4348-77f6-4f40-a60e-6b3269d24c1e tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.236745 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1961/3945] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Oct 28 10:06:46 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:46.238561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.238850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.242464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.254838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a396-8f07-4ddd-9893-53bdc7ddb792 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.332718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:46.337589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.342633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.346462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.346612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:46.352632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.397374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.404155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.474806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:46.502607 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1985/3946] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3533 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:06:46.514787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.537815 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1962/3947] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:46.560286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.569467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:46.578302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965d160-9c61-4739-9cbc-3ceeeef45bcc service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.606169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.606839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.607117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.610049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.614452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.617395 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:46.617395 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:46.617395 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:46.621037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.643782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1986/3948] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 10:06:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:46.647640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.671220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc99a9-0356-44fb-899b-4717cd49fae8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.701104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.701941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.702440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.702833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.704060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3cd85b8666ac45ecbba76b6dea6d0b7c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.706113 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:46.706113 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:46.706113 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:46.707194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.724329 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1987/3949] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Oct 28 10:06:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c => generated 334 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:46.733610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.775371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c236-06e3-468e-9ab2-d8cac14f0a62 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.810837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.811519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.813814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.814392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.817354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3cd85b8666ac45ecbba76b6dea6d0b7c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.822041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.854741 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1988/3950] 10.222.0.16 () {58 vars in 1291 bytes} [Fri Oct 28 10:06:46 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c => generated 0 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 28 10:06:46.858613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.880888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77ad8d-ac1b-4b35-ac5b-9613a0600ed7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.883835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104eb353-24ec-46a6-b6ce-eb1d01cdfb41 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.892801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.893505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.894367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.894650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.895361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3cd85b8666ac45ecbba76b6dea6d0b7c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.896325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.897403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.897953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.898230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.899584 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:46.899584 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:46.899584 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:46.900441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.925463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.925463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.932945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1989/3951] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:06:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:46.936199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:46.959997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1963/3952] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:46.960487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999b9e-4018-48b1-b387-5b6a37616d27 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:46.978292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:46.978595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:46.980382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:46.980685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:46.981439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:46.983126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:46.989858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1990/3953] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 10:06:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:46.994363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.012355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31135-b9fc-4e1c-b805-f25d5ac2747c service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.033398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.034049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.034336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.034614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.035212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3cd85b8666ac45ecbba76b6dea6d0b7c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.036223 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:47.036223 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:47.036223 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:47.037740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Could not find Endpoint Group: 3cd85b8666ac45ecbba76b6dea6d0b7c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3cd85b8666ac45ecbba76b6dea6d0b7c. Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 28 10:06:47.064303 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3cd85b8666ac45ecbba76b6dea6d0b7c. Oct 28 10:06:47.065704 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:06:47.078838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.084688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1964/3954] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:06:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3cd85b8666ac45ecbba76b6dea6d0b7c => generated 120 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:06:47.094421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52886f5-5325-4b24-98e4-462b46787de8 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.109265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.109902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.110187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.110465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services/b23e2bc8a6c8454e93c827d7b83ffe6b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.111067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b23e2bc8a6c8454e93c827d7b83ffe6b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.112098 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:47.112098 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:47.112098 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:47.113061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.129466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:47.173751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1991/3955] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:47 2022] DELETE /identity/v3/services/b23e2bc8a6c8454e93c827d7b83ffe6b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:47.175012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.197821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104a2ba-cd4d-4423-9be6-e43ceffe6916 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.239338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.240296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.240769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.241234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.242078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.243889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.301565 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1965/3956] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:47 2022] POST /identity/v3/services => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:47.304979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.329849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c57d-caeb-4acb-9c6c-73428620136b tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.378396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.379232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.379567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.379850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.380514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.382678 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:47.382678 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:47.382678 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:47.386421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.416125 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1992/3957] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Oct 28 10:06:47 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:06:47.419810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.436255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3e1d-4851-46b9-aaf3-7272af20625a tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.460238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.463204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.463640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.467622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.469541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.482268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.525607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1966/3958] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:47 2022] POST /identity/v3/services => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:47.526204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.541826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e75e9-838f-4005-b52c-dcbff2871a59 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.642076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.642886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.643274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.643676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2d4ec2be52874f94b387c51894c4adba` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.644460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=2d4ec2be52874f94b387c51894c4adba)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.645623 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:47.645623 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:47.645623 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:47.652309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.689723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1993/3959] 10.222.0.16 () {60 vars in 1313 bytes} [Fri Oct 28 10:06:47 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/2d4ec2be52874f94b387c51894c4adba => generated 332 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:47.694412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.718659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913dc19-4a1c-4abe-8e85-9c4fb230d9fa tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.749406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.750000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.750307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.750554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services/b330b4e83c584f4bb5e5340d9baadab1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.753625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b330b4e83c584f4bb5e5340d9baadab1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.754611 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:47.754611 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:47.754611 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:47.755518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.845229 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1967/3960] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:47 2022] DELETE /identity/v3/services/b330b4e83c584f4bb5e5340d9baadab1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:47.849109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.864128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d5f83-7175-4eaf-b1b7-ba7ac82dfef4 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:47.926671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:47.927350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:47.928164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:47.928436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2d4ec2be52874f94b387c51894c4adba` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:47.934358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2d4ec2be52874f94b387c51894c4adba)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:47.935267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:47.975643 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1994/3961] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:06:47 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2d4ec2be52874f94b387c51894c4adba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:47.976068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:47.991010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a486ba3-bbb9-4762-a3e8-21e67d9a469f tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:48.012312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:48.013500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:48.013500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:48.013500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services/2f3db87ef8eb45079fa8d49e44da33a1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:48.013921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2f3db87ef8eb45079fa8d49e44da33a1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:48.015733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:48.086970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1968/3962] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:47 2022] DELETE /identity/v3/services/2f3db87ef8eb45079fa8d49e44da33a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:48.097562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:48.111185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c8b3-3b73-4d13-a0d4-71cd29c913dc tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:48.186315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:48.187235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:48.187235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:48.187623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/fa17d03588ba4ed0989c68d3e1641fff` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:48.188090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=fa17d03588ba4ed0989c68d3e1641fff)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:48.196395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:48.218648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1995/3963] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:06:48 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/fa17d03588ba4ed0989c68d3e1641fff => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:48.223127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:48.238194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538ae63-5b8b-4cd9-ab16-1db563b7bf88 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:48.259864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a0e0f7ea5c9421c8fe4524033aa1dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49232a9161f145b6ba910374f86484fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:48.260525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:48.260811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:48.261115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] PATH_INFO: `/v3/services/76cc1f10fffe4945a3b883d84b227294` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:48.261712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorizing `identity:delete_service(service_id=76cc1f10fffe4945a3b883d84b227294)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:48.263383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf23a4-985e-4f13-8afd-a21846cdce8d tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:48.323714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1969/3964] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:48 2022] DELETE /identity/v3/services/76cc1f10fffe4945a3b883d84b227294 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:06:48.328230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:48.546504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe299-8804-4163-8a51-731fa698dcd7 tempest-EndPointGroupsTest-2093832185 tempest-EndPointGroupsTest-2093832185-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:48.607217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:48.609595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:48.609930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:48.611765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] PATH_INFO: `/v3/users/34dfd359f2c347b691d08ff889b4b082` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:48.628001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34dfd359f2c347b691d08ff889b4b082)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:48.629663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:48.744273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34dfd359f2c347b691d08ff889b4b082'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:48.748346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34dfd359f2c347b691d08ff889b4b082'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:48.753756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:48.764984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34dfd359f2c347b691d08ff889b4b082'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:48.788246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34dfd359f2c347b691d08ff889b4b082'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:48.790655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34dfd359f2c347b691d08ff889b4b082'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:48.847277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:48.847549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:48.847825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:48.851501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1996/3965] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:48 2022] DELETE /identity/v3/users/34dfd359f2c347b691d08ff889b4b082 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:48.868670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:48.882227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:48.888043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:49.025278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1970/3966] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:49.038060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:49.041660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:49.288373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb68b9-b5e4-458c-9728-dcd1d4d449a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:49.292809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:49.293611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:49.293855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:49.294135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:49.307298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:49.310846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:49.349829 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1997/3967] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:49.841727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:49.843226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:49.867468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031bb19-58ac-4edb-a7c1-b05c70c05872 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:49.885419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:49.886077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:49.889127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:49.889411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] PATH_INFO: `/v3/projects/7bd1a9a33df846b193a3fb043c52ed02` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:49.892933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd1a9a33df846b193a3fb043c52ed02)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:49.896833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:50.014978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd1a9a33df846b193a3fb043c52ed02', 'request_id': 'req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.031018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd1a9a33df846b193a3fb043c52ed02', 'request_id': 'req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.042948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd1a9a33df846b193a3fb043c52ed02', 'request_id': 'req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.065025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] The token cache is being invalidate because project 7bd1a9a33df846b193a3fb043c52ed02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:50.065293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.066192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.070876 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1971/3968] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:49 2022] DELETE /identity/v3/projects/7bd1a9a33df846b193a3fb043c52ed02 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:50.074926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:50.090069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100bf2b-ac58-42d9-89c6-f3acc03d56c4 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:50.408075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:50.412752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:50.413180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:50.413796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] PATH_INFO: `/v3/users/3a0e0f7ea5c9421c8fe4524033aa1dd0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:50.415223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0e0f7ea5c9421c8fe4524033aa1dd0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:50.421009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:50.500512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:50.502343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:50.515265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0e0f7ea5c9421c8fe4524033aa1dd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.516425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0e0f7ea5c9421c8fe4524033aa1dd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.532362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0e0f7ea5c9421c8fe4524033aa1dd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.542722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0e0f7ea5c9421c8fe4524033aa1dd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.543908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0e0f7ea5c9421c8fe4524033aa1dd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:50.545461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:50.624519 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1998/3969] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:50 2022] DELETE /identity/v3/users/3a0e0f7ea5c9421c8fe4524033aa1dd0 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:50.728174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e00d-88fa-4865-b50c-a0b2ea6a7cc8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:50.838301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:50.857971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:50.859432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:50.859964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:50.860475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:50.862636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:50.879905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:50.885209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321739-3af7-4576-b227-9bc07101bf79 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:50.905494 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1972/3970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:51.492385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:51.494685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:51.777678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9ef3-39c3-4888-a84e-6738ff482249 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:51.797488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:51.798789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:51.799222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:51.801101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] PATH_INFO: `/v3/projects/49232a9161f145b6ba910374f86484fb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:51.803541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49232a9161f145b6ba910374f86484fb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:51.813062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:51.992342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49232a9161f145b6ba910374f86484fb', 'request_id': 'req-19a33c18-ccb6-4111-a607-fb11f92037e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:52.019012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49232a9161f145b6ba910374f86484fb', 'request_id': 'req-19a33c18-ccb6-4111-a607-fb11f92037e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:52.041943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49232a9161f145b6ba910374f86484fb', 'request_id': 'req-19a33c18-ccb6-4111-a607-fb11f92037e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:52.071265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] The token cache is being invalidate because project 49232a9161f145b6ba910374f86484fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:52.071859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:52.074041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19a33c18-ccb6-4111-a607-fb11f92037e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:52.086814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 1999/3971] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:51 2022] DELETE /identity/v3/projects/49232a9161f145b6ba910374f86484fb => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:52.092102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:52.092990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:52.093495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:52.142573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:52.150402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:52.401308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1973/3972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:52.403101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:52.403386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:52.403667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:52.478645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:52.497666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:52.536570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:52.539955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2000/3973] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:52.556300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04da13-be8d-498a-b2e6-fba2665175a2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:52.574426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:52.575488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:52.576049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:52.576541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:52.577463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:52.578006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:52.582670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:52.616796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1974/3974] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:52.620204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:52.632345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b4c62-0e64-4f57-92af-344b3afcb889 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:52.660084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:52.660352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:52.660673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:52.661025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:52.663095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:52.665146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:52.809357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:52.819588 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2001/3975] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:52 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:52.828077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf284-4555-4462-a191-a0d2aef02357 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:53.053822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:53.054492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.054842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.055194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.055915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:53.058005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:53.123161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1975/3976] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:52 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:53.128261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:53.150731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0594-0fb6-4b77-9df2-221148a3b468 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:53.170804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:53.171723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.172222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.172694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.173544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:53.175337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:53.199845 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2002/3977] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:53.203773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:53.218303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795f12-ec9c-4a0d-b43e-f08409970951 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:53.231639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:53.232570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.233058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.233490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.234312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:53.238914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5ab4f-8a3e-4c97-aaed-47a9b2bfcc3f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:53.265577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1976/3978] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:53.267382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:53.280150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed08d-0d8c-4005-8ed0-8de80a7ff085 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:53.296942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:53.297963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.298438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.298930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] PATH_INFO: `/v3/projects/ddd1230bc5c543b99c6d12dafc33a77b/users/fd224e18445f4377b7cef57d79fe0c55/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.335490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd1230bc5c543b99c6d12dafc33a77b, user_id=fd224e18445f4377b7cef57d79fe0c55, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:53.338766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:53.368851 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2003/3979] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:53 2022] PUT /identity/v3/projects/ddd1230bc5c543b99c6d12dafc33a77b/users/fd224e18445f4377b7cef57d79fe0c55/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:53.382821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.383168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.383366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.476134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] MFA Rules not processed for user `fd224e18445f4377b7cef57d79fe0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:53.477457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:53.603814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:53.650036 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1977/3980] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:53.655698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:53.668743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:53.834901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca9837-4145-44e1-a0e2-0de00493d930 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:53.860943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:53.865509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:53.865800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:53.869259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:53.869955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:53.881197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:53.928812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:53.935769 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2004/3981] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:06:53 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:53.941235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07aeb1-46f4-4778-87d6-b11402f4151b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.054646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.055601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.056064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.056511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.057422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.059538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.132539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1978/3982] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:53 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:54.134338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:54.149323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9f4f-890f-4035-aa44-fac8b11bfbb6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.161462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.162858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.163317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.163773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.165223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.167068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.217156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2005/3983] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:54.221531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:54.239373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f751-c957-4b29-9181-218bdc8b84e2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.269766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.274288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.274862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.275377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] PATH_INFO: `/v3/projects/38616cd29ae9448186210229f856e77d/users/2e453c2443f94767964de3733c5611fa/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.345871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38616cd29ae9448186210229f856e77d, user_id=2e453c2443f94767964de3733c5611fa, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.353623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.416373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1979/3984] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:54 2022] PUT /identity/v3/projects/38616cd29ae9448186210229f856e77d/users/2e453c2443f94767964de3733c5611fa/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:54.420277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:54.433596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3dd8-b3ab-4635-be56-e6e8b8ae221f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.540887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.541612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.541890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.542162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.542810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.544428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822693f-4dfe-4e37-8816-8206b768d682 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.556603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2006/3985] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:54.560232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:54.574389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0994a-64eb-40f3-9fa2-a98764a8bb21 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.590185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.590896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.591177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.591462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] PATH_INFO: `/v3/projects/38616cd29ae9448186210229f856e77d/users/2e453c2443f94767964de3733c5611fa/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.593675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38616cd29ae9448186210229f856e77d, user_id=2e453c2443f94767964de3733c5611fa, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.596360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.628829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1980/3986] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:06:54 2022] PUT /identity/v3/projects/38616cd29ae9448186210229f856e77d/users/2e453c2443f94767964de3733c5611fa/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:54.641201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.642189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.642704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.755068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] MFA Rules not processed for user `2e453c2443f94767964de3733c5611fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:54.757279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:54.920521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2007/3987] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:54.924817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:54.952156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28284e-bec7-4607-969c-a7301455e892 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:54.957188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:54.957809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:54.958089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:54.958584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:54.959649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:54.961013 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:54.961013 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:54.961013 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:54.961912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:54.994677 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1981/3988] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:06:54 2022] POST /identity/v3/domains => generated 275 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:54.999006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.005532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:55.014581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753a93e-10d9-41b0-b07a-0dbb56f5c32f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.185394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.188302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.190930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.191472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.194961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.198867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.253732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.266371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf2b6-4120-45b3-a994-013c4fd00574 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.267121 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2008/3989] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:54 2022] POST /identity/v3/users => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:55.272337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.273282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.273644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.273967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.274800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.277660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.331631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1982/3990] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:06:55 2022] POST /identity/v3/users => generated 322 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:06:55.337457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.352318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9498c3-7c93-4f8a-a1d0-b56f688d8585 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.359099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.359971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.360424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.360974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users/bf5cf99227e0479b9fde2f1eb4c0be95` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.401620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:get_user(user_id=bf5cf99227e0479b9fde2f1eb4c0be95)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.403812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.406355 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2009/3991] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:06:55 2022] GET /identity/v3/users/bf5cf99227e0479b9fde2f1eb4c0be95 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:55.412560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.434566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261b46-6b7c-4b0c-b4f9-4832a802c00c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.454789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.456269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.456561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.456845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.461669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Adding query filter params (domain_id=18cea6cea48d41e0b1f211beaa6369bd) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:55.462152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.465420 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:55.465420 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:55.465420 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:55.469169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.550091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1983/3992] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Oct 28 10:06:55 2022] GET /identity/v3/users?domain_id=18cea6cea48d41e0b1f211beaa6369bd => generated 483 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:55.554362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.575976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569129-8f22-4269-9077-b1f5e2fec527 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.594655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.595292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.595570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.595843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.596546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.600874 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:55.600874 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:55.600874 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:55.605491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.714612 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2010/3993] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:06:55 2022] GET /identity/v3/users => generated 8581 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:06:55.715386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.727382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc1b5-0850-4123-88a9-ef99f8a6d841 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.742360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.742994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.743276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.743547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.744252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1651922866) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:55.744765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:55.746815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:55.912711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:55.918467 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1984/3994] 10.222.0.16 () {58 vars in 1189 bytes} [Fri Oct 28 10:06:55 2022] GET /identity/v3/users?name=tempest-test_user-1651922866 => generated 474 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:55.934235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d9ad-c86d-422a-bc72-7da80f43fff6 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:55.992110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:55.993143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:55.993333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:55.993493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:55.997179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:06:55.999437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:56.001339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:56.080263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:56.101371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2011/3995] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 10:06:55 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:06:56.111080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f879c-96ae-4d62-9d07-5b9ab053e43f tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:56.116453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:56.117140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:56.117425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:56.117700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users/95df9e4ac76143238625179cd365317c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:56.162133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:delete_user(user_id=95df9e4ac76143238625179cd365317c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:56.164186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:56.254911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:INSERT=9,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:56.298507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95df9e4ac76143238625179cd365317c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.301130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95df9e4ac76143238625179cd365317c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.303914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95df9e4ac76143238625179cd365317c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.319761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95df9e4ac76143238625179cd365317c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.337118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95df9e4ac76143238625179cd365317c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.369471 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1985/3996] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:56 2022] DELETE /identity/v3/users/95df9e4ac76143238625179cd365317c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:56.373105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:56.375523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:56.396548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15dd2f-3ef4-41c6-a5c5-8debf850d680 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:56.507170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:56.507869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:56.508141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:56.508529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/users/bf5cf99227e0479b9fde2f1eb4c0be95` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:56.509756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bf5cf99227e0479b9fde2f1eb4c0be95)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:56.513698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:56.590839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5cf99227e0479b9fde2f1eb4c0be95'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.591815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5cf99227e0479b9fde2f1eb4c0be95'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.593882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:56.608543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5cf99227e0479b9fde2f1eb4c0be95'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.627484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5cf99227e0479b9fde2f1eb4c0be95'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.628253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5cf99227e0479b9fde2f1eb4c0be95'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.673482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2012/3997] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:56 2022] DELETE /identity/v3/users/bf5cf99227e0479b9fde2f1eb4c0be95 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:06:56.677934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:56.696862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a35e-c26f-430e-abb6-e59a478d5447 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:56.868506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:56.869328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:56.869714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:56.870089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/domains/18cea6cea48d41e0b1f211beaa6369bd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:56.873573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=18cea6cea48d41e0b1f211beaa6369bd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:56.875103 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:56.875103 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:06:56.875103 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:06:56.876760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:56.943397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.944526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.997959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:56.998723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.004175 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1986/3998] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:06:56 2022] PATCH /identity/v3/domains/18cea6cea48d41e0b1f211beaa6369bd => generated 276 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:06:57.005593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:57.007126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:57.040541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1ac1-da7d-4135-bea4-9faf043ec76c tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:57.241743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e453c2443f94767964de3733c5611fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38616cd29ae9448186210229f856e77d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:57.242404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:57.242687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:57.242962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] PATH_INFO: `/v3/domains/18cea6cea48d41e0b1f211beaa6369bd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:57.290110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=18cea6cea48d41e0b1f211beaa6369bd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:57.291106 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:06:57.291106 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:06:57.291106 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:06:57.292034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:57.418955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.435359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.545218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.559369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.576534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.612732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] The token cache is being invalidate because project 18cea6cea48d41e0b1f211beaa6369bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:06:57.613158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.613869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.653901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.665656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.666555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8c107843-11b5-46d9-85ba-22b8c0b7822b tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '18cea6cea48d41e0b1f211beaa6369bd', 'request_id': 'req-8c107843-11b5-46d9-85ba-22b8c0b7822b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:57.685244 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2013/3999] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:06:57 2022] DELETE /identity/v3/domains/18cea6cea48d41e0b1f211beaa6369bd => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:57.685523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:57.687495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:57.908596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e354-ff93-4a71-8392-dbb484bb1083 tempest-UsersV3TestJSON-979393280 tempest-UsersV3TestJSON-979393280-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:57.946546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:58.096392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:58.097083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:58.097363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:58.098061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] PATH_INFO: `/v3/users/fd224e18445f4377b7cef57d79fe0c55` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:58.099487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd224e18445f4377b7cef57d79fe0c55)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:58.102978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:58.193863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd224e18445f4377b7cef57d79fe0c55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:58.194856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd224e18445f4377b7cef57d79fe0c55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:58.195969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd224e18445f4377b7cef57d79fe0c55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:58.209680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd224e18445f4377b7cef57d79fe0c55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:58.246322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd224e18445f4377b7cef57d79fe0c55'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:06:58.284517 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1987/4000] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:06:57 2022] DELETE /identity/v3/users/fd224e18445f4377b7cef57d79fe0c55 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:06:58.289119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca45f-a89f-462c-ab56-184011ef211f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:58.289611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca45f-a89f-462c-ab56-184011ef211f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:58.289785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca45f-a89f-462c-ab56-184011ef211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:58.299657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=2,keystone:DELETE=14,keystone:SELECT=84 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:58.346270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f7ca45f-a89f-462c-ab56-184011ef211f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:58.347953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f7ca45f-a89f-462c-ab56-184011ef211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:58.503971 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2014/4001] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:58.564092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:58.565383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:58.719031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223d3a4-c441-4881-9bf8-d6f3a7eabf23 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:58.732472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:58.733139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:58.733416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:58.733683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:58.783082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:58.807895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:58.845561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1988/4002] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:59.267773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:59.268767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:59.269311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:59.319734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:59.325722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:59.488926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2015/4003] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:59.508752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:59.511466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:59.602326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:59.693234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd762-c6a4-44be-a921-2062c6b8ab58 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:59.701806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:59.702462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:59.702731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:59.703193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:59.721913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:59.724731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9816db-cb52-4b1c-bb8f-585cb64def53 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:59.748569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1989/4004] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:00.895823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:00.899865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:00.946447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e870b3-9fcd-4760-b5b8-a3d3ec30630e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:00.963605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:00.966185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:00.966440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:00.968569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] PATH_INFO: `/v3/projects/ddd1230bc5c543b99c6d12dafc33a77b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:00.975181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd1230bc5c543b99c6d12dafc33a77b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:00.980075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:01.040451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:01.040989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:01.041249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:01.079291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:01.083430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:01.122186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd1230bc5c543b99c6d12dafc33a77b', 'request_id': 'req-2da4953e-f7b7-4dfc-9539-1db91fb9a281'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.138453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd1230bc5c543b99c6d12dafc33a77b', 'request_id': 'req-2da4953e-f7b7-4dfc-9539-1db91fb9a281'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.152509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd1230bc5c543b99c6d12dafc33a77b', 'request_id': 'req-2da4953e-f7b7-4dfc-9539-1db91fb9a281'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.173097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] The token cache is being invalidate because project ddd1230bc5c543b99c6d12dafc33a77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:01.173393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.174440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.176520 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2016/4005] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:00 2022] DELETE /identity/v3/projects/ddd1230bc5c543b99c6d12dafc33a77b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:01.181810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:01.183576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:01.245323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1990/4006] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:01.266157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:01.266456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:01.268202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:01.376254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4953e-f7b7-4dfc-9539-1db91fb9a281 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:01.382309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:01.383142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:01.383423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:01.383696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] PATH_INFO: `/v3/users/2e453c2443f94767964de3733c5611fa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:01.385769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e453c2443f94767964de3733c5611fa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:01.392438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:01.467250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6f27-0ed2-405b-89e0-5b49f0fedab5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:01.498075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:01.503288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:01.503824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:01.504449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:01.545765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:01.549846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:01.554325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e453c2443f94767964de3733c5611fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.556395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e453c2443f94767964de3733c5611fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.573882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e453c2443f94767964de3733c5611fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.605130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e453c2443f94767964de3733c5611fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.610776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-93e7cf47-7833-4842-a669-15ebecfc9071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e453c2443f94767964de3733c5611fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:01.624204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1991/4007] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:07:01.683524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2017/4008] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:01 2022] DELETE /identity/v3/users/2e453c2443f94767964de3733c5611fa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:02.903003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:02.934678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa00f7-5e5f-46ed-9682-b49d66701467 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.043256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:03.063015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.064852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.065609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.066738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] PATH_INFO: `/v3/projects/38616cd29ae9448186210229f856e77d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.073301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38616cd29ae9448186210229f856e77d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.075828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.187560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38616cd29ae9448186210229f856e77d', 'request_id': 'req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:03.200018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38616cd29ae9448186210229f856e77d', 'request_id': 'req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:03.220548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38616cd29ae9448186210229f856e77d', 'request_id': 'req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:03.256292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] The token cache is being invalidate because project 38616cd29ae9448186210229f856e77d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:03.261669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:03.265609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ccdddd0-91d8-491f-ad2e-a5ecd69826d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:03.271373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1992/4009] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:02 2022] DELETE /identity/v3/projects/38616cd29ae9448186210229f856e77d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:03.275999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.276503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.276642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.308078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:03.309370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:03.464952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2018/4010] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:03.471889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.472181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.472667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.498646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:03.500409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:03.512953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1993/4011] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:03.517280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.561393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e627-d64b-4095-9efa-f17907b28947 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.572311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.573760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.575592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.578733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.580628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:03.583747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.588598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.611516 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2019/4012] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:03.616503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.629439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51bb2-6160-496d-91b4-cfd596b2cdc7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.639821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.640951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.641417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.641875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.642870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.646060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.703910 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1994/4013] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:03 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:07:03.708013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.723641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240cbaf-0c13-4110-8010-e988a8cb448f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.763397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.765296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:03.796041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:03.866357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.868060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.868557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.869168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.870148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.872668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.905195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2020/4014] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:03 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:03.909435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.929167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830fc61-c812-403d-9a53-29a389f76a0d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.936322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.937628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.938182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.939021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.940261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.942874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.957575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884cb7-39b3-4684-a4c3-6721aa0efe46 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.973944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2021/4015] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:03.985670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.994874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.995515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.995793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.996062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.002853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:04.014340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd273c2-0b81-47d7-aae0-bf1f6c3d14c1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.040896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.041540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.041818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.042087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.042736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.044332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8777e-f669-49ba-8395-4a1edb36765c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.045142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.046710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.065214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1995/4016] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:07:04.079249 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2022/4017] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:04.083069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:04.095998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de77e90-aa16-4a96-a97f-2c4fc2f878e1 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.104829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.105557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.106037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.106622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] PATH_INFO: `/v3/projects/3a8a6642a30545e48d3990324f77458e/users/ea9c5b2fb8a84fc38280562dcd3081cb/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.142150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8a6642a30545e48d3990324f77458e, user_id=ea9c5b2fb8a84fc38280562dcd3081cb, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.145057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.185819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1996/4018] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:04 2022] PUT /identity/v3/projects/3a8a6642a30545e48d3990324f77458e/users/ea9c5b2fb8a84fc38280562dcd3081cb/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:04.282196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184321b-f218-415a-b993-3188630d4584 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.282783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184321b-f218-415a-b993-3188630d4584 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.282783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184321b-f218-415a-b993-3188630d4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.321185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1184321b-f218-415a-b993-3188630d4584 None None] MFA Rules not processed for user `ea9c5b2fb8a84fc38280562dcd3081cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:04.322577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1184321b-f218-415a-b993-3188630d4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:04.437972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:04.443390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2023/4019] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:04.463784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:04.622645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c737b6-0fc7-498c-9f36-dd682832db51 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.639660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.641290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.641648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.642331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.643567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.647403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.703872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.704205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.704725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.721293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1997/4020] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:04 2022] POST /identity/v3/projects => generated 367 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:07:04.725483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:04.752044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:04.753393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:04.887169 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2024/4021] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:04.891564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9ae5-0c73-4ab5-ae3b-6b4b2fabfb56 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.904258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.904884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.905184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.905452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.909739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.915491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.950448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1998/4022] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:04 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:04.958146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:04.971305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799125f2-6e54-435c-96fb-974ddc75c1c1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.991644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.992276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.992557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.993467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.994318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.997403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.025142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2025/4023] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:05.029632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.048922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c00b-d9ff-4b10-b85c-c2eac5628929 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.057166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.058117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.062307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.062307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] PATH_INFO: `/v3/projects/f4d20e68e2454c64afcd5b9dfee69012/users/547bb1aa4db748d2a068e25526894d04/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.095432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d20e68e2454c64afcd5b9dfee69012, user_id=547bb1aa4db748d2a068e25526894d04, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:05.100897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.128938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 1999/4024] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:05 2022] PUT /identity/v3/projects/f4d20e68e2454c64afcd5b9dfee69012/users/547bb1aa4db748d2a068e25526894d04/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:05.133922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.147612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45424fcf-7cf6-4f83-89ce-0e06262125ad admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.158555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:05.275996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.279585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.279585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.279585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.279585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:05.280739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b661-d19c-43ac-9515-801b090abd95 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.301005 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2026/4025] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:05.301954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.324052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed8d03-0058-4ad2-b68d-3ad64bbbc283 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.339787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.340634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.340939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.341216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] PATH_INFO: `/v3/projects/f4d20e68e2454c64afcd5b9dfee69012/users/547bb1aa4db748d2a068e25526894d04/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.350403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d20e68e2454c64afcd5b9dfee69012, user_id=547bb1aa4db748d2a068e25526894d04, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:05.353333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.378293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2000/4026] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:05 2022] PUT /identity/v3/projects/f4d20e68e2454c64afcd5b9dfee69012/users/547bb1aa4db748d2a068e25526894d04/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:05.389639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.390118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.390746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.452969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] MFA Rules not processed for user `547bb1aa4db748d2a068e25526894d04`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:05.459918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:05.622911 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2027/4027] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:05.623566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.639481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70d8bb-d322-438a-8ad1-7bb3242ae961 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.660358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.661351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.661646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.662085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.662729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:05.664604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.745080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2001/4028] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:05 2022] POST /identity/v3/projects => generated 358 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:05.748216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.762005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db210a-20dc-4739-ba7f-b5dba1133486 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.864942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.865867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.866557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.867015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:05.867680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:05.869679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:05.872222 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.common [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 10:07:05.935736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:05.942533 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2028/4029] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:05 2022] POST /identity/v3/users => generated 410 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:05.948328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc1aa-cf42-4ffb-90ad-4fd50a7409b7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:05.960562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:05.962589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:05.963076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:05.963831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/users/3a01824e89d34371b6092c3940efd117` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:06.029777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_user(user_id=3a01824e89d34371b6092c3940efd117)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:06.039473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:06.044001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2002/4030] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:07:05 2022] GET /identity/v3/users/3a01824e89d34371b6092c3940efd117 => generated 410 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:06.048474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:06.075657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7e13e-8d26-49ce-bc1c-26f32d050c14 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:06.084319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:06.085021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:06.085457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:06.085741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/users/3a01824e89d34371b6092c3940efd117` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:06.087077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3a01824e89d34371b6092c3940efd117)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:06.089734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:06.156837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:06.279266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a01824e89d34371b6092c3940efd117'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.281469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a01824e89d34371b6092c3940efd117'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.318707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a01824e89d34371b6092c3940efd117'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.330338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a01824e89d34371b6092c3940efd117'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.331208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a01824e89d34371b6092c3940efd117'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.442712 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2029/4031] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:06 2022] DELETE /identity/v3/users/3a01824e89d34371b6092c3940efd117 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:06.446747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:06.449409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:06.469513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb609c-388d-48ef-9036-2d5773996944 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:06.477267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:06.644309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:06.644806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:06.645670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:06.645950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/334efd2cb318465b9908c707b1325b7e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:06.662816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=334efd2cb318465b9908c707b1325b7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:06.667509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:06.794891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334efd2cb318465b9908c707b1325b7e', 'request_id': 'req-f6e897f3-e804-4889-9eb4-22cbbc55628e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.838560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334efd2cb318465b9908c707b1325b7e', 'request_id': 'req-f6e897f3-e804-4889-9eb4-22cbbc55628e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.853395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334efd2cb318465b9908c707b1325b7e', 'request_id': 'req-f6e897f3-e804-4889-9eb4-22cbbc55628e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.871512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 334efd2cb318465b9908c707b1325b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:06.872498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.874733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:06.880986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2003/4032] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:06 2022] DELETE /identity/v3/projects/334efd2cb318465b9908c707b1325b7e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:06.884755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:06.902418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480786e-acd1-4e9d-a6c3-0273c41aa86c tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:07.038140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:07.038926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:07.039300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:07.039674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:07.040488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:07.042375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:07.079457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2030/4033] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:06 2022] POST /identity/v3/projects => generated 348 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:07.081426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:07.084594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:07.105147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e897f3-e804-4889-9eb4-22cbbc55628e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:07.235847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:07.236826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:07.237316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:07.237770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:07.238631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:07.240511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:07.241778 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:07.241778 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:07:07.241778 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:07:07.243616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:07.284025 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2004/4034] 10.222.0.16 () {58 vars in 1160 bytes} [Fri Oct 28 10:07:07 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:07.285342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:07.299980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09999f2d-e3db-4251-983b-d142fb17a1c2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:07.316162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:07.316879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:07.320918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:07.321458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:07.322012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:07.323720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:07.409618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2031/4035] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 10:07:07 2022] GET /identity/v3/domains => generated 829 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:07.414346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:07.431237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e174-f4c9-40fe-8e97-1f4c65ab1912 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:07.444988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:07.449451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:07.454334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:07.455515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/43e8959078a94a159c3c0d97d549691f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:07.459986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_project(project_id=43e8959078a94a159c3c0d97d549691f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:07.462906 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:07.462906 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:07:07.462906 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:07:07.466067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:07.512270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:07.513890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:07.568487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:07.581948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:07.582977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:07.602630 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2005/4036] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:07:07 2022] PATCH /identity/v3/projects/43e8959078a94a159c3c0d97d549691f => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:07.604343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:07.608554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:07.647266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ccf8-07e0-4d3c-955f-75f4884313a9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:07.830778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:07.831561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:07.836078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:07.837058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/43e8959078a94a159c3c0d97d549691f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:07.865408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43e8959078a94a159c3c0d97d549691f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:07.868689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:07.888827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:07.922937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:07.928935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '43e8959078a94a159c3c0d97d549691f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.228874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.243191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.258820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.294341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 43e8959078a94a159c3c0d97d549691f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:08.294644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.297942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.323382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.327890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.328819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '43e8959078a94a159c3c0d97d549691f', 'request_id': 'req-a792b05e-eb29-4395-b732-d15ff133d0d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.356657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2032/4037] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:07 2022] DELETE /identity/v3/projects/43e8959078a94a159c3c0d97d549691f => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:08.358335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:08.374871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bfd6b-8db8-404d-9fbf-2dc704f70793 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:08.609673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:08.610332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:08.610694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:08.610978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:08.612013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:08.614948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:08.700783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2006/4038] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:08 2022] POST /identity/v3/projects => generated 360 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:08.704790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:08.708091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:08.732735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b05e-eb29-4395-b732-d15ff133d0d0 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:08.818506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:08.819167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:08.819444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:08.819713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/b384afabbc6845c4993625dff3f71957` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:08.820944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=b384afabbc6845c4993625dff3f71957)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:08.823228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:08.825366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2033/4039] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:08 2022] GET /identity/v3/projects/b384afabbc6845c4993625dff3f71957 => generated 360 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:08.829382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:08.847135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834c6de-dcb2-4440-b4ef-f7bb570e493e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:08.853117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:08.853848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:08.854441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:08.854744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/b384afabbc6845c4993625dff3f71957` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:08.856093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b384afabbc6845c4993625dff3f71957)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:08.858616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:08.928545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b384afabbc6845c4993625dff3f71957', 'request_id': 'req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.935654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b384afabbc6845c4993625dff3f71957', 'request_id': 'req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.947235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b384afabbc6845c4993625dff3f71957', 'request_id': 'req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.964527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project b384afabbc6845c4993625dff3f71957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:08.965086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.965975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:08.968314 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2007/4040] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:08 2022] DELETE /identity/v3/projects/b384afabbc6845c4993625dff3f71957 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:08.975125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:08.977950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:08.994424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5d21c-1f7e-46c6-88bf-b76062a299f6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:09.062397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:09.072337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:09.072337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:09.072337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:09.072858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:09.073819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:09.076830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:09.119123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2034/4041] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:08 2022] POST /identity/v3/projects => generated 359 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:09.124389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:09.142890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd010a3-687e-4d6d-8ba8-41e6dc3d6dc7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:09.300252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:09.300841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:09.301778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:09.302291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/433b523fa63b4f9981483c9aa486f892` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:09.304251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=433b523fa63b4f9981483c9aa486f892)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:09.308981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:09.317027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:09.322385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2008/4042] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:09 2022] GET /identity/v3/projects/433b523fa63b4f9981483c9aa486f892 => generated 359 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:09.336805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07650f-9a3b-4a17-b845-1f2138715556 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:09.356784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:09.357467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:09.357749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:09.358257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/433b523fa63b4f9981483c9aa486f892` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:09.360014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=433b523fa63b4f9981483c9aa486f892)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:09.362181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:09.509008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433b523fa63b4f9981483c9aa486f892', 'request_id': 'req-c4126310-cc22-44ab-b30c-11d3ec2d85ba'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:09.542402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433b523fa63b4f9981483c9aa486f892', 'request_id': 'req-c4126310-cc22-44ab-b30c-11d3ec2d85ba'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:09.572811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433b523fa63b4f9981483c9aa486f892', 'request_id': 'req-c4126310-cc22-44ab-b30c-11d3ec2d85ba'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:09.623653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 433b523fa63b4f9981483c9aa486f892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:09.624013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:09.624749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:09.628960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2035/4043] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:09 2022] DELETE /identity/v3/projects/433b523fa63b4f9981483c9aa486f892 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:09.632613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:09.634824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:09.656493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865014-f56f-47ef-91a9-9e51608eaeb5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:09.676432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:09.819690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:09.820723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:09.821260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:09.821793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:09.822649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:09.826216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:09.876000 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2009/4044] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:09 2022] POST /identity/v3/projects => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:09.880412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:09.894102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4126310-cc22-44ab-b30c-11d3ec2d85ba tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:09.971239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:09.972848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:09.973415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:09.973985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/8366b770e99640ebbe7733d2e87e2455` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:09.975366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=8366b770e99640ebbe7733d2e87e2455)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:09.978159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:09.980085 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2036/4045] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:09 2022] GET /identity/v3/projects/8366b770e99640ebbe7733d2e87e2455 => generated 347 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:09.984554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:09.997464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332c6b4-70a8-458d-af0b-4585e7eb1c03 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:10.003468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:10.006296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:10.006881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:10.007642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/8366b770e99640ebbe7733d2e87e2455` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:10.009159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8366b770e99640ebbe7733d2e87e2455)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:10.012315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:10.098043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8366b770e99640ebbe7733d2e87e2455', 'request_id': 'req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.105368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8366b770e99640ebbe7733d2e87e2455', 'request_id': 'req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.122492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8366b770e99640ebbe7733d2e87e2455', 'request_id': 'req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.140484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 8366b770e99640ebbe7733d2e87e2455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:10.141202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.142329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.150549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:10.151805 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2010/4046] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:09 2022] DELETE /identity/v3/projects/8366b770e99640ebbe7733d2e87e2455 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:10.153132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:10.170943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a78293-1256-4718-ad32-2b54d05b150d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:10.239965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:10.240956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:10.241595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:10.242045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:10.242879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:10.244208 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:10.244208 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:10.244208 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:10.246194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:10.263233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:10.278479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:10.284359 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2037/4047] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:07:10 2022] POST /identity/v3/domains => generated 277 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:10.297847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f3c5-8cb4-4c77-b9d1-167df4b9a418 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:10.463704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:10.465134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:10.465692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:10.466203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:10.467084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:10.469672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:10.514439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:10.535573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2011/4048] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:10 2022] POST /identity/v3/projects => generated 403 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:07:10.539116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:10.571506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6260d-64d2-4bfa-9858-df3b4dd1ef0d tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:10.772308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:10.774740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:10.776334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:10.776874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/3a2692fc3997485fb4bec641f6609fd4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:10.778404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=3a2692fc3997485fb4bec641f6609fd4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:10.780936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:10.785644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2038/4049] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:10 2022] GET /identity/v3/projects/3a2692fc3997485fb4bec641f6609fd4 => generated 403 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:10.789383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:10.805090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d3e73-9438-48ce-add5-b0be15181dd5 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:10.812503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:10.814074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:10.829183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:10.829519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/3a2692fc3997485fb4bec641f6609fd4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:10.835958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a2692fc3997485fb4bec641f6609fd4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:10.837980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:10.962303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2692fc3997485fb4bec641f6609fd4', 'request_id': 'req-110a2379-e275-49fd-94d0-5870fd44d22f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:10.981642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2692fc3997485fb4bec641f6609fd4', 'request_id': 'req-110a2379-e275-49fd-94d0-5870fd44d22f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.006526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2692fc3997485fb4bec641f6609fd4', 'request_id': 'req-110a2379-e275-49fd-94d0-5870fd44d22f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.025736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 3a2692fc3997485fb4bec641f6609fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:11.026393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.028048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.030309 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2012/4050] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:10 2022] DELETE /identity/v3/projects/3a2692fc3997485fb4bec641f6609fd4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:11.034801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:11.038838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:11.078198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e063447-2506-4e75-91fb-4149d6439a7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:11.187736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:11.189087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:11.189576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:11.194320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/c208387c4af7407abf1edc7a986f5ae8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:11.197848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c208387c4af7407abf1edc7a986f5ae8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:11.207568 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:11.207568 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:11.207568 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:11.210444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:11.294193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.295691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.401341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.403075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.406803 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2039/4051] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:07:11 2022] PATCH /identity/v3/domains/c208387c4af7407abf1edc7a986f5ae8 => generated 278 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:11.410259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:11.423388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2379-e275-49fd-94d0-5870fd44d22f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:11.743660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:11.744334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:11.744613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:11.744882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/c208387c4af7407abf1edc7a986f5ae8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:11.782544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c208387c4af7407abf1edc7a986f5ae8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:11.784077 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:11.784077 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:07:11.784077 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:07:11.784537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:11.861813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:11.878905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.054867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:12.064733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.103910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.135855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.168955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project c208387c4af7407abf1edc7a986f5ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:12.169269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.170045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.209180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.217162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.217925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c208387c4af7407abf1edc7a986f5ae8', 'request_id': 'req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:12.237560 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2013/4052] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:11 2022] DELETE /identity/v3/domains/c208387c4af7407abf1edc7a986f5ae8 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:12.244047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:12.245865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:12.273577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f531-4e82-4ab9-a249-8ba45e0c67d1 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:12.470086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:12.470828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:12.471402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:12.472039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:12.475095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:12.480136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:12.509139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2040/4053] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:07:12 2022] POST /identity/v3/domains => generated 277 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:12.513596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:12.517085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:12.572594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4c3a-4b7e-4029-a70d-d2f2dc7f0744 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:12.762371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:12.763004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:12.763332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:12.765906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:12.765906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:12.766344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:12.843725 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2014/4054] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:12 2022] POST /identity/v3/projects => generated 410 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:12.846843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:12.853926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:12.863476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e954-6868-4ed3-b3fe-6a1f04ba75db tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:12.984537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:12.986385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:12.986684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:12.986962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:12.995158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:13.003073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:13.053140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2041/4055] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:12 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:13.057181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:13.075542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bf42-e214-4ee3-8667-88169a04ed81 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:13.177018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:13.177695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:13.180299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:13.180578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/87fb3ef9cd6b4b029ecf884fdd95f360` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:13.184932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87fb3ef9cd6b4b029ecf884fdd95f360)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:13.193746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:13.248529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:13.266800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fb3ef9cd6b4b029ecf884fdd95f360', 'request_id': 'req-8213cdda-596a-43f0-965a-eada1ff3d3ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.274976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fb3ef9cd6b4b029ecf884fdd95f360', 'request_id': 'req-8213cdda-596a-43f0-965a-eada1ff3d3ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.284795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fb3ef9cd6b4b029ecf884fdd95f360', 'request_id': 'req-8213cdda-596a-43f0-965a-eada1ff3d3ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.308457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 87fb3ef9cd6b4b029ecf884fdd95f360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:13.308869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.309896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.313478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2015/4056] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:13 2022] DELETE /identity/v3/projects/87fb3ef9cd6b4b029ecf884fdd95f360 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:13.319418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:13.322094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:13.339259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7117cf-1b8a-4f7e-8288-c28203bc78bb tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:13.448093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:13.450195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:13.453639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:13.454213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/3ab16be7176044c8850fb8dace6796c9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:13.456470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ab16be7176044c8850fb8dace6796c9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:13.465088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:13.559295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab16be7176044c8850fb8dace6796c9', 'request_id': 'req-03991223-a1bf-4b0d-94a2-e3498df99d7e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.567289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab16be7176044c8850fb8dace6796c9', 'request_id': 'req-03991223-a1bf-4b0d-94a2-e3498df99d7e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.592303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab16be7176044c8850fb8dace6796c9', 'request_id': 'req-03991223-a1bf-4b0d-94a2-e3498df99d7e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.623143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 3ab16be7176044c8850fb8dace6796c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:13.624316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.625193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.627240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2042/4057] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:13 2022] DELETE /identity/v3/projects/3ab16be7176044c8850fb8dace6796c9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:13.632136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:13.643979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cdda-596a-43f0-965a-eada1ff3d3ca tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:13.757045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:13.757764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:13.757993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:13.758677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/a269db93a6d24c8a85bf1483dae1037b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:13.759742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a269db93a6d24c8a85bf1483dae1037b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:13.761597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:13.834501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.835255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.873688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.874758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b4cef2c-e8ca-44e0-a441-eb45184376e2 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:13.879904 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2016/4058] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:07:13 2022] PATCH /identity/v3/domains/a269db93a6d24c8a85bf1483dae1037b => generated 278 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:13.884694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:13.887257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:13.921304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03991223-a1bf-4b0d-94a2-e3498df99d7e tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:13.937055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:14.057032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:14.058103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.058424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.058824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/a269db93a6d24c8a85bf1483dae1037b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.077475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a269db93a6d24c8a85bf1483dae1037b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:14.079578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:14.114104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.128114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.268053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.270442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.271374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.271605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.284428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.302775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.309373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:14.311367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:14.338120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project a269db93a6d24c8a85bf1483dae1037b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:14.338712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.339617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.359163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.385253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.387763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a269db93a6d24c8a85bf1483dae1037b', 'request_id': 'req-9cfbd809-affa-45ff-99f0-94e33890779b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:14.403920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2043/4059] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:13 2022] DELETE /identity/v3/domains/a269db93a6d24c8a85bf1483dae1037b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:14.411850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:14.415175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:14.466930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2017/4060] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:14.493100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:14.494149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:14.555647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:14.591521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd809-affa-45ff-99f0-94e33890779b tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:14.605093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:14.618477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:14.619323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.619695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.620083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.621055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:14.624520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:14.697632 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2044/4061] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:14.701505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:14.709367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738ba5a-9ee8-4298-86d9-aa88679fec62 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:14.885122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd134-d528-4986-b149-617793338363 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:14.896971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:14.897956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.897956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.898206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/9dae52e1e1714524a0d47ca62639b969` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.901004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=9dae52e1e1714524a0d47ca62639b969)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:14.903543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:14.911063 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2045/4062] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:14 2022] GET /identity/v3/projects/9dae52e1e1714524a0d47ca62639b969 => generated 377 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:14.912537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:14.918163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:14.918813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.919093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.919369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.930812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eec3b3-c829-4637-866c-fe1b306a7320 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:14.947522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:14.947784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:14.948051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:14.948315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:14.949417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:14.951127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.012362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2046/4063] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:07:14 2022] GET /identity/v3/projects => generated 6578 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:15.016370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:15.038974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0aaa2-0f44-45d5-8531-73bc1cb56e47 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:15.043695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.047150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.048723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:15.049403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.049686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.050121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/9dae52e1e1714524a0d47ca62639b969` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.062170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dae52e1e1714524a0d47ca62639b969)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.064072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.068032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2018/4064] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:07:15.171934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dae52e1e1714524a0d47ca62639b969', 'request_id': 'req-9017a865-a1ce-4364-bb69-73c6b65b167a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.179459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dae52e1e1714524a0d47ca62639b969', 'request_id': 'req-9017a865-a1ce-4364-bb69-73c6b65b167a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.191263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dae52e1e1714524a0d47ca62639b969', 'request_id': 'req-9017a865-a1ce-4364-bb69-73c6b65b167a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.216949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 9dae52e1e1714524a0d47ca62639b969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:15.216949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.218573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.222538 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2047/4065] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:15 2022] DELETE /identity/v3/projects/9dae52e1e1714524a0d47ca62639b969 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:15.227834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:15.243889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67af7-c790-4fa4-a72f-1f16d82470e9 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:15.361843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:15.362449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.362729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.363000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.363666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.365567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.444204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2019/4066] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:15 2022] POST /identity/v3/projects => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:15.454390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:15.463879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:15.523177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017a865-a1ce-4364-bb69-73c6b65b167a tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:15.625653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:15.667812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:15.668520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.668808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.669107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.670445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_project(project_id=23af34baa5b141a5bcfa0bc10456c4a1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.672027 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:15.672027 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:15.672027 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:15.673395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.736116 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2048/4067] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:07:15 2022] PATCH /identity/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1 => generated 361 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:15.740879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:15.750200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:15.757918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f46c4-b95a-49b6-a495-9c16a475bdaa tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:15.770049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:15.772009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.773856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.774243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.800732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=23af34baa5b141a5bcfa0bc10456c4a1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.807176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ee56-44bf-41d7-8625-179c47850ff4 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.809092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2020/4068] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:15 2022] GET /identity/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1 => generated 348 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:15.813639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:15.829184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e272-0e1e-466d-ac9e-f8d001dd2e17 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:15.838753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:15.841300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.842933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.843426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.846488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23af34baa5b141a5bcfa0bc10456c4a1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:15.851071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:15.934529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:15.934812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:15.935470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:15.974878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23af34baa5b141a5bcfa0bc10456c4a1', 'request_id': 'req-75c00d46-21ab-41d4-901e-9d5e43cbfff7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:15.980212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:15.982086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:15.989641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23af34baa5b141a5bcfa0bc10456c4a1', 'request_id': 'req-75c00d46-21ab-41d4-901e-9d5e43cbfff7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.007315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23af34baa5b141a5bcfa0bc10456c4a1', 'request_id': 'req-75c00d46-21ab-41d4-901e-9d5e43cbfff7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.030799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 23af34baa5b141a5bcfa0bc10456c4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:16.031102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.033364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.040874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2049/4069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:15 2022] DELETE /identity/v3/projects/23af34baa5b141a5bcfa0bc10456c4a1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:16.042154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.044368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:16.141733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00d46-21ab-41d4-901e-9d5e43cbfff7 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.145310 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2021/4070] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:16.162361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.163021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.163436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.163710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.164650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.168379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.231800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2050/4071] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:16 2022] POST /identity/v3/projects => generated 359 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:16.236129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.249614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97706dd-a367-4896-84c9-9d7bcdc15964 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.334060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.334901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.335281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.335702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/58e41da4304144c09bf3ca0668188cfb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.337810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_project(project_id=58e41da4304144c09bf3ca0668188cfb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.340105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.505464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.508793 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2022/4072] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:07:16 2022] PATCH /identity/v3/projects/58e41da4304144c09bf3ca0668188cfb => generated 371 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:16.524762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d671-84ee-40be-9340-e3024cd7c9ce tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.534259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.536760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.537297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.537829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/58e41da4304144c09bf3ca0668188cfb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.554803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=58e41da4304144c09bf3ca0668188cfb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.558049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.565582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.566268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2051/4073] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:16 2022] GET /identity/v3/projects/58e41da4304144c09bf3ca0668188cfb => generated 358 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:16.578789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096c2e-66e1-4c11-aeca-ad778e27f7ae tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.585335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.586474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.586998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.587510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/58e41da4304144c09bf3ca0668188cfb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.591623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58e41da4304144c09bf3ca0668188cfb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.594891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.634195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.636402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:16.670719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.708279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.716931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e41da4304144c09bf3ca0668188cfb', 'request_id': 'req-456e4eb6-5e39-467c-abf0-52c8524ae168'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.734276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e41da4304144c09bf3ca0668188cfb', 'request_id': 'req-456e4eb6-5e39-467c-abf0-52c8524ae168'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.766313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e41da4304144c09bf3ca0668188cfb', 'request_id': 'req-456e4eb6-5e39-467c-abf0-52c8524ae168'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.786072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project 58e41da4304144c09bf3ca0668188cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:16.786486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.787752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.789720 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2023/4074] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:16 2022] DELETE /identity/v3/projects/58e41da4304144c09bf3ca0668188cfb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:16.794638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.796019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:16.807132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d6b10-9b2e-4a1a-ba8f-1e9836c352f9 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.883307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.883964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.884242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.884717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] PATH_INFO: `/v3/users/8c89b4a51ce649389bbff589d10e1585` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.888497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c89b4a51ce649389bbff589d10e1585)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.890881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.924069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e4eb6-5e39-467c-abf0-52c8524ae168 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.929329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.930173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.930307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.930626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.931267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.933339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.954086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c89b4a51ce649389bbff589d10e1585'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.954952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c89b4a51ce649389bbff589d10e1585'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.968388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c89b4a51ce649389bbff589d10e1585'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.990013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2024/4075] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:16 2022] POST /identity/v3/projects => generated 355 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:16.990797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c89b4a51ce649389bbff589d10e1585'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.992115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c89b4a51ce649389bbff589d10e1585'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:16.994494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.000586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.027949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2052/4076] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:16 2022] DELETE /identity/v3/users/8c89b4a51ce649389bbff589d10e1585 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:17.029691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.043566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.092410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eae31-9098-4208-a8fe-682cb0792b7f tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.161516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:17.172104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.173823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.174111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.174388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.178808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.193980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dff5-0e85-4445-ab93-932fcdd78213 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.194507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.196738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.205739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.206256 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2025/4077] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:17.206404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.206694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.207223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/c05b5519fc3044a3b15fe5936c4dabea` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.209546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:update_project(project_id=c05b5519fc3044a3b15fe5936c4dabea)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.211529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.261052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2053/4078] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:07:17 2022] PATCH /identity/v3/projects/c05b5519fc3044a3b15fe5936c4dabea => generated 369 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:17.265156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.277864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b22c51-28bf-49f1-839e-f8ae39db20ee service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.283663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.284514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.284862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.285654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/c05b5519fc3044a3b15fe5936c4dabea` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.299599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:get_project(project_id=c05b5519fc3044a3b15fe5936c4dabea)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.302289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.304688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2026/4079] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:17 2022] GET /identity/v3/projects/c05b5519fc3044a3b15fe5936c4dabea => generated 356 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:17.308518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.322476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5d8c-4db7-4217-bbb7-e1b288dda513 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.329656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.330526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.330738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.331026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/projects/c05b5519fc3044a3b15fe5936c4dabea` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.332268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c05b5519fc3044a3b15fe5936c4dabea)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.334477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.359578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.362773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.370846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:17.418419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05b5519fc3044a3b15fe5936c4dabea', 'request_id': 'req-7c4b595f-538a-4a6f-a371-d748356d32d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.429792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05b5519fc3044a3b15fe5936c4dabea', 'request_id': 'req-7c4b595f-538a-4a6f-a371-d748356d32d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.442040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05b5519fc3044a3b15fe5936c4dabea', 'request_id': 'req-7c4b595f-538a-4a6f-a371-d748356d32d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.459674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38863f-4f4e-44de-99f8-7b46d9c168ad tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.483123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] The token cache is being invalidate because project c05b5519fc3044a3b15fe5936c4dabea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:17.483393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.484001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.486236 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2054/4080] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:17 2022] DELETE /identity/v3/projects/c05b5519fc3044a3b15fe5936c4dabea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:17.491257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.492760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.592334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b595f-538a-4a6f-a371-d748356d32d6 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.597460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.598686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.599052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.599354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/a269db93a6d24c8a85bf1483dae1037b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.608472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Could not find domain: a269db93a6d24c8a85bf1483dae1037b.: keystone.exception.DomainNotFound: Could not find domain: a269db93a6d24c8a85bf1483dae1037b. Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a269db93a6d24c8a85bf1483dae1037b. Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:17.615912 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:07:17.617252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a269db93a6d24c8a85bf1483dae1037b. Oct 28 10:07:17.618396 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.619777 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2055/4081] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:07:17 2022] PATCH /identity/v3/domains/a269db93a6d24c8a85bf1483dae1037b => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:07:17.621246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.621896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.622033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.622283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.622557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] PATH_INFO: `/v3/projects/cdec51986d2644d6a667908a6fa34da2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.623855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdec51986d2644d6a667908a6fa34da2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.627173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.634609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faa384-a350-4c02-88d5-834ec1b39a23 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.639964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '547bb1aa4db748d2a068e25526894d04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d20e68e2454c64afcd5b9dfee69012', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.640710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.641115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.641461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] PATH_INFO: `/v3/domains/c208387c4af7407abf1edc7a986f5ae8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.650537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Could not find domain: c208387c4af7407abf1edc7a986f5ae8.: keystone.exception.DomainNotFound: Could not find domain: c208387c4af7407abf1edc7a986f5ae8. Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c208387c4af7407abf1edc7a986f5ae8. Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:17.656145 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:07:17.657614 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c208387c4af7407abf1edc7a986f5ae8. Oct 28 10:07:17.658942 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:17.660744 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2056/4082] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:07:17 2022] PATCH /identity/v3/domains/c208387c4af7407abf1edc7a986f5ae8 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:07:17.664715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:17.667653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.686735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e117-2d86-4790-963c-9c131d126d85 tempest-ProjectsTestJSON-957647794 tempest-ProjectsTestJSON-957647794-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:17.701808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdec51986d2644d6a667908a6fa34da2', 'request_id': 'req-41007059-9b14-4d1a-8315-0afdd785b4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.710602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdec51986d2644d6a667908a6fa34da2', 'request_id': 'req-41007059-9b14-4d1a-8315-0afdd785b4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.719987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdec51986d2644d6a667908a6fa34da2', 'request_id': 'req-41007059-9b14-4d1a-8315-0afdd785b4e5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.730762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:17.739145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] The token cache is being invalidate because project cdec51986d2644d6a667908a6fa34da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:17.739535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.740397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41007059-9b14-4d1a-8315-0afdd785b4e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.742880 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2027/4083] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:17 2022] DELETE /identity/v3/projects/cdec51986d2644d6a667908a6fa34da2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:17.749903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748025-0147-4831-88ae-dc0bce949165 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.751011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748025-0147-4831-88ae-dc0bce949165 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.751462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748025-0147-4831-88ae-dc0bce949165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.785188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dd748025-0147-4831-88ae-dc0bce949165 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:17.787319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dd748025-0147-4831-88ae-dc0bce949165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.795598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:17.796244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.796569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.796842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] PATH_INFO: `/v3/users/ea9c5b2fb8a84fc38280562dcd3081cb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.800396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9c5b2fb8a84fc38280562dcd3081cb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:17.805474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:17.844119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:17.902496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9c5b2fb8a84fc38280562dcd3081cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.903215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9c5b2fb8a84fc38280562dcd3081cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.916327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2028/4084] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:17.918583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.919032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.919646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:17.934161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9c5b2fb8a84fc38280562dcd3081cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.948076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9c5b2fb8a84fc38280562dcd3081cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.948877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c1670ea-dad7-4f5d-89cf-940618d5cd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9c5b2fb8a84fc38280562dcd3081cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:17.984725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:17.986215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:17.990913 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2057/4085] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:17 2022] DELETE /identity/v3/users/ea9c5b2fb8a84fc38280562dcd3081cb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:17.992361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:17.992650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:17.992933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.038913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:18.040111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:18.117457 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2029/4086] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:18.122786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.143383 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2058/4087] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:18.143651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb467-2015-40ef-966f-e0032587b4fd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.150204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.150940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.151370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.151714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.152452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:18.152832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.154843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.167911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.169412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:18.176547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2030/4088] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:18.178562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.193222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9e7a-0066-4800-a2d5-fff6e1d68f0a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.199259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.200120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.200498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.200813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.201598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.204128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.253537 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2031/4089] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:18 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:18.255230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.281864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e701-06d5-4fc0-81f0-099e0160f0c8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.290072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:18.344867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2ecb-6d2e-4081-9af7-5668c429af99 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.353718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.354422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.355026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.355172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.355874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.358433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.378964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.387370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.387652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.387927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.400273 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2032/4090] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:18 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:18.404234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.405038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.406971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.417969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fdf9b-969c-42b7-bb09-640a62cd170e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.420799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2059/4091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:07:18.425393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.426586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.426866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.427137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.427785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.429578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.445639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2033/4092] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:18.446490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.456628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5653-9cc0-4551-8da4-e33ed7ed853d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.468731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.471073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.471225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.472240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.474727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.478980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81c575-ce22-4710-8b8f-be15c9a1ab00 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.512206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2060/4093] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:18.516587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.529252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447f635-0fb2-49a3-b95b-29a117e6d696 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.535918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.536723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.537269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.537507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] PATH_INFO: `/v3/projects/669c6c5d2876466193ec4abce33def69/users/6b0638e280d940d1ba1f3c78c02351c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.557445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669c6c5d2876466193ec4abce33def69, user_id=6b0638e280d940d1ba1f3c78c02351c0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.561615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.577878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:18.592156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2034/4094] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:18 2022] PUT /identity/v3/projects/669c6c5d2876466193ec4abce33def69/users/6b0638e280d940d1ba1f3c78c02351c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:18.593463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.593878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.599562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.639336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:18.640897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:18.755484 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2061/4095] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:18.787051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:18.880976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839e02-207d-4738-a582-96453f3322a6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:18.889149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:18.890143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:18.890425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:18.891085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:18.906149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:18.910421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:18.925609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2035/4096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:20.131361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:20.133986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:20.178648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926ed3-1e0f-4db3-8b0d-9162978449a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:20.207665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:20.208200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:20.208476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:20.209617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] PATH_INFO: `/v3/projects/3a8a6642a30545e48d3990324f77458e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:20.211185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8a6642a30545e48d3990324f77458e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:20.213094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:20.324261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8a6642a30545e48d3990324f77458e', 'request_id': 'req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.343599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8a6642a30545e48d3990324f77458e', 'request_id': 'req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.354674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8a6642a30545e48d3990324f77458e', 'request_id': 'req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.386954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] The token cache is being invalidate because project 3a8a6642a30545e48d3990324f77458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:20.388073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.390152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.394362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2062/4097] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:20 2022] DELETE /identity/v3/projects/3a8a6642a30545e48d3990324f77458e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:20.399925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:20.414270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded8759-dd03-49ec-a478-a4aaabdecb88 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:20.493811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:20.494517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:20.494796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:20.495069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] PATH_INFO: `/v3/users/547bb1aa4db748d2a068e25526894d04` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:20.496460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=547bb1aa4db748d2a068e25526894d04)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:20.499463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:20.582172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547bb1aa4db748d2a068e25526894d04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.584991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547bb1aa4db748d2a068e25526894d04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.586259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547bb1aa4db748d2a068e25526894d04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.603194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547bb1aa4db748d2a068e25526894d04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.614443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547bb1aa4db748d2a068e25526894d04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:20.640823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2036/4098] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:20 2022] DELETE /identity/v3/users/547bb1aa4db748d2a068e25526894d04 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:20.839840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:20.841449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:20.882025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:20.946147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a14c-b61c-42b8-9050-3a7b99f38eed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:21.075522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:21.076528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:21.076940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:21.077487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:21.079454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:21.099348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:21.101971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbd782-5f6c-4658-ac95-67c8c5fd8bbf service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:21.117224 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2063/4099] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:21.662242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:21.663735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:21.711362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:21.786697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48670bb5-5e48-4f2d-92ad-ace07f9cd92d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:21.796205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:21.796964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:21.798254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:21.799939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] PATH_INFO: `/v3/projects/f4d20e68e2454c64afcd5b9dfee69012` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:21.802111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d20e68e2454c64afcd5b9dfee69012)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:21.818003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:21.913049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d20e68e2454c64afcd5b9dfee69012', 'request_id': 'req-fefd1657-5d16-4c9a-83d7-3b12453c2740'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:21.920867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d20e68e2454c64afcd5b9dfee69012', 'request_id': 'req-fefd1657-5d16-4c9a-83d7-3b12453c2740'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:21.930682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d20e68e2454c64afcd5b9dfee69012', 'request_id': 'req-fefd1657-5d16-4c9a-83d7-3b12453c2740'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:21.947405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] The token cache is being invalidate because project f4d20e68e2454c64afcd5b9dfee69012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:21.948479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:21.949684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fefd1657-5d16-4c9a-83d7-3b12453c2740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:21.951733 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2037/4100] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:21 2022] DELETE /identity/v3/projects/f4d20e68e2454c64afcd5b9dfee69012 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:21.956392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:21.957023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:21.957150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:21.984294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:21.986332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:22.111545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2064/4101] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:22.115576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.116123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.116640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.139626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:22.141311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:22.152812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2038/4102] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:22.157226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.170499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e106c-9ea0-471a-991d-f12a14aea225 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.178500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.178731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.179115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.179617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.180384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:22.180785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.182637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.200964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2065/4103] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:22.204897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.219349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6fd5d-becb-42f0-9cf0-7b915feae5f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.225799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.226688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.227274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.227983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.228791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.231051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.277043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.289733 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2039/4104] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:22 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:22.291440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdbdbe-f024-435c-b291-a77f33be82ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.355265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:22.395490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.398431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.399328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.399774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.400804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.405102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.443591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.450108 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2066/4105] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:22 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:22.458031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff705c4-8a5b-4162-a69e-0a9b1d613d37 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.468671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.469574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.469949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.470399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.471203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.478537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.495788 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2040/4106] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:22.500207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.521095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8794-6120-4a9e-8969-c75811f6d426 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.529368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.530004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.530374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.530922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.532247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.534287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467e91f-b943-4f22-a507-56378b48a4ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.551382 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2067/4107] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:22.555047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.581260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64624f38-a2a7-43f6-8ff9-1910f20cdd23 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:22.593666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:22.594729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.595223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.595728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] PATH_INFO: `/v3/projects/4fd47fcc0e4744ad84914721550ed092/users/657a53f59d1340f1b68b857b6a07e58a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.623494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd47fcc0e4744ad84914721550ed092, user_id=657a53f59d1340f1b68b857b6a07e58a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:22.626948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:22.647459 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2041/4108] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:22 2022] PUT /identity/v3/projects/4fd47fcc0e4744ad84914721550ed092/users/657a53f59d1340f1b68b857b6a07e58a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:22.657643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:22.658080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:22.658448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:22.714699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] MFA Rules not processed for user `657a53f59d1340f1b68b857b6a07e58a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:22.716042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:22.836649 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2068/4109] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:22.843611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:22.968094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:22.993841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6341aa-62bf-45ed-bcd4-442274f95ad9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.009019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.009884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.010340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.010773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.012301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.017517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.066011 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2042/4110] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:22 2022] POST /identity/v3/projects => generated 397 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:07:23.070467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:23.091994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f031-8a34-4e43-b828-efdc4e34a388 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.196599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.197474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.197889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.198274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.201578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.201762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.237781 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2069/4111] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:23 2022] POST /identity/v3/users => generated 305 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:23.242838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:23.261379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f78e8-ca99-49cf-8276-7157b4e0211f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.278455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.279277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.280718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.281122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.283080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.291075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.330043 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2043/4112] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:23.334117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:23.348519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6134f-f10d-4c18-8df5-5f1efa0c71ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.356506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.357444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.357952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.358511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] PATH_INFO: `/v3/projects/de8d7101334d4ffb964c23746597efeb/users/ee5c66c2d46745ccbb1b37e47b708dfc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.382409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8d7101334d4ffb964c23746597efeb, user_id=ee5c66c2d46745ccbb1b37e47b708dfc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.386325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.412671 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2070/4113] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:23 2022] PUT /identity/v3/projects/de8d7101334d4ffb964c23746597efeb/users/ee5c66c2d46745ccbb1b37e47b708dfc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:23.417278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:23.442418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef3472-1503-405c-b71b-ccf61e0b2b56 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.632850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.634597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.635095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.635586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.636431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.639180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012aab7-38c9-4ff8-8a1d-6927e04a3179 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.654690 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2044/4114] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:23.658449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:23.676012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b36eb7-7346-4f2f-8756-fc745880b143 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:23.693540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:23.694297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.694577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.694852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] PATH_INFO: `/v3/projects/de8d7101334d4ffb964c23746597efeb/users/ee5c66c2d46745ccbb1b37e47b708dfc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.698097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8d7101334d4ffb964c23746597efeb, user_id=ee5c66c2d46745ccbb1b37e47b708dfc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:23.701453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:23.737311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2071/4115] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:23 2022] PUT /identity/v3/projects/de8d7101334d4ffb964c23746597efeb/users/ee5c66c2d46745ccbb1b37e47b708dfc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:23.748394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:23.748972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:23.750020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:23.887844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] MFA Rules not processed for user `ee5c66c2d46745ccbb1b37e47b708dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:23.893154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:24.219405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.223052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2045/4116] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:24.229132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:24.367517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549c32-e2f0-4a94-8e7b-e269078ff596 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.371894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a53f59d1340f1b68b857b6a07e58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fd47fcc0e4744ad84914721550ed092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.372520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.372800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.373113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.373742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 28 10:07:24.382265 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 28 10:07:24.383408 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.384176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2072/4117] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:24 2022] POST /identity/v3/projects => generated 136 bytes in 165 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:07:24.388976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.407380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c743-87b6-4c4c-85fd-86d05c1a8cba None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.416811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.417471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.417753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.418025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.419123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.421011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invalid input for field 'name': '' is too short Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: On instance['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: On instance['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: '' Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application '' Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.442395 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:07:24.444098 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application '' Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.445356 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2046/4118] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:24 2022] POST /identity/v3/projects => generated 283 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 28 10:07:24.449415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.470095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e24c-83bb-426c-a2b1-18ab7d179649 tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.481089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.481743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.482098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.482403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.483351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.486058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: On instance['name']: Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: On instance['name']: Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise error Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:07:24.497339 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:24.498857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:07:24.501108 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.505127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.514496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2073/4119] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:24 2022] POST /identity/v3/projects => generated 412 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:07:24.518538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e59bae-494b-485f-a226-775913ffb423 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.524503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.525749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.525749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.525978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects/0ba2ae472e944e2a87524e51558c18c4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.533875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ba2ae472e944e2a87524e51558c18c4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.535928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Could not find project: 0ba2ae472e944e2a87524e51558c18c4.: keystone.exception.ProjectNotFound: Could not find project: 0ba2ae472e944e2a87524e51558c18c4. Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 28 10:07:24.548502 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0ba2ae472e944e2a87524e51558c18c4. Oct 28 10:07:24.549692 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:07:24.555569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.564256 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2047/4120] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:24 2022] DELETE /identity/v3/projects/0ba2ae472e944e2a87524e51558c18c4 => generated 113 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:07:24.569897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb5273-22c4-46fc-8b2a-729ec7b7bf35 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.592721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a53f59d1340f1b68b857b6a07e58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fd47fcc0e4744ad84914721550ed092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.594166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.596829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.597638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.598303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 28 10:07:24.624724 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._list_projects() Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 28 10:07:24.626008 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:24.627774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2074/4121] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:07:24 2022] GET /identity/v3/projects => generated 135 bytes in 73 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:07:24.634507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.651658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff84a-b8cf-40a2-a644-b19acb61eeed tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.658658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.659305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.659591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.660000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.661083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.662957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:24.765013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2048/4122] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:24 2022] POST /identity/v3/projects => generated 358 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:24.773347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:24.795723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905020-2ff0-4033-9bbe-4353a4c3c58d tempest-ProjectsNegativeStaticTestJSON-1125643979 tempest-ProjectsNegativeStaticTestJSON-1125643979-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:24.946072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:24.948725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:24.949403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:24.949869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:24.950691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:24.953138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:25.010397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.sql.core [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1471476540' for key 'project.ixu_project_name_domain_id'") Oct 28 10:07:25.010397 n-d-zed-1 devstack@keystone.service[88452]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 10:07:25.010397 n-d-zed-1 devstack@keystone.service[88452]: [parameters: {'id': 'b53c7e5a81364cbda9397be69f877094', 'name': 'tempest-project-dup-1471476540', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 10:07:25.010397 n-d-zed-1 devstack@keystone.service[88452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1471476540, project id b53c7e5a81364cbda9397be69f877094.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1471476540, project id b53c7e5a81364cbda9397be69f877094. Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:07:25.029921 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1471476540' for key 'project.ixu_project_name_domain_id'") Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 10:07:25.031082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application yield resource Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise self.value Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 10:07:25.032545 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application session.commit() Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.flush() Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application compat.raise_( Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 10:07:25.034093 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 10:07:25.036179 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:07:25.037635 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1471476540' for key 'project.ixu_project_name_domain_id'") Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [parameters: {'id': 'b53c7e5a81364cbda9397be69f877094', 'name': 'tempest-project-dup-1471476540', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:25.039041 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1471476540 at domain ID default. Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:25.042953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1471476540, project id b53c7e5a81364cbda9397be69f877094. Oct 28 10:07:25.045819 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:25.046920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2075/4123] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:24 2022] POST /identity/v3/projects => generated 285 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 10:07:25.049622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:25.063067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:25.076351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f14f-8e3b-4ba0-9579-86d6dd250ea2 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:25.087625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee5c66c2d46745ccbb1b37e47b708dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de8d7101334d4ffb964c23746597efeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:25.088734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:25.090375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:25.090905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] PATH_INFO: `/v3/projects/d9213a4b48c84c42bb45a056e4d0e2e3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:25.092379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9213a4b48c84c42bb45a056e4d0e2e3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:25.101646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:25.308781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9213a4b48c84c42bb45a056e4d0e2e3', 'request_id': 'req-0b316164-8f50-4e5a-8aeb-27eb9e84012e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.322991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9213a4b48c84c42bb45a056e4d0e2e3', 'request_id': 'req-0b316164-8f50-4e5a-8aeb-27eb9e84012e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.361697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9213a4b48c84c42bb45a056e4d0e2e3', 'request_id': 'req-0b316164-8f50-4e5a-8aeb-27eb9e84012e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.406558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] The token cache is being invalidate because project d9213a4b48c84c42bb45a056e4d0e2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:25.407409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.409060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b316164-8f50-4e5a-8aeb-27eb9e84012e tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.416232 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2049/4124] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:25 2022] DELETE /identity/v3/projects/d9213a4b48c84c42bb45a056e4d0e2e3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:25.417311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:25.419316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:25.579010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340a41-26ad-4130-8273-d91f92ad93e4 tempest-ProjectsNegativeStaticTestJSON-2115447529 tempest-ProjectsNegativeStaticTestJSON-2115447529-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:25.687119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:25.734769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:25.735426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:25.735701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:25.735969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] PATH_INFO: `/v3/users/657a53f59d1340f1b68b857b6a07e58a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:25.737762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657a53f59d1340f1b68b857b6a07e58a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:25.745133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:25.900132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657a53f59d1340f1b68b857b6a07e58a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.901343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657a53f59d1340f1b68b857b6a07e58a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.915241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657a53f59d1340f1b68b857b6a07e58a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.932609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657a53f59d1340f1b68b857b6a07e58a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.934054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657a53f59d1340f1b68b857b6a07e58a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:25.969672 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2076/4125] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:25 2022] DELETE /identity/v3/users/657a53f59d1340f1b68b857b6a07e58a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:25.974144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaab45-2cc7-4779-a720-a8ac20731393 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:25.974416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaab45-2cc7-4779-a720-a8ac20731393 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:25.974689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaab45-2cc7-4779-a720-a8ac20731393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:26.018347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6cfaab45-2cc7-4779-a720-a8ac20731393 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:26.020657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6cfaab45-2cc7-4779-a720-a8ac20731393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:26.134165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2050/4126] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:26.186052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:26.191494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:26.296155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ab21-60da-463b-afa3-b5ee0c41e020 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:26.305815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:26.306430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:26.306710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:26.306982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:26.336312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:26.337825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:26.353457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2077/4127] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:26.437386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:26.438889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:26.439452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:26.473799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] MFA Rules not processed for user `1f95d3b5d2334eefb1b5386fb8580780`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:26.475309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:26.663658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2051/4128] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:27.697402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:27.698832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:27.722587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb216-f1d1-48ce-9cb0-978b44e70cf3 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:27.731813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:27.732302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:27.732577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:27.732846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] PATH_INFO: `/v3/projects/4fd47fcc0e4744ad84914721550ed092` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:27.741818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd47fcc0e4744ad84914721550ed092)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:27.743767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:27.849267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd47fcc0e4744ad84914721550ed092', 'request_id': 'req-75d997cb-df45-49e3-b0dc-be10eb1a7769'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:27.864965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:27.876564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd47fcc0e4744ad84914721550ed092', 'request_id': 'req-75d997cb-df45-49e3-b0dc-be10eb1a7769'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:27.892228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd47fcc0e4744ad84914721550ed092', 'request_id': 'req-75d997cb-df45-49e3-b0dc-be10eb1a7769'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:27.909125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] The token cache is being invalidate because project 4fd47fcc0e4744ad84914721550ed092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:27.909405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:27.910709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:27.912953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2078/4129] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:27 2022] DELETE /identity/v3/projects/4fd47fcc0e4744ad84914721550ed092 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:27.916744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:27.941130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead04f8-db68-4101-bda3-bfaffe8386f3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:27.978197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:28.027296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:28.028373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:28.028657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:28.028959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] PATH_INFO: `/v3/users/ee5c66c2d46745ccbb1b37e47b708dfc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:28.030150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5c66c2d46745ccbb1b37e47b708dfc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:28.032110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:28.092832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5c66c2d46745ccbb1b37e47b708dfc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:28.093707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5c66c2d46745ccbb1b37e47b708dfc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:28.094331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5c66c2d46745ccbb1b37e47b708dfc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:28.103932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5c66c2d46745ccbb1b37e47b708dfc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:28.114733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28a51866-2721-4652-8b51-f802bb1dbd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5c66c2d46745ccbb1b37e47b708dfc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:28.145337 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2052/4130] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:27 2022] DELETE /identity/v3/users/ee5c66c2d46745ccbb1b37e47b708dfc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:28.712238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:28.713733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:28.733445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d997cb-df45-49e3-b0dc-be10eb1a7769 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:28.911005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:28.911820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:28.911983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:28.912760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] PATH_INFO: `/v3/projects/de8d7101334d4ffb964c23746597efeb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:28.916865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8d7101334d4ffb964c23746597efeb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:28.926568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.061228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8d7101334d4ffb964c23746597efeb', 'request_id': 'req-285ef4ee-72cc-46c6-a846-47512a218654'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:29.069156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8d7101334d4ffb964c23746597efeb', 'request_id': 'req-285ef4ee-72cc-46c6-a846-47512a218654'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:29.082534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8d7101334d4ffb964c23746597efeb', 'request_id': 'req-285ef4ee-72cc-46c6-a846-47512a218654'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:29.106436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] The token cache is being invalidate because project de8d7101334d4ffb964c23746597efeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:29.106738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:29.109761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-285ef4ee-72cc-46c6-a846-47512a218654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:29.113479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2079/4131] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:28 2022] DELETE /identity/v3/projects/de8d7101334d4ffb964c23746597efeb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:29.118166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.119055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.119518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.145569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:29.147261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:29.335079 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2053/4132] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:29.347595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.347894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.348150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.429129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:29.430371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:29.450238 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2080/4133] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:29.451223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.470724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579421-a81c-40ed-b8dc-6bca16fb5ce9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.486565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.487147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.487429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.487725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.488411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:29.488684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.490443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.521017 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2054/4134] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:29.521945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.537999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40026-2506-4a57-98df-fb51df45df31 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.549738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.550365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.550751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.551089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.552805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.558155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.651593 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2081/4135] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:29 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:29.655225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.672340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242464c6-2c7e-4aae-86bb-aee1022a9b39 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.722059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:29.783706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.784289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.784687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.785042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.787545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.791666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.824422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.834344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2055/4136] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:29 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:29.839816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198d48e-1c6c-4a4b-87de-9fd53153f6aa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.848165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.849286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.849883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.850417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.851590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.854509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.870361 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2082/4137] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:07:29.874003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.887243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99687b2f-7c33-4dfe-9820-e4d57c2073c3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.893054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.893878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.894503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.894650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.895393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.897357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853765a8-6480-4804-96da-1c514b9efd22 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.916352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.917582 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2056/4138] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:29.931432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44966c-a76f-4c41-a2e0-87291f28ffea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.938010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.942363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.943184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.943684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] PATH_INFO: `/v3/projects/a6f9767a514d41d588fdf30a4a66e752/users/ec6705ad03684e01b527642f79422d85/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.969780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f9767a514d41d588fdf30a4a66e752, user_id=ec6705ad03684e01b527642f79422d85, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.974269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:30.027912 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2083/4139] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:29 2022] PUT /identity/v3/projects/a6f9767a514d41d588fdf30a4a66e752/users/ec6705ad03684e01b527642f79422d85/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:30.038853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.039418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.039939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.122590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] MFA Rules not processed for user `ec6705ad03684e01b527642f79422d85`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:30.125441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:30.278902 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2057/4140] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:30.283037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:30.328959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:30.493298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ae8b-ede7-4465-82f8-ea348d9554d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:30.504154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:30.504772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.505124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.505396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.506028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:30.508144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:30.544518 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2084/4141] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:30 2022] POST /identity/v3/projects => generated 369 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:30.548246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:30.586472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8b4b-701b-49a2-b239-4fce740d6577 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:30.806855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:30.807326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.807618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.808151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.809069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:30.811221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:30.868239 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2058/4142] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:30 2022] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:30.869663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:30.898539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915dd3-1a1e-48dd-a517-39fa6c1d18b8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:30.907464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:30.908186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.908469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.908735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.909802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:30.926949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:30.966857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:30.968704 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2085/4143] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:30.981121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31510-cf2d-4165-b6ad-a9d7b058a400 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:30.993467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:30.994218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.994494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.994759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] PATH_INFO: `/v3/projects/75bcb034a33e4427833085845444acfc/users/430c675854a54bd0868d9d9c2f8dcd0b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.030279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bcb034a33e4427833085845444acfc, user_id=430c675854a54bd0868d9d9c2f8dcd0b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.033727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.064696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.077851 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2059/4144] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:30 2022] PUT /identity/v3/projects/75bcb034a33e4427833085845444acfc/users/430c675854a54bd0868d9d9c2f8dcd0b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:31.079576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca1257-1faf-463c-bdd4-564e98e95fe3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:31.220522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:31.221453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.221959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.222415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.223264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.225142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f0981-6beb-408e-95b8-0e24f6474e62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.239648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2086/4145] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:31.243751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.252544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:31.260035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c3db-27d3-45fc-a853-9aeb2f196867 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:31.274902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:31.275601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.275882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.276156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] PATH_INFO: `/v3/projects/75bcb034a33e4427833085845444acfc/users/430c675854a54bd0868d9d9c2f8dcd0b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.284088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bcb034a33e4427833085845444acfc, user_id=430c675854a54bd0868d9d9c2f8dcd0b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.287224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.321129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2060/4146] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:31 2022] PUT /identity/v3/projects/75bcb034a33e4427833085845444acfc/users/430c675854a54bd0868d9d9c2f8dcd0b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:31.331399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.331752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.331968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.423458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] MFA Rules not processed for user `430c675854a54bd0868d9d9c2f8dcd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:31.433004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:31.650458 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2087/4147] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:31.655066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.676945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e133cd-12b9-41ee-af40-fd14cbfea3bf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:31.694369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:31.694369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.694369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.694859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.694971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.703182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.742608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2061/4148] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:07:31 2022] POST /identity/v3/services => generated 239 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:31.746348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.759379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8f17d-a78e-4db5-a743-07f0a7fbe4fb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:31.770281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:31.797394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:31.798138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.798654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.799059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/2e9e37af14b1458fb1c6674423def987` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.799762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2e9e37af14b1458fb1c6674423def987)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.802579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.860960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2088/4149] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:31 2022] DELETE /identity/v3/services/2e9e37af14b1458fb1c6674423def987 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:31.864302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.879411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e655-b3d1-4895-917f-eb5ac449e291 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:31.917544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:31.918566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:31.919102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:31.919600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:31.920567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:31.923654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:31.951782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:31.958928 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2062/4150] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:31 2022] POST /identity/v3/services => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:31.973880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba8de4-ef0d-474f-a635-6f3fecd6dfe6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.010732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.011650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.012191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.012191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/14e2a77cd3514abebc7c54a21812cd73` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.012859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:update_service(service_id=14e2a77cd3514abebc7c54a21812cd73)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.014009 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:32.014009 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:32.014009 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:32.015032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.095294 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2089/4151] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:07:31 2022] PATCH /identity/v3/services/14e2a77cd3514abebc7c54a21812cd73 => generated 282 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:32.106971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.129454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397890d2-c2d7-4695-9a1d-bb0b169aba79 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.189953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.190706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.190925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.191173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/14e2a77cd3514abebc7c54a21812cd73` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.191776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:get_service(service_id=14e2a77cd3514abebc7c54a21812cd73)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.192894 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:32.192894 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:07:32.192894 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:07:32.193730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.229026 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2063/4152] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:32 2022] GET /identity/v3/services/14e2a77cd3514abebc7c54a21812cd73 => generated 282 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:32.233190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.252919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.255012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:32.270119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f968-8ed5-4267-9674-15c3e793e3f3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.280499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.281200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.281628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.282056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/14e2a77cd3514abebc7c54a21812cd73` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.282663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=14e2a77cd3514abebc7c54a21812cd73)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.285246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.345191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2090/4153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:32 2022] DELETE /identity/v3/services/14e2a77cd3514abebc7c54a21812cd73 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:32.349794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.391035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f388-24e7-423e-abbd-beb82ef553cf tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.410460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.412054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.412658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.413776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/14e2a77cd3514abebc7c54a21812cd73` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.414866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:get_service(service_id=14e2a77cd3514abebc7c54a21812cd73)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.416069 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:32.416069 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:32.416069 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:32.417618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Could not find service: 14e2a77cd3514abebc7c54a21812cd73.: keystone.exception.ServiceNotFound: Could not find service: 14e2a77cd3514abebc7c54a21812cd73. Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 14e2a77cd3514abebc7c54a21812cd73. Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:07:32.435989 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:07:32.437487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 14e2a77cd3514abebc7c54a21812cd73. Oct 28 10:07:32.439115 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:07:32.446271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2091/4154] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:07:32 2022] GET /identity/v3/services/14e2a77cd3514abebc7c54a21812cd73 => generated 113 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:07:32.452285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.467901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d126-fd79-49cf-87d5-1865c604d6b1 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.484451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd594-94db-487f-b88c-c27df08c15b3 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.493953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.494856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.495335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.495930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] PATH_INFO: `/v3/users/46e60190fc7542aea2104d11446c2614` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.498153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e60190fc7542aea2104d11446c2614)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.500452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.500636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.501383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.501667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.501948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.502738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.508521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.558896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2092/4155] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:32 2022] POST /identity/v3/services => generated 273 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:32.560370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.607993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ed83-4314-4584-afa8-372ced4c1ca6 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.623425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.624049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.624854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e60190fc7542aea2104d11446c2614'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:32.627095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e60190fc7542aea2104d11446c2614'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:32.627743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.628232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e60190fc7542aea2104d11446c2614'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:32.630613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.631302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.632969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.648345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e60190fc7542aea2104d11446c2614'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:32.664121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e60190fc7542aea2104d11446c2614'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:32.667577 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2093/4156] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:32 2022] POST /identity/v3/services => generated 275 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:32.673466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.676252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:32.687340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:32.694918 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2064/4157] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:32 2022] DELETE /identity/v3/users/46e60190fc7542aea2104d11446c2614 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:32.722670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b315-d5c7-4393-9ab9-8d39a572cd2f tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.811701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.812330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.812882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.813192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.813843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.815488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.834141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2094/4158] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:32 2022] POST /identity/v3/services => generated 273 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:32.838017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.854349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e3d9-aae4-4fd3-9302-0f44d654e599 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.882300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.882938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.883219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.883493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.885568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.886684 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:32.886684 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:07:32.886684 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:07:32.887671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.912741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2065/4159] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:07:32 2022] GET /identity/v3/services => generated 2976 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:32.913773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.933693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795014d6-10fc-4786-9e13-8ed60a4c225a tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.952438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.953464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.953745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.954114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.955258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-935268414) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:32.955417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.956653 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:07:32.956653 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:07:32.956653 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:07:32.957650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:32.964379 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2095/4160] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Oct 28 10:07:32 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-935268414 => generated 415 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:32.968534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:32.983723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6bf3-5827-4ab3-af6a-b0c1951d9b27 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:32.994095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:32.994727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:32.995009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:32.995374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:32.996473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1670373372) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:32.996473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:32.998007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.007367 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2066/4161] 10.222.0.16 () {58 vars in 1222 bytes} [Fri Oct 28 10:07:32 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1670373372 => generated 418 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:33.011866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.026128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243197ba-3633-4164-addd-8300981328bc tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.034896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.035798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.036249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.036685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.037591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-607863549) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:33.037881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.059209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.065176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:33.071456 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2096/4162] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Oct 28 10:07:33 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-607863549 => generated 415 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:33.080144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.097076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9958-072d-4142-80b3-327e56dfd2e2 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.104451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.105888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.105888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.105888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/8c142b5f5d51408abc210e54dff34534` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.108245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8c142b5f5d51408abc210e54dff34534)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.108799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.181706 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2067/4163] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:33 2022] DELETE /identity/v3/services/8c142b5f5d51408abc210e54dff34534 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:33.182192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.197558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4137d-30dd-4d07-9662-0852541ac5ff tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.220387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.226493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.232565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.234412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.235053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.235504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/1bf67b5b54114d839f98d04ad300497f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.236880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1bf67b5b54114d839f98d04ad300497f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.243733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.291260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2097/4164] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:33 2022] DELETE /identity/v3/services/1bf67b5b54114d839f98d04ad300497f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:33.298341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.360261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958db778-5070-4eb6-95be-8a47b4efd18b tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.366239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c675854a54bd0868d9d9c2f8dcd0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75bcb034a33e4427833085845444acfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.366877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.367167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.367439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] PATH_INFO: `/v3/services/263125e4e8044a6698e762b2b2df5189` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.368198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorizing `identity:delete_service(service_id=263125e4e8044a6698e762b2b2df5189)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.369953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.372988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3196dd-165a-443b-9d84-b99159598045 tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.406344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2098/4165] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:33 2022] DELETE /identity/v3/services/263125e4e8044a6698e762b2b2df5189 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:33.408126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.411974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.424578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.426190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.426692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.427156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] PATH_INFO: `/v3/projects/8fe652e1ff264b89938f9c5b4b9c09c6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.429166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe652e1ff264b89938f9c5b4b9c09c6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.432349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.445554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e121e-92f5-457c-976a-693f04b5db9c tempest-ServicesTestJSON-1942434223 tempest-ServicesTestJSON-1942434223-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.451953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.452675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.453126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.453323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] PATH_INFO: `/v3/users/ec6705ad03684e01b527642f79422d85` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.454843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6705ad03684e01b527642f79422d85)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.458406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.517959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe652e1ff264b89938f9c5b4b9c09c6', 'request_id': 'req-db0e4692-47a1-40ac-88f0-013de3800478'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.527257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe652e1ff264b89938f9c5b4b9c09c6', 'request_id': 'req-db0e4692-47a1-40ac-88f0-013de3800478'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.542756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe652e1ff264b89938f9c5b4b9c09c6', 'request_id': 'req-db0e4692-47a1-40ac-88f0-013de3800478'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.568617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] The token cache is being invalidate because project 8fe652e1ff264b89938f9c5b4b9c09c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:33.569024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.572305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db0e4692-47a1-40ac-88f0-013de3800478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.577281 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2068/4166] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:33 2022] DELETE /identity/v3/projects/8fe652e1ff264b89938f9c5b4b9c09c6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:33.583833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.584118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.584392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.589653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6705ad03684e01b527642f79422d85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.590652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6705ad03684e01b527642f79422d85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.605876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6705ad03684e01b527642f79422d85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.624114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6705ad03684e01b527642f79422d85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.624949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7b02149d-2353-4b84-9db3-8c4ad7405100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6705ad03684e01b527642f79422d85'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:33.635490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:33.639373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.661601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2099/4167] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:33 2022] DELETE /identity/v3/users/ec6705ad03684e01b527642f79422d85 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:33.665582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7bd2-d13a-462f-bfc9-e8fd0c951d97 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.665994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7bd2-d13a-462f-bfc9-e8fd0c951d97 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.666373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7bd2-d13a-462f-bfc9-e8fd0c951d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.687918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:33.688272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-51dd7bd2-d13a-462f-bfc9-e8fd0c951d97 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:33.689673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-51dd7bd2-d13a-462f-bfc9-e8fd0c951d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.760114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:33.777242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2100/4168] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:33.807285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2069/4169] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:33.817303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.817303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.817610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.861571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:33.863419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.885639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2101/4170] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:33.889600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.903643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1feba9-a2af-4c3a-be2e-9d5e9f25124b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.904093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.908599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:33.913838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:33.915831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:33.916133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:33.916445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:33.917151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:33.917456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:33.919091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:33.954089 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2070/4171] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:33.962360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:33.985692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125655aa-7711-4790-a1f3-6d6245e1943a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:33.999589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.003225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.003562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.003843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.004514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.021190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.103393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bdbf3-703e-402f-8c95-b0bc31dda3f5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:34.116701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.117270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.117617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.117956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.137843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.139319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.141137 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2071/4172] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:34.145741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:34.169205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2102/4173] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:34.333414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dd7d1-2bbc-4d2f-88d9-94365464cbf1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:34.344525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.345195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.345483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.349515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.350310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.354424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.410047 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2072/4174] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:34 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:34.414473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:34.432978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b8b1-21cc-4332-b6d0-170838e6b173 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:34.444707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.446034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.446694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.447587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.448574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.451006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.468311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2103/4175] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:34.472306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:34.487495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c877b4f-8c75-4117-b0a4-0991e7f4500c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:34.497506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.498146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.498424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.498701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.499363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.501140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e3218-c51a-4c9a-ace0-bbdeb3891f57 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.523718 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2073/4176] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:34.524451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:34.537486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01f41a-2a2a-4016-bac7-3216f69e6ebf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:34.542635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:34.543300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.543574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.543844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] PATH_INFO: `/v3/projects/94c8f3e327e8486f912d15eafc4d659b/users/cef0dc360a764184a009d87d2bec9a28/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.600187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c8f3e327e8486f912d15eafc4d659b, user_id=cef0dc360a764184a009d87d2bec9a28, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:34.607733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0897c7-8e52-4823-bac9-1c78315e6f51 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:34.658426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2104/4177] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:34 2022] PUT /identity/v3/projects/94c8f3e327e8486f912d15eafc4d659b/users/cef0dc360a764184a009d87d2bec9a28/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:34.670259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.670588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.670854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.730370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] MFA Rules not processed for user `cef0dc360a764184a009d87d2bec9a28`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:34.737556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:34.856877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:34.871104 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2074/4178] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:34.883377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:34.883707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:34.883918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:34.922990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] MFA Rules not processed for user `cef0dc360a764184a009d87d2bec9a28`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:34.924255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:34.932525 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2105/4179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:35.022332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:35.024533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:35.148826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a72bc-7f8c-476d-b4ba-76bc6a932cd0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:35.155238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:35.156023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:35.156515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:35.157351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:35.172477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:35.172477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:35.196405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2075/4180] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:35.203608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:35.205900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:35.333144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d8cc-e202-4657-af97-e9b1ff119b74 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:35.338212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:35.338993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:35.339331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:35.339807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] PATH_INFO: `/v3/projects/a6f9767a514d41d588fdf30a4a66e752` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:35.341367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f9767a514d41d588fdf30a4a66e752)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:35.343554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:35.429843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:35.438642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f9767a514d41d588fdf30a4a66e752', 'request_id': 'req-7fa36418-13d5-4614-87a6-de3b7c3e6307'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.451655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f9767a514d41d588fdf30a4a66e752', 'request_id': 'req-7fa36418-13d5-4614-87a6-de3b7c3e6307'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.465195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f9767a514d41d588fdf30a4a66e752', 'request_id': 'req-7fa36418-13d5-4614-87a6-de3b7c3e6307'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.487462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] The token cache is being invalidate because project a6f9767a514d41d588fdf30a4a66e752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:35.488257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.489336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa36418-13d5-4614-87a6-de3b7c3e6307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.491929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2106/4181] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:35 2022] DELETE /identity/v3/projects/a6f9767a514d41d588fdf30a4a66e752 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:35.496726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:35.515412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8332-1541-441c-a022-9b6ff1b8f6ab service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:35.631695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:35.632330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:35.632603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:35.632870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] PATH_INFO: `/v3/users/430c675854a54bd0868d9d9c2f8dcd0b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:35.634722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] RBAC: Authorizing `identity:delete_user(user_id=430c675854a54bd0868d9d9c2f8dcd0b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:35.636645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:35.733714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430c675854a54bd0868d9d9c2f8dcd0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.738109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430c675854a54bd0868d9d9c2f8dcd0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.738925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430c675854a54bd0868d9d9c2f8dcd0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.749891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430c675854a54bd0868d9d9c2f8dcd0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.764632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a57528cc-faff-4f40-a7cc-4549acd5774b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430c675854a54bd0868d9d9c2f8dcd0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:35.775011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:35.805657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2076/4182] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:35 2022] DELETE /identity/v3/users/430c675854a54bd0868d9d9c2f8dcd0b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:36.367881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:36.369254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:36.369792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:36.407942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] MFA Rules not processed for user `6b0638e280d940d1ba1f3c78c02351c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:36.410742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:36.511076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2107/4183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:36.522474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:36.523067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:36.523067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:36.556081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] MFA Rules not processed for user `6b0638e280d940d1ba1f3c78c02351c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:36.558718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:36.571625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2077/4184] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:36.589628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:36.591552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:36.711255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00140-78ff-4db8-a517-8af8cfea1cc7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:36.721119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:36.722344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:36.722914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:36.724095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:36.735888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:36.738416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428656ca-93c8-49c9-9b86-315ae47c6c7f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:36.758566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2108/4185] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:37.007091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.009063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:37.158830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a6ea-237d-4bad-9ef9-df5900943ffd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.169508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.170300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.170677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.171173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] PATH_INFO: `/v3/projects/75bcb034a33e4427833085845444acfc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.173713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bcb034a33e4427833085845444acfc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.176670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.248175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bcb034a33e4427833085845444acfc', 'request_id': 'req-8f155bed-93cc-4870-8635-1cdef6159114'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:37.259911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bcb034a33e4427833085845444acfc', 'request_id': 'req-8f155bed-93cc-4870-8635-1cdef6159114'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:37.272935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bcb034a33e4427833085845444acfc', 'request_id': 'req-8f155bed-93cc-4870-8635-1cdef6159114'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:37.288560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] The token cache is being invalidate because project 75bcb034a33e4427833085845444acfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:37.288925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:37.289705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f155bed-93cc-4870-8635-1cdef6159114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:37.291725 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2078/4186] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:37 2022] DELETE /identity/v3/projects/75bcb034a33e4427833085845444acfc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:37.298234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.298915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.300097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.349268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:37.352171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:37.439071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:37.481174 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2109/4187] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:37.482454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.482741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.483015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.518064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:37.521137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:37.546561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2079/4188] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:37.547866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.563652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78fab-ac4a-4fff-91d3-72156b78e70f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.572728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.573824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.574556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.575028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.575940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:37.576563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.578467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.596510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2110/4189] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:37.601568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.623501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a34a57-22a7-4a81-8078-ee98b81ed618 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.635122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.636413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.637149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.639440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.640665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.645183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.691925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2080/4190] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:37 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:37.696089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.714625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b874-a83b-4d7b-a854-9e9c92b8e531 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.792334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.792882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.793368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.793552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.794189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.796726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.830112 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2111/4191] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:37 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:37.832128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.852703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ef25-8cf4-4b47-905a-e1ee00973f99 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.858416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.859322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.859796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.860226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.861107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.863514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.877087 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2081/4192] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:37.881334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.901193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff11c8e-9e05-4f9b-abad-f9bacee3b094 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.906472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.907163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.908107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.908401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] PATH_INFO: `/v3/projects/0cf8e54ffa58418989330455d1c03fb1/users/f9408b05f2934e30b11ca4d71dfcf701/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.931179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf8e54ffa58418989330455d1c03fb1, user_id=f9408b05f2934e30b11ca4d71dfcf701, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.935726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.958142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2112/4193] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:37 2022] PUT /identity/v3/projects/0cf8e54ffa58418989330455d1c03fb1/users/f9408b05f2934e30b11ca4d71dfcf701/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:37.959447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.973051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d717-e422-4a42-ac09-8cdbad8ae883 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.027523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:38.073832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.074480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.074813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.075093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.076513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.078632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138592-6210-48ef-a6d6-6bf9c779b355 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.098061 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2082/4194] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:38.099358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.116627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91863f5a-8fce-4287-b823-f11a8763a520 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.124823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.125428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.125708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.125984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] PATH_INFO: `/v3/projects/0cf8e54ffa58418989330455d1c03fb1/users/f9408b05f2934e30b11ca4d71dfcf701/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.128631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf8e54ffa58418989330455d1c03fb1, user_id=f9408b05f2934e30b11ca4d71dfcf701, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.132610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.159293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2113/4195] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:38 2022] PUT /identity/v3/projects/0cf8e54ffa58418989330455d1c03fb1/users/f9408b05f2934e30b11ca4d71dfcf701/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:38.162133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.162133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.162432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.231021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] MFA Rules not processed for user `f9408b05f2934e30b11ca4d71dfcf701`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:38.232500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:38.369176 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2083/4196] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:38.374503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.528975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273573-84b3-4139-aa71-961af4ebdda5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.543124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.544404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.544404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.544404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.544893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.547114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.614285 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2114/4197] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:38 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:38.618514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.637097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7032-12e1-43e5-84ba-5544edec72e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.722555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.723887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.724729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.725159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.726167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.728840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.771426 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2084/4198] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:38 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:38.772194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.795114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94121aa0-7e04-44be-a8f2-b22c13ed0f90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.826236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.827266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.827483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.827785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.828449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.838732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.883096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2115/4199] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:38.890716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.903095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51292-cc02-46f1-b99a-b4b4b3cf03c7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:38.907939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:38.908554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:38.908810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:38.909226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:38.911281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:38.921890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283840c-019a-4a8b-8629-4d1b67d287e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:38.963764 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2085/4200] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:38.968046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:38.981084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:38.998650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf8563-5d13-4577-b1fb-b6eb56c776f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:39.018459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:39.019145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:39.019419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:39.019688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] PATH_INFO: `/v3/projects/3e7eaccef2bd4134850159b2dfd825f1/users/c70d012c57c54f2aa023af6e91c355f7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:39.084407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7eaccef2bd4134850159b2dfd825f1, user_id=c70d012c57c54f2aa023af6e91c355f7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:39.087862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:39.144565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2116/4201] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:38 2022] PUT /identity/v3/projects/3e7eaccef2bd4134850159b2dfd825f1/users/c70d012c57c54f2aa023af6e91c355f7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:39.146258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:39.146548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:39.146824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:39.223985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] MFA Rules not processed for user `c70d012c57c54f2aa023af6e91c355f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:39.225281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:39.282348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:39.387436 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2086/4202] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:39.427649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:39.429495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:39.639989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eecee-d19b-4cba-a53a-97ea1f39c14b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:39.647282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:39.648129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:39.648600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:39.649083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:39.873578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:39.875435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137f76-c46c-4323-a260-f81098250137 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:39.897048 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2117/4203] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:41.465947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:41.584084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9dce8-dc83-4973-91e8-f17c4809b6ae None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:41.590584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:41.593504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:41.604034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:41.604535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] PATH_INFO: `/v3/users/f9408b05f2934e30b11ca4d71dfcf701` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:41.610878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9408b05f2934e30b11ca4d71dfcf701)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:41.614770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:41.675211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9408b05f2934e30b11ca4d71dfcf701'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:41.676088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9408b05f2934e30b11ca4d71dfcf701'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:41.676784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9408b05f2934e30b11ca4d71dfcf701'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:41.685879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9408b05f2934e30b11ca4d71dfcf701'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:41.696867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9408b05f2934e30b11ca4d71dfcf701'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:41.726177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2087/4204] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:41 2022] DELETE /identity/v3/users/f9408b05f2934e30b11ca4d71dfcf701 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:41.727921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:41.728393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:41.728515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:41.751678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:41.753177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:41.863921 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2118/4205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:41.864836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:41.866462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:41.948580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:41.979403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225e79-801c-4333-ab95-60ae01c094a0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:41.986182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:41.987705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:41.988422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:41.988548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:42.001456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:42.003925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:42.015121 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2088/4206] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:07:42.906344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:42.910045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:42.933079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917afe-ac19-4a81-a6fa-a5329e5149c5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:42.941357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:42.946331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:42.946873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:42.947732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] PATH_INFO: `/v3/projects/0cf8e54ffa58418989330455d1c03fb1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:42.951807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf8e54ffa58418989330455d1c03fb1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:42.954626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:43.013497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:43.063259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf8e54ffa58418989330455d1c03fb1', 'request_id': 'req-977141a0-27b7-47ee-8934-3078ac134d4b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.072370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf8e54ffa58418989330455d1c03fb1', 'request_id': 'req-977141a0-27b7-47ee-8934-3078ac134d4b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.085176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf8e54ffa58418989330455d1c03fb1', 'request_id': 'req-977141a0-27b7-47ee-8934-3078ac134d4b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.099745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] The token cache is being invalidate because project 0cf8e54ffa58418989330455d1c03fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:43.100307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.101199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.104141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2119/4207] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:42 2022] DELETE /identity/v3/projects/0cf8e54ffa58418989330455d1c03fb1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:43.108874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:43.128246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19a8e-8baf-4e33-83ae-a5381c46ee06 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:43.267180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:43.267898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:43.268778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:43.269139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] PATH_INFO: `/v3/users/c70d012c57c54f2aa023af6e91c355f7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:43.270633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70d012c57c54f2aa023af6e91c355f7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:43.279923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:43.395343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70d012c57c54f2aa023af6e91c355f7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.397734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70d012c57c54f2aa023af6e91c355f7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.399335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70d012c57c54f2aa023af6e91c355f7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.418637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70d012c57c54f2aa023af6e91c355f7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.432179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47cc4949-b65e-4666-8f05-821cd7926a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70d012c57c54f2aa023af6e91c355f7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:43.466321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2089/4208] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:43 2022] DELETE /identity/v3/users/c70d012c57c54f2aa023af6e91c355f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:07:44.785523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:44.787121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:44.808503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977141a0-27b7-47ee-8934-3078ac134d4b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:44.924699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:44.925747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:44.926028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:44.926299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] PATH_INFO: `/v3/projects/3e7eaccef2bd4134850159b2dfd825f1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:44.929646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7eaccef2bd4134850159b2dfd825f1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:44.933718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:45.040962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7eaccef2bd4134850159b2dfd825f1', 'request_id': 'req-67ca8294-c106-49d8-9077-692f7755ebb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:45.050258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7eaccef2bd4134850159b2dfd825f1', 'request_id': 'req-67ca8294-c106-49d8-9077-692f7755ebb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:45.064343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7eaccef2bd4134850159b2dfd825f1', 'request_id': 'req-67ca8294-c106-49d8-9077-692f7755ebb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:45.108403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] The token cache is being invalidate because project 3e7eaccef2bd4134850159b2dfd825f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:45.108701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:45.109658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-67ca8294-c106-49d8-9077-692f7755ebb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:45.112844 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2120/4209] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:44 2022] DELETE /identity/v3/projects/3e7eaccef2bd4134850159b2dfd825f1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:45.117476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.118030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.118030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.177855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:45.179240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:45.344425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.344707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.345009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.349665 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2090/4210] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:45.385127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:45.387173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:45.411938 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2121/4211] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:45.416936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:45.441545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf64fc2-dae5-42f6-920f-12686b36c4ae None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:45.458382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:45.459006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.459278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.459543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.460192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:45.460549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:45.465295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:45.471009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:45.531704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2091/4212] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:45.536430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:45.547916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4a145-3991-4392-bd37-6899e777c734 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:45.567297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:45.568287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.568287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.568515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.573909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:45.584679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:45.659929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2122/4213] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:45 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:45.664116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:45.681395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591210ef-24a7-43c3-af0c-cb792260e3ea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:45.838437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:45.839296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.839661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.839896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.844181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:45.844759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:45.904107 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2092/4214] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:45 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:45.906146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:45.915072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:45.922124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dafb-0c84-49ab-a43e-26ee8b0d8539 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:45.934907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:45.935787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.936411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.936853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.938154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:45.941670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:45.967505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2123/4215] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:45.971277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:45.981938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63949-4b58-40fc-b204-fb9b5c97f435 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:45.987274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:45.988146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:45.988665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:45.989134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:45.989936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:45.992951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d27733-fab8-4f5f-bea6-d4b29363d14f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:46.009907 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2093/4216] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:07:46.014152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:46.035255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5eb01-50af-43cb-857e-f842da685d8e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:46.043898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:46.044807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:46.045792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:46.046243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] PATH_INFO: `/v3/projects/e990db67781247c3964d8aa5cc25f877/users/9e6d4b31118c486ca8cc16ab62df9063/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:46.063208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e990db67781247c3964d8aa5cc25f877, user_id=9e6d4b31118c486ca8cc16ab62df9063, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:46.067965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:46.123907 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2124/4217] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:46 2022] PUT /identity/v3/projects/e990db67781247c3964d8aa5cc25f877/users/9e6d4b31118c486ca8cc16ab62df9063/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:46.126666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca721-99e8-4747-adcf-d020c07243d2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:46.127131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca721-99e8-4747-adcf-d020c07243d2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:46.127280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca721-99e8-4747-adcf-d020c07243d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:46.209986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3d0ca721-99e8-4747-adcf-d020c07243d2 None None] MFA Rules not processed for user `9e6d4b31118c486ca8cc16ab62df9063`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:46.211231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d0ca721-99e8-4747-adcf-d020c07243d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:46.391282 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2094/4218] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:46.403108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:46.405157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:46.515486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb7932-c1d2-4bfd-880b-da9dc63b2f1f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:46.526312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:46.528384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:46.532198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:46.532728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:46.562815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:46.567473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:46.621622 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2125/4219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:46.922996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0791f7-1347-4dad-8b1f-acbd057b7286 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:46.923333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0791f7-1347-4dad-8b1f-acbd057b7286 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:46.923576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0791f7-1347-4dad-8b1f-acbd057b7286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:46.974025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ae0791f7-1347-4dad-8b1f-acbd057b7286 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:46.975571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae0791f7-1347-4dad-8b1f-acbd057b7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:47.098322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:47.116298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2095/4220] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:47.151813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:47.153936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:47.302570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae849d-87f1-4abe-a711-4d0ec694877a service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:47.314247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:47.316503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:47.317037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:47.317541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:47.338069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:47.340199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:47.375447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2126/4221] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:47.956492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a596efa-4b5c-4c2b-a290-53380de451f5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:47.957431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a596efa-4b5c-4c2b-a290-53380de451f5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:47.957888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a596efa-4b5c-4c2b-a290-53380de451f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:47.982944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1a596efa-4b5c-4c2b-a290-53380de451f5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:47.985105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1a596efa-4b5c-4c2b-a290-53380de451f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:48.001872 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2096/4222] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:48.016241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:48.031945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed80fe-f241-41e7-9f49-679c2cd1e8c0 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:48.038741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:48.039489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:48.039757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:48.040364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:48.053667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:48.055430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:48.073949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2127/4223] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:48.767107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb61b8-1ada-4349-85dc-96549cc640b5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:48.767498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb61b8-1ada-4349-85dc-96549cc640b5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:48.767913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb61b8-1ada-4349-85dc-96549cc640b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:48.797208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b5fb61b8-1ada-4349-85dc-96549cc640b5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:48.798801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b5fb61b8-1ada-4349-85dc-96549cc640b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:48.808968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2097/4224] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:48.838674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:48.850699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9717c17-7ef6-40e6-bd41-ec90a333474e service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:48.856472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:48.857464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:48.858312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:48.858751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:48.870446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:48.872576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:48.890956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2128/4225] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:49.361609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b6e9-f040-4337-a1b3-291747605504 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:49.362205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b6e9-f040-4337-a1b3-291747605504 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:49.362205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b6e9-f040-4337-a1b3-291747605504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:49.386572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fd95b6e9-f040-4337-a1b3-291747605504 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:49.387808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fd95b6e9-f040-4337-a1b3-291747605504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:49.398092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2098/4226] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:49.419251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:49.431762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7df1c5-9f97-493e-9521-111871dc1044 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:49.439635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:49.440739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:49.441241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:49.441695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:49.457798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:49.459369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:49.470533 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2129/4227] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:49.920340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a55e-6eb7-4d76-84d6-c40bc9214259 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:49.920896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a55e-6eb7-4d76-84d6-c40bc9214259 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:49.922675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a55e-6eb7-4d76-84d6-c40bc9214259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:49.945160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3010a55e-6eb7-4d76-84d6-c40bc9214259 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:49.946662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3010a55e-6eb7-4d76-84d6-c40bc9214259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:49.970516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:49.982012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32cd52-4158-4268-9836-ac29690230a5 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:49.982817 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2099/4228] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:49.988105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:49.988715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:49.989037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:49.989519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:49.998497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:50.000080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:50.006944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:50.022136 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2130/4229] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:07:50.310877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea42-9c38-4e63-8cf9-39a5e98d0f05 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:50.311164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea42-9c38-4e63-8cf9-39a5e98d0f05 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:50.311434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea42-9c38-4e63-8cf9-39a5e98d0f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:50.338688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cb97ea42-9c38-4e63-8cf9-39a5e98d0f05 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:50.341231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cb97ea42-9c38-4e63-8cf9-39a5e98d0f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:50.351325 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2100/4230] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:50.378597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:50.392229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539aba6-e3a6-449a-8f31-7512c52a1335 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:50.398992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:50.400338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:50.400788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:50.401379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:50.413018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:50.414867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:50.439213 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2131/4231] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:51.461718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb053-a881-419f-884b-f057521b730e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:51.462195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb053-a881-419f-884b-f057521b730e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:51.462303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb053-a881-419f-884b-f057521b730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:51.481152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a5bbb053-a881-419f-884b-f057521b730e None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:51.482618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5bbb053-a881-419f-884b-f057521b730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:51.490793 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2101/4232] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:51.504081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:51.515774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abc5f-dc9c-41e7-a39c-b38b5e2093f8 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:51.521126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:51.521711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:51.521993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:51.522257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:51.531787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:51.533689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:51.543023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2132/4233] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:51.758437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f33f-fbcd-45fd-9197-0a8401769f7c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:51.758721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f33f-fbcd-45fd-9197-0a8401769f7c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:51.758996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f33f-fbcd-45fd-9197-0a8401769f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:51.782190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-96e3f33f-fbcd-45fd-9197-0a8401769f7c None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:51.783639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-96e3f33f-fbcd-45fd-9197-0a8401769f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:51.791371 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2102/4234] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:51.805335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:51.819616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ac5c0-3646-4a1b-b671-baf932a83ecd service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:51.824825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:51.825465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:51.825747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:51.826019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:51.834663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:51.836219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:51.844243 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2133/4235] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:51.988102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173978-02ea-449a-bdae-f423255f6ce5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:51.988478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173978-02ea-449a-bdae-f423255f6ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:51.988751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173978-02ea-449a-bdae-f423255f6ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.008737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1e173978-02ea-449a-bdae-f423255f6ce5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:52.009976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e173978-02ea-449a-bdae-f423255f6ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:52.017903 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2103/4236] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:52.031026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:52.043060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310264-da5d-4561-8e53-9b587d4859fc service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:52.048359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:52.049747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.050097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.050437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.058817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:52.060503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:52.069141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2134/4237] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:52.225961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fe90-1e8f-476a-98b8-a78cd9f354e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.226253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fe90-1e8f-476a-98b8-a78cd9f354e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.226528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fe90-1e8f-476a-98b8-a78cd9f354e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.248148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-16b8fe90-1e8f-476a-98b8-a78cd9f354e9 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:52.249418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16b8fe90-1e8f-476a-98b8-a78cd9f354e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:52.258759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2104/4238] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:52.274718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:52.289168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b45b6-da88-4066-bc17-35f0620df493 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:52.294657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:52.296282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.297268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.297268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.309311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:52.311169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:52.331980 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2135/4239] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:52.577637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6749-e5b3-4013-ba96-61b293dc68ff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.578377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6749-e5b3-4013-ba96-61b293dc68ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.578377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb6749-e5b3-4013-ba96-61b293dc68ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.639501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6ffb6749-e5b3-4013-ba96-61b293dc68ff None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:52.645775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6ffb6749-e5b3-4013-ba96-61b293dc68ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:52.664447 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2105/4240] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:52.682046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:52.700950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574de47-a983-456d-9144-ac32875ddaa6 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:52.714586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:52.715218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.715498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.715772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.733331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:52.735439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:52.762587 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2136/4241] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:52.874624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78106-0365-48d2-b0c8-bc12bddcf121 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.875173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78106-0365-48d2-b0c8-bc12bddcf121 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.875615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78106-0365-48d2-b0c8-bc12bddcf121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.897669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-57f78106-0365-48d2-b0c8-bc12bddcf121 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:52.899254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57f78106-0365-48d2-b0c8-bc12bddcf121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:52.910985 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2106/4242] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:52.930113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:52.950475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7af193-3815-4069-983e-d859d11ddc19 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:52.967912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:52.969135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.970715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.972049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:52.991500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:52.992202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:52.992582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:53.011556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:53.020880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:53.041930 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2137/4243] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:53.046288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:53.056509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:53.096262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2107/4244] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:53.135192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:53.156235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861e14c-f64a-43e5-bf41-6998420a3b4b service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:53.182618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:53.186035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:53.186320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:53.186595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:53.212235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:53.214099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:53.242644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2138/4245] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:53.569851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:53.629705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:53.635299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:53.744119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e40e-cfb3-4e64-8a94-e11711ef1593 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:53.765651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:53.766601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:53.766887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:53.767236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] PATH_INFO: `/v3/users/9e6d4b31118c486ca8cc16ab62df9063` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:53.768968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6d4b31118c486ca8cc16ab62df9063)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:53.770898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12cf08-f445-4fa2-8d70-35e60df0e0c0 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:53.771381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:53.775436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:53.776239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:53.776682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:53.777159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:53.779124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:53.794983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:53.796943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4f6a2-c072-4850-8a42-82783bec2fdf service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:53.813770 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2139/4246] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:07:53.854586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6d4b31118c486ca8cc16ab62df9063'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:53.855743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6d4b31118c486ca8cc16ab62df9063'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:53.856614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6d4b31118c486ca8cc16ab62df9063'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:53.869748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6d4b31118c486ca8cc16ab62df9063'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:53.892892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6d4b31118c486ca8cc16ab62df9063'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:53.911877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:53.925925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2108/4247] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:53 2022] DELETE /identity/v3/users/9e6d4b31118c486ca8cc16ab62df9063 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:53.927201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:53.927489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:53.927789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:53.969403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:53.971611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.066269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:54.067690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.094863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:54.141806 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2140/4248] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:54.152608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:54.154946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.243783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6593-e2fe-4c50-b9bd-16043bad495e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:54.262510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:54.263171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:54.264819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:54.265132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] PATH_INFO: `/v3/users/cef0dc360a764184a009d87d2bec9a28` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:54.267194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef0dc360a764184a009d87d2bec9a28)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:54.275124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:54.299417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e1a8-62ce-47ae-82e6-941f6ca73375 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:54.308890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:54.309805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:54.310270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:54.310553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:54.339285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:54.344213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70cd4-4837-4a17-a52e-360c082b1f01 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:54.374225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2141/4249] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:54.398998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef0dc360a764184a009d87d2bec9a28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:54.401039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef0dc360a764184a009d87d2bec9a28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:54.405107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef0dc360a764184a009d87d2bec9a28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:54.434636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef0dc360a764184a009d87d2bec9a28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:54.443590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef0dc360a764184a009d87d2bec9a28'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:54.475963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2109/4250] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:07:54 2022] DELETE /identity/v3/users/cef0dc360a764184a009d87d2bec9a28 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:54.480403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:54.480685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:54.481100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:54.523056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:54.524207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.652438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2142/4251] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:54.682705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:54.684317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.823734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499f57-7f3b-451b-b97f-fd9cd4170803 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:54.834071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:54.834708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:54.834992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:54.835272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:54.860313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:54.861836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1c0c-5e33-4b64-a9d9-83f64abd521e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:54.884658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2110/4252] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:55.354807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:55.357155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:55.373423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0c468-0208-439d-88a5-7bbca1e51cbd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:55.379842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:55.380939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.381410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.381850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] PATH_INFO: `/v3/projects/e990db67781247c3964d8aa5cc25f877` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.384014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e990db67781247c3964d8aa5cc25f877)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:55.386273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:55.496128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e990db67781247c3964d8aa5cc25f877', 'request_id': 'req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:55.514778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e990db67781247c3964d8aa5cc25f877', 'request_id': 'req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:55.531712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e990db67781247c3964d8aa5cc25f877', 'request_id': 'req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:55.553729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] The token cache is being invalidate because project e990db67781247c3964d8aa5cc25f877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:55.554023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:55.554703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a970af82-7d8a-4e3d-8e6d-1b42ac10e14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:55.557660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2143/4253] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:55 2022] DELETE /identity/v3/projects/e990db67781247c3964d8aa5cc25f877 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:55.562619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.562977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.563326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.615542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:55.617406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:55.638762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:55.707323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2111/4254] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:55.716130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.716793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.717320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.805892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:55.806294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:55.833160 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2144/4255] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:55.837639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:55.856424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b45f9-8ac4-4aaf-9da7-23ed0b63857f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:55.858573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:55.865475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:55.867628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:55.871174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.871463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.872295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.873562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:55.874335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:55.879482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:55.897149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1010f8-6faf-46ce-af04-154adacc2b4a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:55.910143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:55.910986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.911265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.911533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] PATH_INFO: `/v3/projects/94c8f3e327e8486f912d15eafc4d659b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.913680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c8f3e327e8486f912d15eafc4d659b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:55.917484 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2112/4256] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:07:55.917660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:55.918422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:55.934013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:55.958429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab8f-5c8b-410c-8c45-1ea86b823357 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:55.969654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:55.973197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:55.973571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:55.973854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:55.976161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:55.982362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.006707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c8f3e327e8486f912d15eafc4d659b', 'request_id': 'req-a2148499-4807-4dac-a093-bdc2793e940d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:56.015705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c8f3e327e8486f912d15eafc4d659b', 'request_id': 'req-a2148499-4807-4dac-a093-bdc2793e940d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:56.045863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c8f3e327e8486f912d15eafc4d659b', 'request_id': 'req-a2148499-4807-4dac-a093-bdc2793e940d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:56.046521 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2113/4257] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:55 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:56.050895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.087196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] The token cache is being invalidate because project 94c8f3e327e8486f912d15eafc4d659b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:07:56.102750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:56.103504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2148499-4807-4dac-a093-bdc2793e940d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:07:56.113816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2145/4258] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:55 2022] DELETE /identity/v3/projects/94c8f3e327e8486f912d15eafc4d659b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:56.123376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff665fa-70d4-445e-8190-27b026582151 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.123953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff665fa-70d4-445e-8190-27b026582151 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.124476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff665fa-70d4-445e-8190-27b026582151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.150513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-eff665fa-70d4-445e-8190-27b026582151 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:56.152071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eff665fa-70d4-445e-8190-27b026582151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:56.228658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15409-ab89-44cd-ba14-befaf07de331 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.248576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.249386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.249678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.250531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.251917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.253918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.308410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2114/4259] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:56.309698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.312495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:56.329726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082dd6c-dd38-4117-88b4-f102d530e2cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.340327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.342201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.342491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.342768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.343503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.345473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.366425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2146/4260] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:56.370516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2115/4261] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:56.374607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.375522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.375819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.376094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.390960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4569fc4-db71-4a9d-a7da-291510e70912 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.408335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:56.408571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.410703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:56.410996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.411313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.411593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.414198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.418443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.424597 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2147/4262] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:56.425638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.435876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea176-eea9-48e1-8318-b3185df45443 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.444258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.445001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.445350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.445694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.446439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:07:56.446811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.446938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2116/4263] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:56.449511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.451177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.467223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2148/4264] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:07:56.472523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.485178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef70ab9-fca6-46d0-a154-050f8c3634b8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.488216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbbd56-c1b0-4c58-aae0-8c9680b7354c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.491644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.492675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.493055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.493401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.494112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.496115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.518372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.521878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.522180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.522784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] PATH_INFO: `/v3/projects/d09438d1893b446ab711dce42ae22a85/users/c02613abd2904388b5a081e301a17714/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.558731 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2149/4265] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:56.561371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09438d1893b446ab711dce42ae22a85, user_id=c02613abd2904388b5a081e301a17714, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.564949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12765210-9da4-4062-9e33-1643db249a1e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.565122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.606699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2117/4266] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:56 2022] PUT /identity/v3/projects/d09438d1893b446ab711dce42ae22a85/users/c02613abd2904388b5a081e301a17714/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:56.619896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.620257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.620956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.681988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] MFA Rules not processed for user `c02613abd2904388b5a081e301a17714`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:56.683891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:56.717220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d90-7f51-4b79-9089-2b1cbf2a9792 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.721997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:56.739593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:56.797869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.799656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.800116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.800443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.801062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.803232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.827724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2118/4267] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:56.832511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.851629 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2150/4268] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:07:56.855688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.859750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faa021-1b2e-46e4-afe5-29be6e60dac5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.866310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.867258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.867938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.868440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.869535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.872166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.873886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a232e-d503-43c1-a1af-935390e27da6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:56.882953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:56.883582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:56.883918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:56.884195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:56.884894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:56.886779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:56.902646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2151/4269] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:56.913487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2119/4270] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:56.922071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.928862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:56.962138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbe20-09f1-46e4-befb-54d0231e7a67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.070916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec930-6018-4435-aa97-7c78b1dc3643 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.088316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.090380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.091714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.093137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.094004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.098060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.131608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.132375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.132858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.133284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.134297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.137065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.154247 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2120/4271] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:07:56 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:07:57.158951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.172504 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2152/4272] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:57.175252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.190328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c750eae-ef80-4df4-8a68-01d6917ca64f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.211033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.212967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88d05c-c83f-4370-9f57-c07bc29b2aaa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.217450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.217759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.218045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.220005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.226274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.236751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.237648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.238298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.238581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] PATH_INFO: `/v3/projects/938d52ca99bf461d9175ab267ef56ae5/users/05b11268812b415bbe36c1980bea37b6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.263845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2121/4273] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:07:57.267801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.291226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938d52ca99bf461d9175ab267ef56ae5, user_id=05b11268812b415bbe36c1980bea37b6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.297639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330971-d0a6-4350-93db-a3cf84533ac6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.302224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ac981-16f3-4524-a714-c86aa13b9f84 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.320022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.320491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.320772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.321218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] PATH_INFO: `/v3/projects/116b54496bd540d483aedfd487ba02b0/users/5c238b160c5f40c2983f5ab8ac5972b2/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.336919 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2153/4274] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:57 2022] PUT /identity/v3/projects/938d52ca99bf461d9175ab267ef56ae5/users/05b11268812b415bbe36c1980bea37b6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:57.340478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.341475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.342388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.358143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116b54496bd540d483aedfd487ba02b0, user_id=5c238b160c5f40c2983f5ab8ac5972b2, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.360849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.384162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2122/4275] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:57 2022] PUT /identity/v3/projects/116b54496bd540d483aedfd487ba02b0/users/5c238b160c5f40c2983f5ab8ac5972b2/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:57.387322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:57.388225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.390170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:57.520626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:57.534609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:57.553233 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2154/4276] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:57.554454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.556338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:57.571668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a0d3c-37cc-4041-b135-aae0753f7539 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.603380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.604016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.604294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.604562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.605255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.606877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.640082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2123/4277] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:07:57.641102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.658981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ae5ec-d893-42a5-997a-cfb5b6c8f25a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.672429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.673173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.673992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.674269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] PATH_INFO: `/v3/projects/116b54496bd540d483aedfd487ba02b0/users/5c238b160c5f40c2983f5ab8ac5972b2/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.682231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=116b54496bd540d483aedfd487ba02b0, user_id=5c238b160c5f40c2983f5ab8ac5972b2, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.685183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3089165-d2a9-405d-8411-99c971d88d9c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.729926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2124/4278] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:07:57 2022] PUT /identity/v3/projects/116b54496bd540d483aedfd487ba02b0/users/5c238b160c5f40c2983f5ab8ac5972b2/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:07:57.741129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.741448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.741680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.763528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf5528-b415-46ea-9c16-097e36710e61 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.801807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] MFA Rules not processed for user `5c238b160c5f40c2983f5ab8ac5972b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:57.803058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:57.839900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.840604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.841349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.841629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.957229 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2125/4279] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:57.976045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.977824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:57.988971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.992867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:58.002655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e99bd-0613-4cf9-b6d3-40f821d1e797 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:58.010787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:58.011408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:58.011689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:58.011960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:58.020955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2155/4280] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:58.118135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:58.138033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:58.154499 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2126/4281] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:07:58.972070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:58.994438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789f362-862b-4ece-9719-c36978a6c7ab service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:59.011183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:59.014263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:59.014660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:59.016186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:59.048444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:59.050146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:59.081173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2156/4282] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:04.431388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:04.432515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:04.506179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60e86-2332-44d4-a712-9e7a5af67b05 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:04.511011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:04.511661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:04.511942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:04.512221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] PATH_INFO: `/v3/users/f864f72343c84ff4a54ef0467bf34c04` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:04.527919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f864f72343c84ff4a54ef0467bf34c04)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:04.531342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:04.672852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:04.728499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f864f72343c84ff4a54ef0467bf34c04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:04.729529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f864f72343c84ff4a54ef0467bf34c04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:04.730315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f864f72343c84ff4a54ef0467bf34c04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:04.745034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f864f72343c84ff4a54ef0467bf34c04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:04.807768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db074827-1896-460e-a306-61a456d063b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f864f72343c84ff4a54ef0467bf34c04'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:04.899786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2127/4283] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:04 2022] DELETE /identity/v3/users/f864f72343c84ff4a54ef0467bf34c04 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:06.255277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:06.275173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b15-1d40-440f-bcd6-0ce1663cca84 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:06.276398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b15-1d40-440f-bcd6-0ce1663cca84 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:06.276961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b15-1d40-440f-bcd6-0ce1663cca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:06.383804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe4bf-041f-443b-bf09-b0e40b57ceee service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:06.403261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ca3c7b15-1d40-440f-bcd6-0ce1663cca84 None None] MFA Rules not processed for user `6b0638e280d940d1ba1f3c78c02351c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:06.408326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca3c7b15-1d40-440f-bcd6-0ce1663cca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:06.453555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:06.543718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:06.544645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:06.545366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:06.546018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] PATH_INFO: `/v3/projects/71a60b6f0d084d349f2cd19041175d4b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:06.547538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a60b6f0d084d349f2cd19041175d4b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:06.550171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:06.589144 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2128/4284] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:06.612280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26899-5303-400d-b7b3-1e005d541a90 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:06.614327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26899-5303-400d-b7b3-1e005d541a90 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:06.615021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f26899-5303-400d-b7b3-1e005d541a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:06.668994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a60b6f0d084d349f2cd19041175d4b', 'request_id': 'req-09f72859-1664-4c81-8863-395b6e64c711'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:06.697435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a60b6f0d084d349f2cd19041175d4b', 'request_id': 'req-09f72859-1664-4c81-8863-395b6e64c711'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:06.701130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c7f26899-5303-400d-b7b3-1e005d541a90 None None] MFA Rules not processed for user `6859db32b98f4caba7379962eaef9de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:06.707252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c7f26899-5303-400d-b7b3-1e005d541a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:06.729347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a60b6f0d084d349f2cd19041175d4b', 'request_id': 'req-09f72859-1664-4c81-8863-395b6e64c711'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:06.795443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] The token cache is being invalidate because project 71a60b6f0d084d349f2cd19041175d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:06.795722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:06.803647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09f72859-1664-4c81-8863-395b6e64c711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:06.817814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2157/4285] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:06 2022] DELETE /identity/v3/projects/71a60b6f0d084d349f2cd19041175d4b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:06.819329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:06.819621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:06.819898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:06.881991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:06.883266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:06.977823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2129/4286] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:07.043983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2158/4287] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:07.044746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.045122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.045397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.105366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:07.107035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:07.135273 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2130/4288] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:07.139445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.158581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeec7f6-82d7-4dc6-848f-01033ef5864a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.178028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.178742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.178930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.179203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.179867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:07.206091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.206091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.249779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.250041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2159/4289] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:07.256223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143caaf-2a80-4ed1-ad05-e746442485e8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.266391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.269257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.269578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.270197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.270595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.273605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.318186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2131/4290] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:07 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:07.321828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.339544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1c82-fd26-44c4-8cd4-4bfd362e24d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.417133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:07.494523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.496491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.498050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.499861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.505470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.510589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.592557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.613299 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2160/4291] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:07 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:07.617420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1b236-2aa6-40a0-9d3a-eff28e7da966 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.631813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.632537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.632886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.633239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.635251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.637168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.676188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2132/4292] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:07.677699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.700081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a056f-986b-4653-b157-b642fb0ad3ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.713871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.714856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.715374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.715860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.716712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.718710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7da2-a214-420d-8500-51cbf1695d42 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.748403 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2161/4293] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:07.750796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:07.758818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:07.772196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fbf7-6b8c-4ab3-8df2-076753e99645 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:07.787167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:07.788511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.788940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.789508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] PATH_INFO: `/v3/projects/fc74310d959f480f807680afc8db2ff2/users/a7863b10a42a4238ab12c24c909ed6a1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.826340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc74310d959f480f807680afc8db2ff2, user_id=a7863b10a42a4238ab12c24c909ed6a1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:07.829982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:07.877230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:07.878038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:07.878423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:07.881895 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2133/4294] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:07 2022] PUT /identity/v3/projects/fc74310d959f480f807680afc8db2ff2/users/a7863b10a42a4238ab12c24c909ed6a1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:07.939748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] MFA Rules not processed for user `a7863b10a42a4238ab12c24c909ed6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:07.940316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:08.116786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2162/4295] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:08.122411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:08.285597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ddbc6-b817-4f21-8845-c16bc59c8b30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:08.297637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:08.298959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:08.299238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:08.299507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:08.300148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:08.304142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:08.373357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:08.380138 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2134/4296] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:08 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:08.394976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6fac-1f7a-4ef3-83d4-53f8dfad2ca8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:08.540621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:08.541291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:08.541572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:08.541847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:08.542563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:08.544749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:08.601701 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2163/4297] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:08 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:08.605678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:08.620516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f670-03e1-47f5-9904-fd56e4abb259 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:08.626422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:08.627481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:08.627867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:08.628362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:08.629165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:08.632225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:08.645773 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2135/4298] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:08.649484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:08.666654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759808-3d89-495b-9608-43bfd694a157 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:08.681394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:08.684548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:08.685914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:08.686664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] PATH_INFO: `/v3/projects/1767b01b55d847418e690c5ed0c21a8d/users/c64bb123be4142a9bc526d4f6b730a56/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:08.723223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1767b01b55d847418e690c5ed0c21a8d, user_id=c64bb123be4142a9bc526d4f6b730a56, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:08.726519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:08.772606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2164/4299] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:08 2022] PUT /identity/v3/projects/1767b01b55d847418e690c5ed0c21a8d/users/c64bb123be4142a9bc526d4f6b730a56/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:08.777262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:08.796349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1fafa-47ab-483a-9f7a-e4c433c5a695 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:09.019897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:09.020867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:09.021058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:09.021401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:09.022173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:09.024175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554460-fd74-4674-a1ba-033de4aa1fe9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:09.039825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2136/4300] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:09.044831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:09.066824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93032b4f-d94e-4152-9ed1-7f1b073a5b18 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:09.085784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:09.086823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:09.087304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:09.087806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] PATH_INFO: `/v3/projects/1767b01b55d847418e690c5ed0c21a8d/users/c64bb123be4142a9bc526d4f6b730a56/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:09.090765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1767b01b55d847418e690c5ed0c21a8d, user_id=c64bb123be4142a9bc526d4f6b730a56, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:09.100490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:09.130061 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2165/4301] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:09 2022] PUT /identity/v3/projects/1767b01b55d847418e690c5ed0c21a8d/users/c64bb123be4142a9bc526d4f6b730a56/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:09.140617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:09.141467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:09.142776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:09.211220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] MFA Rules not processed for user `c64bb123be4142a9bc526d4f6b730a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:09.212361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:09.313337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:09.395567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2137/4302] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:09.396250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:09.406686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:09.421867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334cbe-7543-4aee-bcd0-d26e60db80c8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:09.452790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:09.456883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:09.462960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:09.463322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:09.471137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:09.483234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:09.568933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2166/4303] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:09 2022] POST /identity/v3/domains => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:09.573754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:09.588356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e299-1a15-42bd-b48a-61ade3cec7b9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:09.743285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:09.743285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:09.743285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:09.743733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:09.743733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:09.743733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:09.847541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2138/4304] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:09 2022] POST /identity/v3/projects => generated 408 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:09.848653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:09.887257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe1d9c-24d7-4f4b-bda5-fb7d2949d4cb tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:10.122679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:10.123354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.123639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.123919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:10.125151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:10.130841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:10.165329 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2167/4305] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:09 2022] POST /identity/v3/users => generated 346 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:10.169410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:10.183712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20866e8-f464-4b8d-8d66-64b763ab1525 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:10.215144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:10.215825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.216117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.216398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:10.217107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:10.231802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f45bf-8cbc-4e13-bbf8-c3474791b9b4 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:10.277812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2139/4306] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:10.282031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:10.297090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad132-5528-4ced-a3ff-1e015ee23fb9 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:10.306875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:10.309767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.310060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.310340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/projects/7bed0582705144e7a5325c5e0fe316c1/users/a9c1a52ae11e4d09a3b5635a89391453/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:10.342263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7bed0582705144e7a5325c5e0fe316c1, user_id=a9c1a52ae11e4d09a3b5635a89391453, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:10.346721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b532c5-71e2-4837-ab2b-73d70747fb19 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:10.397659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.398206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.398305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:10.401962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2168/4307] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:10 2022] PUT /identity/v3/projects/7bed0582705144e7a5325c5e0fe316c1/users/a9c1a52ae11e4d09a3b5635a89391453/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:10.876743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] MFA Rules not processed for user `a9c1a52ae11e4d09a3b5635a89391453`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:10.878098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:10.911950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.912232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.912509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:10.917355 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2140/4308] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:10 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:10.942625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] MFA Rules not processed for user `a9c1a52ae11e4d09a3b5635a89391453`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:10.944069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:10.960203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:10.960518 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2169/4309] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:10 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:10.973607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f771-244c-42e8-8f68-6fe60823b938 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:10.993447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9c1a52ae11e4d09a3b5635a89391453', 'user_domain_id': 'e26355419027417a9ba85d8bce6fdba6', 'system_scope': None, 'project_id': '7bed0582705144e7a5325c5e0fe316c1', 'project_domain_id': 'e26355419027417a9ba85d8bce6fdba6', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:10.994139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:10.994565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:10.999191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:11.012957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:11.027996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:11.030201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:11.060709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2141/4310] 10.222.0.16 () {56 vars in 1284 bytes} [Fri Oct 28 10:08:10 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:08:11.065756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:11.328266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a7df7-1296-422f-b36e-4f08199fa16f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:11.347212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:11.347881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:11.348189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:11.348440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/users/a9c1a52ae11e4d09a3b5635a89391453` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:11.357857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a9c1a52ae11e4d09a3b5635a89391453)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:11.359873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:11.505371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c1a52ae11e4d09a3b5635a89391453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:11.508612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c1a52ae11e4d09a3b5635a89391453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:11.517041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:11.523557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c1a52ae11e4d09a3b5635a89391453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:11.540219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c1a52ae11e4d09a3b5635a89391453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:11.541238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c1a52ae11e4d09a3b5635a89391453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:11.576441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2170/4311] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:11 2022] DELETE /identity/v3/users/a9c1a52ae11e4d09a3b5635a89391453 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:11.587632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:11.608066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33d5a-b352-438f-be20-d0679aa7eb2d tempest-test_project-992181392 tempest-user-46325260] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:11.753914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:11.757849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:11.803248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:11.810068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:11.810206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:11.810510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/projects/7bed0582705144e7a5325c5e0fe316c1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:11.812299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bed0582705144e7a5325c5e0fe316c1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:11.815991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:11.986278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bed0582705144e7a5325c5e0fe316c1', 'request_id': 'req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.013793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bed0582705144e7a5325c5e0fe316c1', 'request_id': 'req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.035401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bed0582705144e7a5325c5e0fe316c1', 'request_id': 'req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.069427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] The token cache is being invalidate because project 7bed0582705144e7a5325c5e0fe316c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:12.076331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.081986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.090457 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2142/4312] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:11 2022] DELETE /identity/v3/projects/7bed0582705144e7a5325c5e0fe316c1 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:12.091427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:12.100810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:12.117204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e465c8-1d8c-4acb-b504-71e1a31bfa80 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:12.414562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd1c31-10ad-446c-9970-9ef2f3bf2980 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:12.445806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:12.446475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:12.446757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:12.447033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/domains/e26355419027417a9ba85d8bce6fdba6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:12.467340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e26355419027417a9ba85d8bce6fdba6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:12.469083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:12.568564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:12.569419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:12.569574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:12.582720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:12.588769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:12.633033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.645793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.699074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:12.761102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.768271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:12.788525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2143/4313] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:08:12 2022] PATCH /identity/v3/domains/e26355419027417a9ba85d8bce6fdba6 => generated 247 bytes in 697 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:12.792480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:12.794518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:12.849152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:12.898239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:12.900369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:12.946775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2171/4314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:13.021930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6e21a-ffb3-4aea-8f31-ae8519bfacb6 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:13.037197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c64bb123be4142a9bc526d4f6b730a56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1767b01b55d847418e690c5ed0c21a8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:13.038053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:13.038478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:13.038904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] PATH_INFO: `/v3/domains/e26355419027417a9ba85d8bce6fdba6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:13.095209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e26355419027417a9ba85d8bce6fdba6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:13.103129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:13.169730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.176528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.388599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.406560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.427723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.449519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] The token cache is being invalidate because project e26355419027417a9ba85d8bce6fdba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:13.450243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.456821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.488839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.492683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.495109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-870c6348-65de-4f2b-932c-05712854e204 tempest-TestDefaultProjectId-899641014 tempest-TestDefaultProjectId-899641014-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e26355419027417a9ba85d8bce6fdba6', 'request_id': 'req-870c6348-65de-4f2b-932c-05712854e204'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:13.502956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2144/4315] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:12 2022] DELETE /identity/v3/domains/e26355419027417a9ba85d8bce6fdba6 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:13.508864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:13.510358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:13.622529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf54d4-bdb9-46ac-923f-a08e9344561f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:13.832847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:13.833642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:13.833788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:13.834061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] PATH_INFO: `/v3/users/a7863b10a42a4238ab12c24c909ed6a1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:13.837857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7863b10a42a4238ab12c24c909ed6a1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:13.841203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:14.011945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7863b10a42a4238ab12c24c909ed6a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:14.013934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7863b10a42a4238ab12c24c909ed6a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:14.031931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7863b10a42a4238ab12c24c909ed6a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:14.080176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7863b10a42a4238ab12c24c909ed6a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:14.103882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7863b10a42a4238ab12c24c909ed6a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:14.187933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2172/4316] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:13 2022] DELETE /identity/v3/users/a7863b10a42a4238ab12c24c909ed6a1 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:14.190068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf35e-392f-4e0c-b841-d2d10cd5f6a5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:14.191464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf35e-392f-4e0c-b841-d2d10cd5f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:14.191762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf35e-392f-4e0c-b841-d2d10cd5f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:14.237106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2b6bf35e-392f-4e0c-b841-d2d10cd5f6a5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:14.238426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2b6bf35e-392f-4e0c-b841-d2d10cd5f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:14.290073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:14.382513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2145/4317] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:14.598284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:14.613788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:14.721938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:14.920980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4db4-53fd-4622-aac5-5687d07f6964 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:14.939015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:14.940920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:14.941342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:14.946869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:14.997636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:15.004698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b038d8-7074-426d-8647-365692749b29 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:15.038020 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2173/4318] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:17.196954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:17.197462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:17.197690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:17.307555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] MFA Rules not processed for user `05b11268812b415bbe36c1980bea37b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:17.315066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:17.504486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2146/4319] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:17.618258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:17.620043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:17.620767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:17.670539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] MFA Rules not processed for user `05b11268812b415bbe36c1980bea37b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:17.672404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:17.700412 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2174/4320] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:08:17.704190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:17.705745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:17.711753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:17.721666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:17.732745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd522ac-fdf4-436c-881f-558804407b7c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:17.746216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:17.747240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:17.747702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:17.748157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] PATH_INFO: `/v3/projects/fc74310d959f480f807680afc8db2ff2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:17.749670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc74310d959f480f807680afc8db2ff2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:17.751820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:17.894628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc74310d959f480f807680afc8db2ff2', 'request_id': 'req-74c6a75e-1306-4ab3-8985-b417d64066f0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:17.911370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc74310d959f480f807680afc8db2ff2', 'request_id': 'req-74c6a75e-1306-4ab3-8985-b417d64066f0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:17.925517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc74310d959f480f807680afc8db2ff2', 'request_id': 'req-74c6a75e-1306-4ab3-8985-b417d64066f0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:17.951304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] The token cache is being invalidate because project fc74310d959f480f807680afc8db2ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:17.952240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:17.953502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:17.959069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1c85c-2de6-4aac-923c-f7279b76d82c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:17.962651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2147/4321] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:17 2022] DELETE /identity/v3/projects/fc74310d959f480f807680afc8db2ff2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:17.963805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:17.972210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:18.085152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:18.117810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a75e-1306-4ab3-8985-b417d64066f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:18.118342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:18.118973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:18.119258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:18.119681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:18.121742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:18.124384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:18.125413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:18.126662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:18.127126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] PATH_INFO: `/v3/users/c64bb123be4142a9bc526d4f6b730a56` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:18.130443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64bb123be4142a9bc526d4f6b730a56)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:18.134006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:18.238005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:18.261707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64bb123be4142a9bc526d4f6b730a56'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:18.263176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64bb123be4142a9bc526d4f6b730a56'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:18.266152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64bb123be4142a9bc526d4f6b730a56'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:18.272773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:18.274432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:18.295621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64bb123be4142a9bc526d4f6b730a56'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:18.296126 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2175/4322] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:18.329841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71dc0d54-69a3-44c8-a285-c365aa55b6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64bb123be4142a9bc526d4f6b730a56'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:18.369454 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2148/4323] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:17 2022] DELETE /identity/v3/users/c64bb123be4142a9bc526d4f6b730a56 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:18.892560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:18.895025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:18.952644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76736c5-2066-4e61-b19b-43e27ac4c90f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:19.139667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:19.140406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:19.140743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:19.141131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:19.143096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:19.324132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:19.326665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:19.362022 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2176/4324] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:19.459778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe0c3-ec2f-4526-b690-f2419b96e914 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:19.460280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe0c3-ec2f-4526-b690-f2419b96e914 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:19.460539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe0c3-ec2f-4526-b690-f2419b96e914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:19.505396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-759fe0c3-ec2f-4526-b690-f2419b96e914 None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:19.506947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-759fe0c3-ec2f-4526-b690-f2419b96e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:19.524821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2149/4325] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:20.430704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:20.432809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:20.526258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac755d-495e-42c8-81c0-6a13f88b2000 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:20.535418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:20.537199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:20.537752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:20.538455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] PATH_INFO: `/v3/projects/1767b01b55d847418e690c5ed0c21a8d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:20.539939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1767b01b55d847418e690c5ed0c21a8d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:20.542856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:20.591767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:20.696156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1767b01b55d847418e690c5ed0c21a8d', 'request_id': 'req-b3f02142-2f41-4f64-bd91-09d65abc27a4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:20.708300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1767b01b55d847418e690c5ed0c21a8d', 'request_id': 'req-b3f02142-2f41-4f64-bd91-09d65abc27a4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:20.718945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1767b01b55d847418e690c5ed0c21a8d', 'request_id': 'req-b3f02142-2f41-4f64-bd91-09d65abc27a4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:20.749712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] The token cache is being invalidate because project 1767b01b55d847418e690c5ed0c21a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:20.749879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:20.750699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3f02142-2f41-4f64-bd91-09d65abc27a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:20.758321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:20.758891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:20.759063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:20.761861 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2177/4326] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:20 2022] DELETE /identity/v3/projects/1767b01b55d847418e690c5ed0c21a8d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:20.823704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:20.827828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:20.971920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:20.972204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:20.972502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:20.981397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2150/4327] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:21.009803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:21.011539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:21.021220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2178/4328] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:21.025356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.040176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8504-f579-40b4-9d7e-41a117d42cb1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.050746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.051385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.051665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.052029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.052591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:21.052994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.054852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.075146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.075802 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2151/4329] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:21.090166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81b588-9924-4451-a348-afb2cc490f27 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.101660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.102292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.102573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.102842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.103473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.105433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.158209 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2179/4330] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:21 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:21.159610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.178196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ea8a-c0f0-43af-80eb-ba70ece8d9e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.264956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:21.320819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.321579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.321976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.322432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.323256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.325843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.370538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2152/4331] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:21 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:21.371313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.384555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c077-5486-40c5-b63b-50041cf00f1e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.399193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.400225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.400715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.401219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.402998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.405258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.427050 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2180/4332] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:21.428487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.457257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca81fc-c615-4873-926d-fada1538b8f8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.463480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.464476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.464969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.465410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.466981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.470732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980823-6f7e-4694-9ded-c966d91de6b2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.492531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2153/4333] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:21.493951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:21.513170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac535e-f778-4066-b140-30e99675d451 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:21.529649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:21.530410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.530686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.530958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] PATH_INFO: `/v3/projects/9612f1a745504eed9d425bac6da3c780/users/17d436fc535e43d695caa4ebfb96b2db/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.576563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9612f1a745504eed9d425bac6da3c780, user_id=17d436fc535e43d695caa4ebfb96b2db, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:21.595469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:21.622480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2181/4334] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:21 2022] PUT /identity/v3/projects/9612f1a745504eed9d425bac6da3c780/users/17d436fc535e43d695caa4ebfb96b2db/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:21.633948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87472053-c167-4344-be49-968a74d164eb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:21.634839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87472053-c167-4344-be49-968a74d164eb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:21.635687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87472053-c167-4344-be49-968a74d164eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:21.701625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-87472053-c167-4344-be49-968a74d164eb None None] MFA Rules not processed for user `17d436fc535e43d695caa4ebfb96b2db`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:21.705197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87472053-c167-4344-be49-968a74d164eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:21.897760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2154/4335] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:21.902006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.019662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd241-b44c-4e7f-8c50-bf54ddafd5af admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.027889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.028839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.029587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.029919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.030667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.033752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.084249 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2182/4336] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:21 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:22.086226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87472053-c167-4344-be49-968a74d164eb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.102528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87472053-c167-4344-be49-968a74d164eb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.200490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.201223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.201537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.201903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.202625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.204663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.239527 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2155/4337] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:22 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:22.242535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.259689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11d79-b467-4f5d-9ec1-2b7b2b3e0ff3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.268658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.275981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.276480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.276934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.277726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.279677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.294279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2183/4338] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:08:22.298999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.314264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077634-9dd4-4958-95cc-3103b915a11c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.324348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.325437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.325875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.327306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] PATH_INFO: `/v3/projects/5c6b17e7795b4786ba287011c7769b8a/users/ff0e4cc9e8804da58280a0181917b207/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.356080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6b17e7795b4786ba287011c7769b8a, user_id=ff0e4cc9e8804da58280a0181917b207, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.362395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.382755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2156/4339] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:22 2022] PUT /identity/v3/projects/5c6b17e7795b4786ba287011c7769b8a/users/ff0e4cc9e8804da58280a0181917b207/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:22.386487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.412633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa957b-b60f-44d5-ac60-ca3eb6241477 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.433234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:22.554074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.554788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.555097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.557515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.558259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.564634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b3e4-1019-44eb-b91e-b163381edf39 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.629465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.641393 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2184/4340] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:08:22.646032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452cd7b-161b-4bb5-b1a1-82fbf4bbda89 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:22.660616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:22.662263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.662626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.662969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] PATH_INFO: `/v3/projects/5c6b17e7795b4786ba287011c7769b8a/users/ff0e4cc9e8804da58280a0181917b207/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.667538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6b17e7795b4786ba287011c7769b8a, user_id=ff0e4cc9e8804da58280a0181917b207, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:22.676613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:22.695287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:22.709322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:22.709601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:22.709870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:22.726248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2157/4341] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:22 2022] PUT /identity/v3/projects/5c6b17e7795b4786ba287011c7769b8a/users/ff0e4cc9e8804da58280a0181917b207/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:22.781436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] MFA Rules not processed for user `ff0e4cc9e8804da58280a0181917b207`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:22.785019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:22.965243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:22.968184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2185/4342] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:22.991921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04078a-0f08-4bd5-93f6-f6ce6ae0c8f9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:23.017998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:23.018634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:23.018917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:23.019193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:23.019823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:23.022286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:23.064177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2158/4343] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:22 2022] POST /identity/v3/projects => generated 334 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:23.066241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:23.111698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cf852-9ad5-4736-95d9-3d8b1d6b1c42 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:23.274222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:23.274856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:23.275134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:23.275412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:23.276026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:23.281298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:23.366331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2186/4344] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:08:23 2022] POST /identity/v3/projects => generated 332 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:23.367728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:23.387820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbf9a-ac5d-4ae3-acd9-f0f701638729 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:23.507123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:23.507753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:23.508396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:23.508684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:23.509354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:23.511236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:23.652105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2159/4345] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:23 2022] POST /identity/v3/projects => generated 358 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:23.656991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:23.671818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d68fd-93a5-4aed-9e8f-1a5e00f4c2b1 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:23.736624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:23.819471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:23.821300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:23.821534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:23.821788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:23.824514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:23.831962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:23.901239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:23.910197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2187/4346] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:08:23 2022] GET /identity/v3/projects => generated 7556 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:23.918873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66815b0-60b8-4147-abee-ed48cfdf561b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:23.929704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:23.930972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:23.934077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:23.935241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:23.937158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:23.937474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:23.940622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:23.991317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:23.992051 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2160/4347] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 10:08:23 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:24.007350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff5148-6fac-44de-a1bc-7fad675eefa7 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:24.021733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:24.023322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:24.024000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:24.024538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:24.025440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Adding query filter params (parent_id=192a50356acc428c8fcd61ac60377b7d) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:24.028096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:24.032457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:24.089519 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2188/4348] 10.222.0.16 () {58 vars in 1216 bytes} [Fri Oct 28 10:08:23 2022] GET /identity/v3/projects?parent_id=192a50356acc428c8fcd61ac60377b7d => generated 498 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:24.093570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:24.108605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e5392-f1ac-4a97-83c1-463b387b5277 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:24.119821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:24.120474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:24.120770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:24.121059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects/1b718e78e26642c68489406f3323a711` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:24.127656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b718e78e26642c68489406f3323a711)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:24.179243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:24.239148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b718e78e26642c68489406f3323a711', 'request_id': 'req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.247864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b718e78e26642c68489406f3323a711', 'request_id': 'req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.257536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b718e78e26642c68489406f3323a711', 'request_id': 'req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.282838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] The token cache is being invalidate because project 1b718e78e26642c68489406f3323a711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:24.283133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.283954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.288833 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2161/4349] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:24 2022] DELETE /identity/v3/projects/1b718e78e26642c68489406f3323a711 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:24.290130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:24.293616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:24.314485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148ec7f-419f-4b1f-a25e-7a8a2c8ae94e tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:24.449923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:24.450984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:24.451659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:24.452189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects/192a50356acc428c8fcd61ac60377b7d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:24.453926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:delete_project(project_id=192a50356acc428c8fcd61ac60377b7d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:24.456220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:24.555306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192a50356acc428c8fcd61ac60377b7d', 'request_id': 'req-d59e51e1-d370-4967-8e71-1c08c7c8733b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.566396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192a50356acc428c8fcd61ac60377b7d', 'request_id': 'req-d59e51e1-d370-4967-8e71-1c08c7c8733b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.613451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192a50356acc428c8fcd61ac60377b7d', 'request_id': 'req-d59e51e1-d370-4967-8e71-1c08c7c8733b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.650514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] The token cache is being invalidate because project 192a50356acc428c8fcd61ac60377b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:24.654057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.655786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.661589 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2189/4350] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:24 2022] DELETE /identity/v3/projects/192a50356acc428c8fcd61ac60377b7d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:24.666055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:24.685311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff391f-c8ce-4cbb-a02b-8524a9253ad3 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:24.718658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:24.790214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff0e4cc9e8804da58280a0181917b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c6b17e7795b4786ba287011c7769b8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:24.790938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:24.791201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:24.791717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] PATH_INFO: `/v3/projects/283aeecfc42a45c2aca9d5638b1231d0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:24.793043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorizing `identity:delete_project(project_id=283aeecfc42a45c2aca9d5638b1231d0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:24.795826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:24.896311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283aeecfc42a45c2aca9d5638b1231d0', 'request_id': 'req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.906330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283aeecfc42a45c2aca9d5638b1231d0', 'request_id': 'req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.918305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283aeecfc42a45c2aca9d5638b1231d0', 'request_id': 'req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.935478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] The token cache is being invalidate because project 283aeecfc42a45c2aca9d5638b1231d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:24.935910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.936888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1a72713f-0f03-42b6-8e3c-7fc2555f92c6 tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:24.944012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2162/4351] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:24 2022] DELETE /identity/v3/projects/283aeecfc42a45c2aca9d5638b1231d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:24.945418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:24.947253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:25.075240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:25.203874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e51e1-d370-4967-8e71-1c08c7c8733b tempest-ListProjectsTestJSON-1671036566 tempest-ListProjectsTestJSON-1671036566-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:25.303893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:25.304852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:25.305291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:25.305700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] PATH_INFO: `/v3/users/17d436fc535e43d695caa4ebfb96b2db` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:25.307348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d436fc535e43d695caa4ebfb96b2db)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:25.310296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:25.387659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d436fc535e43d695caa4ebfb96b2db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:25.389360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d436fc535e43d695caa4ebfb96b2db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:25.402696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d436fc535e43d695caa4ebfb96b2db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:25.414688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d436fc535e43d695caa4ebfb96b2db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:25.415739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d436fc535e43d695caa4ebfb96b2db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:25.437868 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2190/4352] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:24 2022] DELETE /identity/v3/users/17d436fc535e43d695caa4ebfb96b2db => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:25.442553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956fec-46c4-4843-9f64-a095344fa4ba None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:25.443040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956fec-46c4-4843-9f64-a095344fa4ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:25.443131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956fec-46c4-4843-9f64-a095344fa4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:25.469980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d3956fec-46c4-4843-9f64-a095344fa4ba None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:25.471594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d3956fec-46c4-4843-9f64-a095344fa4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:25.559631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2163/4353] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:25.639016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:25.640678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:25.753741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68d46-bff0-4aa7-9c3b-5a486a0f5888 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:25.753741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:25.753741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:25.753741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:25.754521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:25.763156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:25.764823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:25.777791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2191/4354] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:26.353054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:26.353566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:26.353785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:26.381337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:26.382846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:26.448868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:26.475255 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2164/4355] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:08:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:26.494423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:26.497449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:26.506110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:26.611993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0728a1-0669-4afc-b162-76adcf63b68f service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:26.621154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:26.622146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:26.622620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:26.623107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:26.636718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:26.638976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:26.651878 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2192/4356] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:28.570309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:28.571445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:28.713976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9a0d7-626e-4db6-8f8a-87dbced186f7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:28.721795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:28.722505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:28.722796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:28.723045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] PATH_INFO: `/v3/projects/9612f1a745504eed9d425bac6da3c780` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:28.724412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9612f1a745504eed9d425bac6da3c780)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:28.736569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:28.838279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9612f1a745504eed9d425bac6da3c780', 'request_id': 'req-9de91051-4189-4e76-be0b-5de4708e7436'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:28.852163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9612f1a745504eed9d425bac6da3c780', 'request_id': 'req-9de91051-4189-4e76-be0b-5de4708e7436'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:28.869600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9612f1a745504eed9d425bac6da3c780', 'request_id': 'req-9de91051-4189-4e76-be0b-5de4708e7436'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:28.903868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] The token cache is being invalidate because project 9612f1a745504eed9d425bac6da3c780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:28.904494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:28.905575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:28.908185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2165/4357] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:28 2022] DELETE /identity/v3/projects/9612f1a745504eed9d425bac6da3c780 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:28.912330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:28.934878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e22c9-2978-4dd7-afdf-a5ec0e6cc47a service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:29.131808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:29.134399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:29.134689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:29.137004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] PATH_INFO: `/v3/users/ff0e4cc9e8804da58280a0181917b207` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:29.139456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0e4cc9e8804da58280a0181917b207)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:29.147199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:29.269516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0e4cc9e8804da58280a0181917b207'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:29.272629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0e4cc9e8804da58280a0181917b207'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:29.291396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0e4cc9e8804da58280a0181917b207'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:29.315637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0e4cc9e8804da58280a0181917b207'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:29.323104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fd11efae-e366-400a-8741-b333dbf53afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0e4cc9e8804da58280a0181917b207'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:29.406201 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2193/4358] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:28 2022] DELETE /identity/v3/users/ff0e4cc9e8804da58280a0181917b207 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:31.553906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:31.555917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:31.596398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91051-4189-4e76-be0b-5de4708e7436 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:31.782352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:31.783154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:31.783534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:31.784001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] PATH_INFO: `/v3/projects/5c6b17e7795b4786ba287011c7769b8a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:31.785604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6b17e7795b4786ba287011c7769b8a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:31.788656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:31.905370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6b17e7795b4786ba287011c7769b8a', 'request_id': 'req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:31.918042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6b17e7795b4786ba287011c7769b8a', 'request_id': 'req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:31.923754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:31.937292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6b17e7795b4786ba287011c7769b8a', 'request_id': 'req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:31.967436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] The token cache is being invalidate because project 5c6b17e7795b4786ba287011c7769b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:31.967983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:31.969488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:31.971465 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2166/4359] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:31 2022] DELETE /identity/v3/projects/5c6b17e7795b4786ba287011c7769b8a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:31.976268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08993d6-0581-4da2-97fa-6728f8b46c28 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:31.976770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08993d6-0581-4da2-97fa-6728f8b46c28 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:31.977190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08993d6-0581-4da2-97fa-6728f8b46c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.020593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:32.129760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a08993d6-0581-4da2-97fa-6728f8b46c28 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:32.131087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a08993d6-0581-4da2-97fa-6728f8b46c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.231673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.233146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.285685 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2194/4360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:32.288195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.288527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.289854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.330113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:32.339462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.355191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2195/4361] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:32.360365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.378253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2259-fca3-496b-9d77-0f335190c24b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:32.389114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:32.391532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.392304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.392721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.394061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:32.394508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:32.405377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:32.419363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dd9-0e37-4eec-8cf0-94bfeacd28fc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:32.433475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:32.434151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.434428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.434772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] PATH_INFO: `/v3/users/c02613abd2904388b5a081e301a17714` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.435229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2196/4362] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:32.436022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02613abd2904388b5a081e301a17714)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:32.439768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.450338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:32.496420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620da4-b2fd-4cac-84ad-074d73567001 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:32.528550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:32.530933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.532255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.533192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.539793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:32.554391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:32.577971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02613abd2904388b5a081e301a17714'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:32.578907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02613abd2904388b5a081e301a17714'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:32.579709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02613abd2904388b5a081e301a17714'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:32.592120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02613abd2904388b5a081e301a17714'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:32.610412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26a42ac7-c602-4806-a8c7-04d405fed832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02613abd2904388b5a081e301a17714'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:32.655557 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2167/4363] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:32 2022] DELETE /identity/v3/users/c02613abd2904388b5a081e301a17714 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:32.660191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2197/4364] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:32 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:32.661110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.661400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.663171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.664693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.669368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.763529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:32.777558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.845544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b376e-3536-40ee-90f5-afddd47be0db admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:32.859700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:32.860502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:32.860786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:32.861089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:32.861729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:32.866431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:32.917610 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2198/4365] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:32 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:32.919153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.922073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:32.970538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2168/4366] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:32.971788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:32.988841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.004344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8367f-2f60-42b2-81a3-909a7a42b133 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.027996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.029015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.029511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.029999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.030868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.041060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.054471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.084335 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2169/4367] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:33.088543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:33.103489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1ed92-38c1-44e0-9ac5-20619d6b0ba7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.116777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f993b-fad0-4c01-92e3-7e98f16b3921 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.125873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.126818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.127277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.127726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.128619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.129352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.129716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.130050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.130767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.131314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:33.142742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.149358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.151473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.175364 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2170/4368] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:08:33.176367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:33.180920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2199/4369] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:33.191184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:33.191468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:33.206040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c2e6-9d3d-4715-a079-107f4c725e10 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.213996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.215086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.215086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.215267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] PATH_INFO: `/v3/projects/bc3a8b18ec644e54b50049d1a53e96b4/users/606d8554c97948c6a3f08f00f02ec1ea/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.244843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3a8b18ec644e54b50049d1a53e96b4, user_id=606d8554c97948c6a3f08f00f02ec1ea, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.247852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd6dc-b558-4b48-9b7f-32886d526e65 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.268473 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2200/4370] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:33 2022] PUT /identity/v3/projects/bc3a8b18ec644e54b50049d1a53e96b4/users/606d8554c97948c6a3f08f00f02ec1ea/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:33.280653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.281472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.281762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.323385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] MFA Rules not processed for user `606d8554c97948c6a3f08f00f02ec1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:33.324865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:33.383416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61090-9531-450e-b5be-2c9e45eaed41 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.471832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.473246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.473655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.474301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.521858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2201/4371] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:33.522830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:33.665425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.667000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.683944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d798-138b-490a-b83f-b61ae386c4ea None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.692429 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2171/4372] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:33.703416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.704042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.704433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.704712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.705948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.707403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.748811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.763639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2202/4373] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:33 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:33.765060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:33.777085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94a94-efd6-4b08-8f2d-3f98e5b10d21 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:33.901156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.928492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:33.929255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:33.929640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:33.929862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:33.930496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:33.941527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:33.997919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2172/4374] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:33 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:34.001820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.021656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927081-706f-4e72-9391-553b36f2e1f2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:34.036055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:34.036693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.037184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.037459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.038111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:34.039723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:34.065470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.065695 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2203/4375] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:34.079782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b9a7-b5a5-4130-87fb-e871cee1620a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:34.094384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:34.098201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.098725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.099172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] PATH_INFO: `/v3/projects/72be94b4f5c54e68a7feba245ac4e628/users/a32003230c6b4a6cb6e0a2b22a780e2f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.148191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be94b4f5c54e68a7feba245ac4e628, user_id=a32003230c6b4a6cb6e0a2b22a780e2f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:34.152799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:34.185753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2173/4376] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:34 2022] PUT /identity/v3/projects/72be94b4f5c54e68a7feba245ac4e628/users/a32003230c6b4a6cb6e0a2b22a780e2f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:34.187846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.219994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eef3c-924a-4725-8180-096175a2ce5c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:34.412727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:34.413696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.414162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.414734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.415544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:34.421107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea023af1-4332-4e97-a9ad-424fba9e9ea7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:34.435197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2204/4377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:34.439882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.452403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381379-31d6-4d6a-8e02-1d62fd0147bb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:34.462586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:34.463569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.463991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.464638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] PATH_INFO: `/v3/projects/72be94b4f5c54e68a7feba245ac4e628/users/a32003230c6b4a6cb6e0a2b22a780e2f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.470008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be94b4f5c54e68a7feba245ac4e628, user_id=a32003230c6b4a6cb6e0a2b22a780e2f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:34.476387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:34.499719 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2174/4378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:34 2022] PUT /identity/v3/projects/72be94b4f5c54e68a7feba245ac4e628/users/a32003230c6b4a6cb6e0a2b22a780e2f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:34.515072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.515632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.516063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.572706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] MFA Rules not processed for user `a32003230c6b4a6cb6e0a2b22a780e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:34.574047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:34.814633 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2205/4379] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:34.815651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.835944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343c44f-0f10-42df-9c31-44edc62f49b9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:34.855279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:34.857042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:34.859825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:34.860294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:34.864708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:34.866072 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:34.866072 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:34.866072 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:34.867394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:34.943222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2175/4380] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:34 2022] POST /identity/v3/regions => generated 224 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:34.945481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:34.963019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ed7f-663d-467d-b15f-07cc3280f9c5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.008486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.010718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.012671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.013503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.015940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.017310 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:35.017310 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:35.017310 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:35.021971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.086031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.106295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2206/4381] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:34 2022] POST /identity/v3/regions => generated 224 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:35.107435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379b93-bd73-4829-ad28-d47a5061dd8b tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.149361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.150222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.150515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.150804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/b553111e-6650-461b-9ccd-17c3c9fd9941` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.152039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:create_region(region_id=b553111e-6650-461b-9ccd-17c3c9fd9941)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.153261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.195316 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2176/4382] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 10:08:35 2022] PUT /identity/v3/regions/b553111e-6650-461b-9ccd-17c3c9fd9941 => generated 232 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:35.196654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.214739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408ddc-d259-46b3-98c8-c601bf01ad31 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.268076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.270035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.270582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.271077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/b553111e-6650-461b-9ccd-17c3c9fd9941` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.271887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b553111e-6650-461b-9ccd-17c3c9fd9941)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.273326 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:35.273326 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:35.273326 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:35.276093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.328523 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2207/4383] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:08:35 2022] DELETE /identity/v3/regions/b553111e-6650-461b-9ccd-17c3c9fd9941 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:35.333996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.361251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babf17-ff9f-46de-b326-0d68f1c2724e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.422616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.424361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.424752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.427053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.427819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.434921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.494692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2177/4384] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:08:35 2022] POST /identity/v3/regions => generated 254 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:35.498677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.517098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.519078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:35.520423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1413-7e4d-466c-aeba-4fca5ae8361c tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.553654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:35.569918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.570576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.570862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.571217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/571379eaa56742cabb00f645197f7e1e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.571920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:update_region(region_id=571379eaa56742cabb00f645197f7e1e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.579067 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:35.579067 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:35.579067 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:35.579535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.644110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2208/4385] 10.222.0.16 () {60 vars in 1250 bytes} [Fri Oct 28 10:08:35 2022] PATCH /identity/v3/regions/571379eaa56742cabb00f645197f7e1e => generated 254 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:35.648280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.687824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989521b-51c6-4d62-9436-779ca75f6568 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.706857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.707557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.707852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.708176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/571379eaa56742cabb00f645197f7e1e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.708775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:get_region(region_id=571379eaa56742cabb00f645197f7e1e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.709942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.742924 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2209/4386] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:08:35 2022] GET /identity/v3/regions/571379eaa56742cabb00f645197f7e1e => generated 254 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:08:35.747285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.769447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4254e0-a221-4092-9485-6b65f222c0be tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.782525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.783234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.783521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.783905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/571379eaa56742cabb00f645197f7e1e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.784504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=571379eaa56742cabb00f645197f7e1e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.786150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.823751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2210/4387] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:35 2022] DELETE /identity/v3/regions/571379eaa56742cabb00f645197f7e1e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:35.827244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.851114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b56cb-632e-456c-bc19-7e1050faebe8 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.876659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50739e4-d573-43b1-ba28-643cda332313 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.885316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.885954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.886237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.886513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.887322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.888421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.898026 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2211/4388] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 10:08:35 2022] GET /identity/v3/regions => generated 670 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:08:35.904223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:35.915886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.916935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.917301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.917791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] PATH_INFO: `/v3/projects/d09438d1893b446ab711dce42ae22a85` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.920065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09438d1893b446ab711dce42ae22a85)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.922983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.950761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e6c6-5b73-4347-adbf-7f73bfbac83d tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:35.966721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:35.969666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:35.975967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:35.976421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/571379eaa56742cabb00f645197f7e1e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:35.977706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=571379eaa56742cabb00f645197f7e1e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:35.980057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:35.987898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Could not find region: 571379eaa56742cabb00f645197f7e1e.: keystone.exception.RegionNotFound: Could not find region: 571379eaa56742cabb00f645197f7e1e. Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 571379eaa56742cabb00f645197f7e1e. Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:08:36.023438 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 571379eaa56742cabb00f645197f7e1e. Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:08:36.024797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2212/4389] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:35 2022] DELETE /identity/v3/regions/571379eaa56742cabb00f645197f7e1e => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:08:36.030384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:36.047452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e94871-79d3-4620-8717-86a1c45caf8e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:36.067387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09438d1893b446ab711dce42ae22a85', 'request_id': 'req-413b6fda-65b9-4b22-bd55-7c06e2860fd8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.080895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09438d1893b446ab711dce42ae22a85', 'request_id': 'req-413b6fda-65b9-4b22-bd55-7c06e2860fd8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.100604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09438d1893b446ab711dce42ae22a85', 'request_id': 'req-413b6fda-65b9-4b22-bd55-7c06e2860fd8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.125537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] The token cache is being invalidate because project d09438d1893b446ab711dce42ae22a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:36.126026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.126714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.131122 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2178/4390] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:35 2022] DELETE /identity/v3/projects/d09438d1893b446ab711dce42ae22a85 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:36.132355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:36.134604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:36.338636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:36.340963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:36.341285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:36.342439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:36.344679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:36.348780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:36.380866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2213/4391] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 10:08:36 2022] GET /identity/v3/regions => generated 670 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:08:36.382158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:36.390076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:36.391986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6fda-65b9-4b22-bd55-7c06e2860fd8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:36.410745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:36.411853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:36.412859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:36.414046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] PATH_INFO: `/v3/users/5c238b160c5f40c2983f5ab8ac5972b2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:36.430224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c238b160c5f40c2983f5ab8ac5972b2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:36.442946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:36.461237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c464dc-5c9a-4a39-ac64-ca47888354ed tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:36.487081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:36.491028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:36.496236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:36.497485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:36.503827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:36.519745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:36.541037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c238b160c5f40c2983f5ab8ac5972b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.542021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c238b160c5f40c2983f5ab8ac5972b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.545487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c238b160c5f40c2983f5ab8ac5972b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.563208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c238b160c5f40c2983f5ab8ac5972b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.573002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c238b160c5f40c2983f5ab8ac5972b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:36.617088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2179/4392] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:36 2022] DELETE /identity/v3/users/5c238b160c5f40c2983f5ab8ac5972b2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:36.674435 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2214/4393] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:08:36 2022] POST /identity/v3/regions => generated 253 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:36.679857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:36.681853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:36.770959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:36.867539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9b78-e8bf-4020-81f6-a48386393c91 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:36.924030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:36.925940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:36.937260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:36.938512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:36.939646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Adding query filter params (parent_region_id=d681fd3de2374f0dafdfcdeb72f74e11) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:36.940928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:36.944351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:36.956812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2180/4394] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:08:36 2022] GET /identity/v3/regions?parent_region_id=d681fd3de2374f0dafdfcdeb72f74e11 => generated 399 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:36.961292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:36.991766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e5b7-e6fa-478d-91ef-01a6108b8cd3 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:36.999239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.000680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.001158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.002068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/fc3ec6a63b9d40d8a0dabeabf5dec325` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.003135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fc3ec6a63b9d40d8a0dabeabf5dec325)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:37.009656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:37.053113 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2215/4395] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:36 2022] DELETE /identity/v3/regions/fc3ec6a63b9d40d8a0dabeabf5dec325 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:37.058273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:37.072763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-e2fc-4a21-871a-2178119c3a72 tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:37.107943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.110053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.110348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.110888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/9bc1a11ca22440b3bfa7d6971b85551e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.113453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9bc1a11ca22440b3bfa7d6971b85551e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:37.114980 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:37.114980 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:37.114980 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:37.118111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:37.163664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2181/4396] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:37 2022] DELETE /identity/v3/regions/9bc1a11ca22440b3bfa7d6971b85551e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:37.167520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:37.185251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aef3a-977e-4f4b-ab8b-5431ee2c9b0e tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:37.226831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32003230c6b4a6cb6e0a2b22a780e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72be94b4f5c54e68a7feba245ac4e628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.227533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.227813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.228090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] PATH_INFO: `/v3/regions/d681fd3de2374f0dafdfcdeb72f74e11` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.228677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d681fd3de2374f0dafdfcdeb72f74e11)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:37.230647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d527c4-c90f-43c2-bfc1-6f17e27e70dd tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:37.259423 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2216/4397] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:37 2022] DELETE /identity/v3/regions/d681fd3de2374f0dafdfcdeb72f74e11 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:37.263939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:37.266730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:37.375366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be206c0-afcc-4eff-a365-08533ca759bf tempest-RegionsTestJSON-659361548 tempest-RegionsTestJSON-659361548-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:37.394701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.395502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.395786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.396111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] PATH_INFO: `/v3/users/606d8554c97948c6a3f08f00f02ec1ea` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.397349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606d8554c97948c6a3f08f00f02ec1ea)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:37.399298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:37.464156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606d8554c97948c6a3f08f00f02ec1ea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.465087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606d8554c97948c6a3f08f00f02ec1ea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.465697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606d8554c97948c6a3f08f00f02ec1ea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.479370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606d8554c97948c6a3f08f00f02ec1ea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.498160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606d8554c97948c6a3f08f00f02ec1ea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.504049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:37.525081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2182/4398] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:37 2022] DELETE /identity/v3/users/606d8554c97948c6a3f08f00f02ec1ea => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:37.529938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.530315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.530587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.539254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:37.558177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:37.560541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:37.635497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:37.637015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:37.656945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2217/4399] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:37.661944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3695-22d9-4c61-b720-dbfef56923c7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:37.668999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.670028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.670900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.672156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] PATH_INFO: `/v3/projects/116b54496bd540d483aedfd487ba02b0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.675602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:37.676442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116b54496bd540d483aedfd487ba02b0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:37.678202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:37.687859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:37.761747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116b54496bd540d483aedfd487ba02b0', 'request_id': 'req-092f9b7e-d289-4646-92f7-b5b0731237e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.769814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116b54496bd540d483aedfd487ba02b0', 'request_id': 'req-092f9b7e-d289-4646-92f7-b5b0731237e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.783126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116b54496bd540d483aedfd487ba02b0', 'request_id': 'req-092f9b7e-d289-4646-92f7-b5b0731237e0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.808213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda845-bc46-4c5e-929c-fcc69ea2bbc2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:37.817175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] The token cache is being invalidate because project 116b54496bd540d483aedfd487ba02b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:37.821196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.822016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-092f9b7e-d289-4646-92f7-b5b0731237e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:37.827111 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2183/4400] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:37 2022] DELETE /identity/v3/projects/116b54496bd540d483aedfd487ba02b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:37.828915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970997-706c-45e7-956a-ad8a7fe9dd72 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.829299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970997-706c-45e7-956a-ad8a7fe9dd72 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.829647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970997-706c-45e7-956a-ad8a7fe9dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.877600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0e970997-706c-45e7-956a-ad8a7fe9dd72 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:37.879084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e970997-706c-45e7-956a-ad8a7fe9dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:37.944454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:37.945224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:37.945583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:37.945985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:37.948076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:38.035813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2184/4401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:38.038812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.039184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.039795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.075382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.077149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.085407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:38.095007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:38.096144 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2218/4402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:08:38.096335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:38.119385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2185/4403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:38.123731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.139479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf5f5-546c-45f6-8a60-f4ddddcc75eb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.154139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.154967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.155350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.155844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.157794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:38.158948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.163295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.200081 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2219/4404] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:38.201628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.220243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3519a-5292-4072-8699-c13f1aed90ea None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.248932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.248932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.248932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.248932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.249379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.249379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.334321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2186/4405] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:38 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:38.335215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.377619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb8ef-b537-45dd-a0a0-c21ff6c36628 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.614506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.615387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.615818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.616348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.621385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.637330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.680796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2220/4406] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:38 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:38.684671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.700705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459958cf-12e3-4835-97c8-e45a3547f8cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.715433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.716210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.716590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.717027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.717741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.719499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.753798 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2187/4407] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:38.757330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.773426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9133e-aa6a-4c11-ad43-78debda71032 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.783252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.784388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.784872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.785600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.787572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.792401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1711-2620-43c4-a911-d518bacd52d4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.805938 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2221/4408] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:38.810141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:38.825695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c734e-3808-445d-8653-5b51179ca08d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:38.837629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:38.839164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.840315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.840889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] PATH_INFO: `/v3/projects/b114d5536b3f46bcb515a63d4a7e9bb2/users/cc45ba6a78d54d36b2a1a50be26388dc/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.873547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b114d5536b3f46bcb515a63d4a7e9bb2, user_id=cc45ba6a78d54d36b2a1a50be26388dc, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:38.878217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:38.903642 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2188/4409] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:38 2022] PUT /identity/v3/projects/b114d5536b3f46bcb515a63d4a7e9bb2/users/cc45ba6a78d54d36b2a1a50be26388dc/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:38.914521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:38.915055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:38.915429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:38.978491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] MFA Rules not processed for user `cc45ba6a78d54d36b2a1a50be26388dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:38.987756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:39.104478 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2222/4410] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:39.105739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.113068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:39.134963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.135452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:39.221183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4dd0-1dd1-414c-89eb-c57fc91204d1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.232430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:39.240188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988fdf8-7b68-4eb7-921f-0fa80fc3de08 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.248517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.249249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.251641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.251923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.252233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.253034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.254021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.255727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.255727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] PATH_INFO: `/v3/projects/bc3a8b18ec644e54b50049d1a53e96b4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.257909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.259129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3a8b18ec644e54b50049d1a53e96b4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.262578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.351549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2189/4411] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:39 2022] POST /identity/v3/projects => generated 391 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:39.352710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.394721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3a8b18ec644e54b50049d1a53e96b4', 'request_id': 'req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.415183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3a8b18ec644e54b50049d1a53e96b4', 'request_id': 'req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.429636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3a8b18ec644e54b50049d1a53e96b4', 'request_id': 'req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.454318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] The token cache is being invalidate because project bc3a8b18ec644e54b50049d1a53e96b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:39.454995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.456095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.471932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2223/4412] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:39 2022] DELETE /identity/v3/projects/bc3a8b18ec644e54b50049d1a53e96b4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:39.481105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.484727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:39.499231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ccee-f6c0-4af1-b243-2d93b68408a3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.518149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.518394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.518635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.518911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.519554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.521516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.567185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2190/4413] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:39 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:39.572596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.576191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:39.619880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7a0-9c1b-40d6-83cd-a4e94e73c1c9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.631783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.635453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.636381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.637447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.640783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.645599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.668856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe4-76e5-4dc6-9926-eb40bce352ed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.674393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.678359 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2191/4414] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:39.680044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.680510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.681097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.681543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] PATH_INFO: `/v3/users/a32003230c6b4a6cb6e0a2b22a780e2f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.683306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32003230c6b4a6cb6e0a2b22a780e2f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.686367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.708632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553550-12fe-4e4b-8e6d-a440d31f16e4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:39.720177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:39.721174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:39.721886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:39.725168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] PATH_INFO: `/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0/users/cb9e8282cb7e4701bdcf9469ab1dfd2d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:39.776122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfa5cd1268d4589a9fcfb1c1eb422e0, user_id=cb9e8282cb7e4701bdcf9469ab1dfd2d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:39.776764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32003230c6b4a6cb6e0a2b22a780e2f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.782183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32003230c6b4a6cb6e0a2b22a780e2f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.786328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:39.798942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32003230c6b4a6cb6e0a2b22a780e2f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.818592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32003230c6b4a6cb6e0a2b22a780e2f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.818592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32003230c6b4a6cb6e0a2b22a780e2f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:39.819119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2192/4415] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:39 2022] PUT /identity/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0/users/cb9e8282cb7e4701bdcf9469ab1dfd2d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:39.823885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:39.826627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:39.891360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2224/4416] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:39 2022] DELETE /identity/v3/users/a32003230c6b4a6cb6e0a2b22a780e2f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:39.946317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:39.975021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e4e6-83ea-4d7b-9b45-3b9a427ace30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.049505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.050240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.050593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.050982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.051796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.053595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996873a7-08e7-4d5c-aaea-e6cacda43de5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.071668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.073307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2193/4417] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:40.079358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:40.083797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fe27-f293-430a-95dd-e29d67156501 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.093873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.095043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.095185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.095658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] PATH_INFO: `/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0/users/cb9e8282cb7e4701bdcf9469ab1dfd2d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.099444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfa5cd1268d4589a9fcfb1c1eb422e0, user_id=cb9e8282cb7e4701bdcf9469ab1dfd2d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.105252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.117726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2225/4418] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:40 2022] PUT /identity/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0/users/cb9e8282cb7e4701bdcf9469ab1dfd2d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:40.129884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.130251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.130598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.189418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] MFA Rules not processed for user `cb9e8282cb7e4701bdcf9469ab1dfd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:40.194793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.285514 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2194/4419] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:40.299365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.301268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.385402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06a69-2225-4f78-9942-f7f89c1bd343 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.390255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.391132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.391415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.391686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.403960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.406066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00609081-ea0d-49ff-a6bd-4e9dd12eb8a7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.424697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2226/4420] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:08:40.440391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.442207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.518109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf3a17-8b9a-42d1-9270-e2e0aaedc416 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.524765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.525647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.525990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.526689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] PATH_INFO: `/v3/projects/72be94b4f5c54e68a7feba245ac4e628` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.527999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72be94b4f5c54e68a7feba245ac4e628)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.530139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.549890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:40.609486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72be94b4f5c54e68a7feba245ac4e628', 'request_id': 'req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.617380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72be94b4f5c54e68a7feba245ac4e628', 'request_id': 'req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.629477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72be94b4f5c54e68a7feba245ac4e628', 'request_id': 'req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.645755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] The token cache is being invalidate because project 72be94b4f5c54e68a7feba245ac4e628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:40.646213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.647063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.648880 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2195/4421] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:40 2022] DELETE /identity/v3/projects/72be94b4f5c54e68a7feba245ac4e628 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:40.654707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c95ab-a18a-49ce-bb39-6249e5e9157c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.655001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c95ab-a18a-49ce-bb39-6249e5e9157c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.655358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c95ab-a18a-49ce-bb39-6249e5e9157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.683685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fd6c95ab-a18a-49ce-bb39-6249e5e9157c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:40.685423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fd6c95ab-a18a-49ce-bb39-6249e5e9157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.693298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.695078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.806590 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2227/4422] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:40.810270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a95b-d9d6-442d-8553-1bc0f11cebd6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.815196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.816985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.817608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.818143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.819095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.819387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.819657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] PATH_INFO: `/v3/users/1f95d3b5d2334eefb1b5386fb8580780` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.821002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f95d3b5d2334eefb1b5386fb8580780)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.823684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.867719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:40.885016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:40.891751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2228/4423] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:08:40.899036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.920521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79503a10-6601-4a4d-a635-4fdf396e4f83 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:40.923624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f95d3b5d2334eefb1b5386fb8580780'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.924980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f95d3b5d2334eefb1b5386fb8580780'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.925913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f95d3b5d2334eefb1b5386fb8580780'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.938612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:40.938942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:40.939290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:40.939627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:40.940776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:40.941194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:40.943342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:40.950735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f95d3b5d2334eefb1b5386fb8580780'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.966380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2229/4424] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:40.970674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:40.973436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f95d3b5d2334eefb1b5386fb8580780'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:40.974498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:41.011710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2196/4425] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:40 2022] DELETE /identity/v3/users/1f95d3b5d2334eefb1b5386fb8580780 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:41.021439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca998a-3aeb-4c54-88b6-78fb7eced562 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.105073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.105876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.106450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.106525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.107549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.110330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:41.143059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:41.158430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2230/4426] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:40 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:41.159681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:41.171374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4532a-8c17-4c18-ba39-43066c28d741 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.197088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:41.277592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.278677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.279038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.280425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.282011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.285933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:41.344729 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2197/4427] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:41 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:41.348960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:41.382465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957d22-6d06-4a8e-abff-6418e8836490 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.388412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.389127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.389421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.391223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.391223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.393122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:41.415647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2231/4428] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:41.419470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:41.432849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fae7-175d-494d-bfe1-400f5ea7e63b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.462845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.463783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.464513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.465250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.466315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.470955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf959a-9668-42d1-bfdd-4ea6a4356b04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:41.496680 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2198/4429] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:41.498326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:41.518467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaad15-6895-454c-9e37-48f08650f828 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.532086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.533666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.533953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.536661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] PATH_INFO: `/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/d6192ec6daa74c5993f81b7789fd91f3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.578289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3e00aa68b54f9b8d5705017c02e3f3, user_id=d6192ec6daa74c5993f81b7789fd91f3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.583807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:41.610880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2232/4430] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:41 2022] PUT /identity/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/d6192ec6daa74c5993f81b7789fd91f3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:41.622625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.623016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.623359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.666250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] MFA Rules not processed for user `d6192ec6daa74c5993f81b7789fd91f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:41.667801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:41.788049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:41.789599 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2199/4431] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:41.916206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710e2c7-fb16-4e7a-9aa3-7ba0becf12ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:41.922813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:41.923662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:41.923944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:41.924219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:41.927084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:41.938682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.009247 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2233/4432] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:41 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:42.012428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.075344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94582d-5f08-417a-9f90-79dfadbc16b1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.204630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.206066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.206431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.207149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.207872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.211516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.215068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.217100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:42.256358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745802b-b07b-4855-88a4-d033495d29fb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.258626 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2200/4433] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:42.259893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.272876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.273633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.275177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.275461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] PATH_INFO: `/v3/projects/26e212a668cf47d38ef3b363ce7dbba4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.277495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b56e9e-bfcc-4e3c-bf30-baa869830171 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.280675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e212a668cf47d38ef3b363ce7dbba4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.287568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.291160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.293756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.295045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.295729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.297203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.301226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.318463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2201/4434] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:42.323586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.342736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeecef-6e3f-410d-951f-9e67ebc46b61 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.353928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.355375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.355959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.357448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] PATH_INFO: `/v3/projects/5859422360d14a50b0f5cde619d687d7/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.366135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:42.401193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e212a668cf47d38ef3b363ce7dbba4', 'request_id': 'req-6a8996ac-c159-41c4-97fc-f268870377e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:42.424190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e212a668cf47d38ef3b363ce7dbba4', 'request_id': 'req-6a8996ac-c159-41c4-97fc-f268870377e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:42.443152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e212a668cf47d38ef3b363ce7dbba4', 'request_id': 'req-6a8996ac-c159-41c4-97fc-f268870377e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:42.445380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5859422360d14a50b0f5cde619d687d7, user_id=dac6153e37a8419db9ef3c28c92b0f75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.451693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.461556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] The token cache is being invalidate because project 26e212a668cf47d38ef3b363ce7dbba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:42.462103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:42.464396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6a8996ac-c159-41c4-97fc-f268870377e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:42.467023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2234/4435] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:42 2022] DELETE /identity/v3/projects/26e212a668cf47d38ef3b363ce7dbba4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:42.474203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cc1d0-26e9-4425-93da-4d0cab8d1d15 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.475231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cc1d0-26e9-4425-93da-4d0cab8d1d15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.475231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cc1d0-26e9-4425-93da-4d0cab8d1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.491516 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2202/4436] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:42 2022] PUT /identity/v3/projects/5859422360d14a50b0f5cde619d687d7/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:42.496169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.498325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:42.506610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-db3cc1d0-26e9-4425-93da-4d0cab8d1d15 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:42.508796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db3cc1d0-26e9-4425-93da-4d0cab8d1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:42.601935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:42.648061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19dda-f92e-4caf-8dd3-b57148dee28f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.653859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.654496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.654781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.655053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.655735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.656017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2235/4437] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:42.657990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.664604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.666827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.667137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.670852 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2203/4438] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:42.675598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.691726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237de7-4165-436d-97f9-d4a2d3b090dd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.703413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.704183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.704824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.705287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] PATH_INFO: `/v3/projects/5859422360d14a50b0f5cde619d687d7/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.707549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5859422360d14a50b0f5cde619d687d7, user_id=dac6153e37a8419db9ef3c28c92b0f75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.709871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:42.710840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec97763-a311-4ead-a055-7ce5ed5a2b22 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.711113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:42.722892 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2236/4439] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:42.727488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.742439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2204/4440] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:42 2022] PUT /identity/v3/projects/5859422360d14a50b0f5cde619d687d7/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:42.744034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.744324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.745450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.759487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aa157-9c8e-449a-9f44-f6d698bb82cb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.787098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] MFA Rules not processed for user `dac6153e37a8419db9ef3c28c92b0f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:42.789683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:42.877887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.878808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.879810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.880762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.881768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:42.882239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.886087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:42.933091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2205/4441] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:42.939279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.946477 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2237/4442] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:42.950856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:42.961872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddede5-65d9-46f0-a8e6-9b36d366643c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.969316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6500d0-4ca4-4b92-a570-adc515c038c8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:42.986251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:42.986883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:42.989146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:42.989895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:42.992341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:42.996415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.007429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.008309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.009084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.009616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.010896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.017591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.097183 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2206/4443] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:43.099018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.106956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2238/4444] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:42 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:43.112625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.179460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:43.225971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023db9a-2a09-4817-a26b-f2b0e5610ae2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.291158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1602917-9496-4960-aaf5-301dd05b03ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.304947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.305700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.306205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.306585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.307321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.311786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.346046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.346853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.347354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.347747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.348536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.350846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.360397 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2239/4445] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:43 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:43.361451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.373862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059a2d7-5f56-4815-9521-db2daf2e9fc3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.380177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.381464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.381763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.382015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.382666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.384290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.395804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2207/4446] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:43 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:43.402849 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2240/4447] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:43.404845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.407228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.422726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af7d-d6a8-4060-8b4d-a8919557e9d2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.429795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.430421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.430698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.430974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.431614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.433472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.445490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5656e-70b9-456d-b97e-3bb5fa221bd2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.448176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2241/4448] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:43.451984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.461223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.462029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.462378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.462740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.463389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bd7f-6452-44ad-ad5d-d9ec22824351 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.463530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.465438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.469697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.470097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.470377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.470649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] PATH_INFO: `/v3/projects/adb7eccfe81e41db93216cb0441db339/users/0a40eaa5eefa439bb590a7511814f61c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.474557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:43.479658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2208/4449] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:43.485638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.496376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb7eccfe81e41db93216cb0441db339, user_id=0a40eaa5eefa439bb590a7511814f61c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.498977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b0015-b7d0-454a-9f1d-224a394109ab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.499631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e76cd3-c8ff-4349-9c75-811d71c17bbf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.508518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.510214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.510504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.510772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.512034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.513662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.520201 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2242/4450] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:43 2022] PUT /identity/v3/projects/adb7eccfe81e41db93216cb0441db339/users/0a40eaa5eefa439bb590a7511814f61c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:43.524830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.525145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.525418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.530293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2209/4451] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:43.535888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.550063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:43.551449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:43.573034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aeee6-4dca-43de-ab4c-d08063b721e3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.697770 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2243/4452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:43.712859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:43.714556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:43.755014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.755668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.755946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.756229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] PATH_INFO: `/v3/projects/2337eb04488241eab3aecd80e9fc51c0/users/0971171a32934e5dbb099615c02100d4/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.782384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2337eb04488241eab3aecd80e9fc51c0, user_id=0971171a32934e5dbb099615c02100d4, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:43.785700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b800b8-a9b8-4d5e-ae0f-f1295c1f5361 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:43.813227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2210/4453] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:43 2022] PUT /identity/v3/projects/2337eb04488241eab3aecd80e9fc51c0/users/0971171a32934e5dbb099615c02100d4/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:43.820400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.820744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.820999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:43.868622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae1ad-9bdc-4f64-8002-beb354f4e70a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:43.914991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] MFA Rules not processed for user `0971171a32934e5dbb099615c02100d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:43.918029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:43.944035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:43.953034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:43.953703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:43.953980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:43.954475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.011088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2211/4454] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:44.017133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.046802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:44.060463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.062276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.088497 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2244/4455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:08:44.147333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1c464-33d3-4732-a643-677fa2b8480d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.153165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.153840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.154183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.154623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.155292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.157583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.182462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2212/4456] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:44 2022] POST /identity/v3/domains => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:44.186737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.206581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757b68-2313-41b7-9188-037f9552b55e service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.335934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.336569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.336832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.337208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.344489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.346480 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:44.346480 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:44.346480 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:44.347560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.395928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2245/4457] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:08:44 2022] POST /identity/v3/roles => generated 239 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:44.399899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.416114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02b5c-1522-4dbe-805f-1f78a4c1c31b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.423853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.424343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.424677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.424981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/696781bc7c1d40359e02bdde7d93c51a/users/0971171a32934e5dbb099615c02100d4/roles/b8a30867108142c7b82deea10e6dbfda` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.455434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=696781bc7c1d40359e02bdde7d93c51a, user_id=0971171a32934e5dbb099615c02100d4, role_id=b8a30867108142c7b82deea10e6dbfda)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.458983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.492932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2213/4458] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Oct 28 10:08:44 2022] PUT /identity/v3/domains/696781bc7c1d40359e02bdde7d93c51a/users/0971171a32934e5dbb099615c02100d4/roles/b8a30867108142c7b82deea10e6dbfda => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:44.498052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.511040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828860e1-a1ca-4882-a9b5-58aea96352f8 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.625307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.625931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.626211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.626485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.627156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.628839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.650793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2246/4459] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:44 2022] POST /identity/v3/domains => generated 276 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:44.656767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.668518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd80c-41f8-408f-8797-9c6c2c72d2ce tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.744216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.746157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.746466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.746735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.747398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.748405 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:44.748405 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:44.748405 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:44.750703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.781659 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2214/4460] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:08:44 2022] POST /identity/v3/roles => generated 239 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:44.782376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.796698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2079b7-a052-4f8e-bc9c-b7505e2b6b61 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.810006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.810633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.811171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.811455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.812863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.813915 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:44.813915 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:44.813915 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:44.815113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.871786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2247/4461] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:44 2022] POST /identity/v3/groups => generated 327 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:44.876850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:44.899705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ba57-591f-47fe-bd1c-2b8862863502 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:44.911718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:44.913354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:44.914157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:44.914617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/9f6e763527be4374b70c3f78ae5479be/users/0971171a32934e5dbb099615c02100d4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:44.925589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9f6e763527be4374b70c3f78ae5479be, user_id=0971171a32934e5dbb099615c02100d4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:44.927233 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:44.927233 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:44.927233 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:44.928806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:44.979298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:44.989351 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2215/4462] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:08:44 2022] PUT /identity/v3/groups/9f6e763527be4374b70c3f78ae5479be/users/0971171a32934e5dbb099615c02100d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:44.993433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.006952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7b625-95c9-4ffc-9afb-6b83cbde1619 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.085701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:45.095886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.097117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.097678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.098179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/c5ab075215f849819c7784024ae354b3/groups/9f6e763527be4374b70c3f78ae5479be/roles/628ca455255d49898c15d8c408a97572` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.102825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c5ab075215f849819c7784024ae354b3, group_id=9f6e763527be4374b70c3f78ae5479be, role_id=628ca455255d49898c15d8c408a97572)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.106552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.124936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2248/4463] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:44 2022] PUT /identity/v3/domains/c5ab075215f849819c7784024ae354b3/groups/9f6e763527be4374b70c3f78ae5479be/roles/628ca455255d49898c15d8c408a97572 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:45.129110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.141632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab97a-53a5-47b5-a603-84591914bda3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.210785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.212108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.212395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.212944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.213480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.215086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.237977 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2216/4464] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:45 2022] POST /identity/v3/domains => generated 276 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:45.239047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.250007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3a88-d793-4323-b8dc-698b7285f49c tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.319981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.321087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.321202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.321524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.322282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.324097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.343686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2249/4465] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:08:45 2022] POST /identity/v3/roles => generated 240 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:45.347457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.372983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012036-baab-4302-9f04-cc10e8ccc2e1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.378576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.379551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.379936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.380314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/19eb506efd5647cdbd0cd00470f72746/users/0971171a32934e5dbb099615c02100d4/roles/bc095708718c4a02a4db60679d87bdf9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.395590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=19eb506efd5647cdbd0cd00470f72746, user_id=0971171a32934e5dbb099615c02100d4, role_id=bc095708718c4a02a4db60679d87bdf9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.398543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.425881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2217/4466] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Oct 28 10:08:45 2022] PUT /identity/v3/domains/19eb506efd5647cdbd0cd00470f72746/users/0971171a32934e5dbb099615c02100d4/roles/bc095708718c4a02a4db60679d87bdf9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:45.429777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.442435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403963f-81e4-489f-a6e3-406759c4fb08 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.572847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.573758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.574256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.574671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.576628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.580321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.619911 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2250/4467] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:08:45 2022] POST /identity/v3/domains => generated 277 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:45.623684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.679512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42071655-0303-4453-96c1-c85828c2c6f2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.829974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.830315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.831276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.831557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.832312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.841596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.883941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2218/4468] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:08:45 2022] POST /identity/v3/roles => generated 240 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:45.886028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.913292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd447b-c437-42b3-a8e8-1d53d758cc0b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:45.920436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:45.932155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:45.934159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:45.934886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:45.935786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:45.942294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:45.981149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:45.984152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:46.027375 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2251/4469] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:45 2022] POST /identity/v3/groups => generated 326 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:46.032487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:46.055020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1396eb-0fc0-4bfb-a104-7c261e90d940 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.063670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.065204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.065684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.066528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/240e5a1b09c84807956dc1ff37241c98/users/0971171a32934e5dbb099615c02100d4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.078500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=240e5a1b09c84807956dc1ff37241c98, user_id=0971171a32934e5dbb099615c02100d4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.080024 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:46.080024 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:46.080024 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:46.083055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.115481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568461-a43a-4362-81ac-9a2682200402 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.125317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:46.127542 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2252/4470] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:08:46 2022] PUT /identity/v3/groups/240e5a1b09c84807956dc1ff37241c98/users/0971171a32934e5dbb099615c02100d4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:46.131310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:46.181939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:46.224719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.228427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.229086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.230165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] PATH_INFO: `/v3/users/cc45ba6a78d54d36b2a1a50be26388dc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.234224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc45ba6a78d54d36b2a1a50be26388dc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.240186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.278131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784183c7-53f6-4dc5-8ab0-a7783f3ae932 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.290524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.291803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.292278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.292963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/efbf616e831c4183ba8a604cf38c18bc/groups/240e5a1b09c84807956dc1ff37241c98/roles/f8e2209786ba45989b51565073226aab` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.295830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=efbf616e831c4183ba8a604cf38c18bc, group_id=240e5a1b09c84807956dc1ff37241c98, role_id=f8e2209786ba45989b51565073226aab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.300713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.330245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2253/4471] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:46 2022] PUT /identity/v3/domains/efbf616e831c4183ba8a604cf38c18bc/groups/240e5a1b09c84807956dc1ff37241c98/roles/f8e2209786ba45989b51565073226aab => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:46.332497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:46.356687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc45ba6a78d54d36b2a1a50be26388dc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.357452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc45ba6a78d54d36b2a1a50be26388dc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.358356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc45ba6a78d54d36b2a1a50be26388dc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.370817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc45ba6a78d54d36b2a1a50be26388dc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.387492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3daceaa-5fe3-4c22-99df-ab11f2f7b825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc45ba6a78d54d36b2a1a50be26388dc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.420644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2219/4472] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:45 2022] DELETE /identity/v3/users/cc45ba6a78d54d36b2a1a50be26388dc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:46.425174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.425824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.426303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.450788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:46.453711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:46.521594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8c6a-e34f-40c0-acfb-91334b659a90 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.540887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2220/4473] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:46.561257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:46.564260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:46.662635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0971171a32934e5dbb099615c02100d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2337eb04488241eab3aecd80e9fc51c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.663255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.663537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.663812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] PATH_INFO: `/v3/auth/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.664386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.665529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.675068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:46.718466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721c227-ec51-45e4-8ebf-82c884f37674 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.722940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.723647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.724038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.724398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.738411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.740402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.752568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:46.754898 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2221/4474] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:46.827861 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2254/4475] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 10:08:46 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:46.831303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:46.836018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:46.926620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15da40-4302-48e3-9a8e-1a63a5b0128f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:46.938610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:46.938610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:46.938610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:46.938868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/efbf616e831c4183ba8a604cf38c18bc/groups/240e5a1b09c84807956dc1ff37241c98/roles/f8e2209786ba45989b51565073226aab` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:46.940256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=efbf616e831c4183ba8a604cf38c18bc, group_id=240e5a1b09c84807956dc1ff37241c98, role_id=f8e2209786ba45989b51565073226aab)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:46.942106 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:46.942106 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:46.942106 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:46.945074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:46.980408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role f8e2209786ba45989b51565073226aab was removed from group 240e5a1b09c84807956dc1ff37241c98 on domain efbf616e831c4183ba8a604cf38c18bc. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:46.980740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:46.985262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.017178 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2222/4476] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:08:46 2022] DELETE /identity/v3/domains/efbf616e831c4183ba8a604cf38c18bc/groups/240e5a1b09c84807956dc1ff37241c98/roles/f8e2209786ba45989b51565073226aab => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:47.021674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:47.024566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:47.047563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e7ee-0249-4090-9e2a-ff70c127f755 tempest-TokensV3TestJSON-2077711821 tempest-TokensV3TestJSON-2077711821-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:47.178049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:47.179350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:47.179809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:47.181512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/240e5a1b09c84807956dc1ff37241c98/users/0971171a32934e5dbb099615c02100d4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:47.183737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=240e5a1b09c84807956dc1ff37241c98, user_id=0971171a32934e5dbb099615c02100d4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:47.184804 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:47.184804 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:47.184804 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:47.187343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:47.198821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.223174 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2255/4477] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:08:47 2022] DELETE /identity/v3/groups/240e5a1b09c84807956dc1ff37241c98/users/0971171a32934e5dbb099615c02100d4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:47.227123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:47.244605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6559b-d319-4382-9013-38be84b13779 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:47.334586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:47.336373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:47.396671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:47.397355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:47.397639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:47.397917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/240e5a1b09c84807956dc1ff37241c98` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:47.401616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=240e5a1b09c84807956dc1ff37241c98)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:47.402641 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:47.402641 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:47.402641 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:47.404529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:47.474054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb5a5-62ae-4fd2-8a13-6e3696401d36 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:47.486391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:47.487036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:47.487451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:47.487729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] PATH_INFO: `/v3/projects/b114d5536b3f46bcb515a63d4a7e9bb2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:47.489988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b114d5536b3f46bcb515a63d4a7e9bb2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:47.491928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:47.537800 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2223/4478] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:08:47 2022] DELETE /identity/v3/groups/240e5a1b09c84807956dc1ff37241c98 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:47.542024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:47.590853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:47.603949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:47.605484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b114d5536b3f46bcb515a63d4a7e9bb2', 'request_id': 'req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.621088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b114d5536b3f46bcb515a63d4a7e9bb2', 'request_id': 'req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.638069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b114d5536b3f46bcb515a63d4a7e9bb2', 'request_id': 'req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.663130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] The token cache is being invalidate because project b114d5536b3f46bcb515a63d4a7e9bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:47.664643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.668245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:47.670621 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2256/4479] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:47 2022] DELETE /identity/v3/projects/b114d5536b3f46bcb515a63d4a7e9bb2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:47.675688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:47.679489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:47.747785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbacfe-f8c9-454c-bbc9-e27a9ae24b75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:47.896058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a136b0-bf3c-4c7d-b6db-17f952de1b4d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:47.911773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:47.915998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:47.916471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:47.917207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] PATH_INFO: `/v3/users/cb9e8282cb7e4701bdcf9469ab1dfd2d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:47.920735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9e8282cb7e4701bdcf9469ab1dfd2d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:47.924350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:47.971194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:47.972027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:47.972311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:47.972591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles/f8e2209786ba45989b51565073226aab` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:47.976264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f8e2209786ba45989b51565073226aab)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:47.977339 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:47.977339 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:08:47.977339 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:08:47.979663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:48.058229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9e8282cb7e4701bdcf9469ab1dfd2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.059638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9e8282cb7e4701bdcf9469ab1dfd2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.076382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9e8282cb7e4701bdcf9469ab1dfd2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.091255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role f8e2209786ba45989b51565073226aab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:48.091529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.092308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.095374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2224/4480] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:47 2022] DELETE /identity/v3/roles/f8e2209786ba45989b51565073226aab => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:48.098379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9e8282cb7e4701bdcf9469ab1dfd2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.099149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:48.100791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:48.101001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9e8282cb7e4701bdcf9469ab1dfd2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.142395 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2257/4481] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:47 2022] DELETE /identity/v3/users/cb9e8282cb7e4701bdcf9469ab1dfd2d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:48.269868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477fdfa-697e-45de-aa49-c7aecaf04864 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:48.379148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:48.419527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:48.420200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:48.420487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:48.420766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/efbf616e831c4183ba8a604cf38c18bc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:48.422576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=efbf616e831c4183ba8a604cf38c18bc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:48.430649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:48.494803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.495628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.515970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:48.518063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:48.565869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.567227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.573389 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2225/4482] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:08:48 2022] PATCH /identity/v3/domains/efbf616e831c4183ba8a604cf38c18bc => generated 278 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:08:48.577851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:48.579908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:48.692408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:48.704106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e974c-0686-40ca-9507-1d9dbfef55de admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:48.778071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec278-1f8a-40fa-8e7e-f587de39bf26 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:48.787320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:48.788143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:48.788535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:48.788962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/efbf616e831c4183ba8a604cf38c18bc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:48.809104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=efbf616e831c4183ba8a604cf38c18bc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:48.812288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:48.828818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:48.843009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:48.843245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:48.846171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] PATH_INFO: `/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:48.851100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfa5cd1268d4589a9fcfb1c1eb422e0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:48.859861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:48.886037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:48.909031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.007036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfa5cd1268d4589a9fcfb1c1eb422e0', 'request_id': 'req-96541a47-193a-4c06-ad02-c7121292fa0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.065692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfa5cd1268d4589a9fcfb1c1eb422e0', 'request_id': 'req-96541a47-193a-4c06-ad02-c7121292fa0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.074549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.080374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfa5cd1268d4589a9fcfb1c1eb422e0', 'request_id': 'req-96541a47-193a-4c06-ad02-c7121292fa0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.096783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.115664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] The token cache is being invalidate because project 1dfa5cd1268d4589a9fcfb1c1eb422e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:49.125860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.125860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96541a47-193a-4c06-ad02-c7121292fa0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.126489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.133123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2258/4483] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:48 2022] DELETE /identity/v3/projects/1dfa5cd1268d4589a9fcfb1c1eb422e0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:49.135157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dffdae-6c2e-42ac-b49e-e64c14c983fe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.135446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dffdae-6c2e-42ac-b49e-e64c14c983fe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.135715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dffdae-6c2e-42ac-b49e-e64c14c983fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.153072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project efbf616e831c4183ba8a604cf38c18bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:49.153433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.154970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.162969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:49.176347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.186089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8dffdae-6c2e-42ac-b49e-e64c14c983fe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:49.187735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.188580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8dffdae-6c2e-42ac-b49e-e64c14c983fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.189986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'efbf616e831c4183ba8a604cf38c18bc', 'request_id': 'req-e36e271f-06ce-472b-ae12-0d15bb833be6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.201480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2226/4484] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:48 2022] DELETE /identity/v3/domains/efbf616e831c4183ba8a604cf38c18bc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:49.207205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.208650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.341616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2259/4485] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:49.344067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.344352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.344632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.356455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e271f-06ce-472b-ae12-0d15bb833be6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.363550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:49.364371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.364772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.365176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/19eb506efd5647cdbd0cd00470f72746/users/0971171a32934e5dbb099615c02100d4/roles/bc095708718c4a02a4db60679d87bdf9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.367545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=19eb506efd5647cdbd0cd00470f72746, user_id=0971171a32934e5dbb099615c02100d4, role_id=bc095708718c4a02a4db60679d87bdf9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:49.368053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:49.371207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:49.377986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role bc095708718c4a02a4db60679d87bdf9 was removed from user 0971171a32934e5dbb099615c02100d4 on domain 19eb506efd5647cdbd0cd00470f72746. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:49.378455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.379438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.383367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.405805 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2227/4486] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Oct 28 10:08:49 2022] DELETE /identity/v3/domains/19eb506efd5647cdbd0cd00470f72746/users/0971171a32934e5dbb099615c02100d4/roles/bc095708718c4a02a4db60679d87bdf9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:49.407339 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2260/4487] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:49.408361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.410066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.417523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.433041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e14b7-37ef-4a88-9e74-2c19679b168c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.479868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:49.571065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d2a5d-8e28-499d-9808-abea789e2853 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.572350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:49.574460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.576146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.576448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:49.576606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.577678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.579017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:49.580408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.580764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles/bc095708718c4a02a4db60679d87bdf9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.584349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bc095708718c4a02a4db60679d87bdf9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:49.585917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:49.587980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:49.592144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:49.612758 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2261/4488] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:49.615743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.630680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66917e95-12c8-41f8-86da-05937e9efdba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.639030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:49.640474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.641123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.641573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.642542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:49.645137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:49.678338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role bc095708718c4a02a4db60679d87bdf9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:49.678968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.681662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.687368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2228/4489] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:49 2022] DELETE /identity/v3/roles/bc095708718c4a02a4db60679d87bdf9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:49.691134 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2262/4490] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:49 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:49.692016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.695119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.695573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.698054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:49.818906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:49.839085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d1e92-971b-4004-bcab-edc2e664ea82 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.856775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:49.857574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:49.857863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:49.858142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/19eb506efd5647cdbd0cd00470f72746` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:49.860002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=19eb506efd5647cdbd0cd00470f72746)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:49.861711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:49.878127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f487-a789-40f5-ba43-d23836f76a71 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:49.914800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.915593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.982271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.982996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:49.989960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2263/4491] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:08:49 2022] PATCH /identity/v3/domains/19eb506efd5647cdbd0cd00470f72746 => generated 277 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:08:49.991449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:49.993384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:50.039853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.040771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.041231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.041651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.042443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.044626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.093511 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2229/4492] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:49 2022] POST /identity/v3/users => generated 287 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:50.097554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.099685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:50.136952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc49c1-34e4-424b-8f26-9559bc89fc1d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:50.138855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1692-6ad6-460c-a4b5-797c34b08535 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:50.165552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.166508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.170605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.172141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/19eb506efd5647cdbd0cd00470f72746` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.204277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:50.217028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=19eb506efd5647cdbd0cd00470f72746)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.222898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.291214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.296104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '19eb506efd5647cdbd0cd00470f72746'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.298845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.299656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.300017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.301283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.307237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.310180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.328298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2230/4493] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:50 2022] GET /identity/v3/roles => generated 1880 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:50.335012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.355028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bdd3b-de56-461d-8cc8-97c26d8011f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:50.363577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.364342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.364722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.365142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.365931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.367750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.385956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2231/4494] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:50 2022] GET /identity/v3/roles => generated 1880 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:50.390147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.392709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.408287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.434688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.438551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811577-097e-4e7f-87c4-1949220c8678 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:50.457421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project 19eb506efd5647cdbd0cd00470f72746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:50.457801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.458454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.474831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.487598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.488386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '19eb506efd5647cdbd0cd00470f72746', 'request_id': 'req-e23232b9-6ffe-452f-84e2-e7547350eebb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.495272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2264/4495] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:49 2022] DELETE /identity/v3/domains/19eb506efd5647cdbd0cd00470f72746 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:50.499900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.502671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:50.536212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.537181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.537552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.537924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] PATH_INFO: `/v3/projects/60bde2e33c1e44ccac5322aa8d66ca43/users/9ebeaedc29354553b5ad818c9a7760f5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.542414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:50.586600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bde2e33c1e44ccac5322aa8d66ca43, user_id=9ebeaedc29354553b5ad818c9a7760f5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.594448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9188d6-c3be-42b3-bfc3-426a194942fc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.619033 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2232/4496] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:50 2022] PUT /identity/v3/projects/60bde2e33c1e44ccac5322aa8d66ca43/users/9ebeaedc29354553b5ad818c9a7760f5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:50.630406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.631228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.631488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.708986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23232b9-6ffe-452f-84e2-e7547350eebb tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:50.711875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] MFA Rules not processed for user `9ebeaedc29354553b5ad818c9a7760f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:50.713300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:50.810140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:50.840075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:50.840792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:50.841219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:50.841596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/c5ab075215f849819c7784024ae354b3/groups/9f6e763527be4374b70c3f78ae5479be/roles/628ca455255d49898c15d8c408a97572` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:50.845546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c5ab075215f849819c7784024ae354b3, group_id=9f6e763527be4374b70c3f78ae5479be, role_id=628ca455255d49898c15d8c408a97572)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:50.846614 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:50.846614 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:50.846614 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:50.850923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:50.900981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role 628ca455255d49898c15d8c408a97572 was removed from group 9f6e763527be4374b70c3f78ae5479be on domain c5ab075215f849819c7784024ae354b3. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:50.901437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.909397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:50.909761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2233/4497] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:08:50.914072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.915476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:50.949270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2265/4498] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:08:50 2022] DELETE /identity/v3/domains/c5ab075215f849819c7784024ae354b3/groups/9f6e763527be4374b70c3f78ae5479be/roles/628ca455255d49898c15d8c408a97572 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:50.953431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:50.964406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:51.096451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150baf-d097-403b-8d1e-2a9f8cfeaa0d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.195829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcad3-19f1-4a5e-8cbd-9fcc444b9738 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.202799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.203607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.204022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.204465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/9f6e763527be4374b70c3f78ae5479be/users/0971171a32934e5dbb099615c02100d4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.206657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=9f6e763527be4374b70c3f78ae5479be, user_id=0971171a32934e5dbb099615c02100d4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.208923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.227993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:51.238979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.239619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.239952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.240228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.240923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.242955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.253918 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2266/4499] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:08:50 2022] DELETE /identity/v3/groups/9f6e763527be4374b70c3f78ae5479be/users/0971171a32934e5dbb099615c02100d4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:51.258085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.300590 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2234/4500] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:50 2022] POST /identity/v3/projects => generated 373 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:08:51.301593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.310535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:51.330784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:51.454294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514116f-7d3e-45ab-8689-d0c88f021976 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.461926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1a88-245a-48c8-a137-8e3b12f8509b tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.474805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.475510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.475796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.476066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.476710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.484032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.543810 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2235/4501] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:51 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:51.547111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.568211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d255c-f7b8-4e67-a67d-dd7737b1674b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.580939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.581627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.582163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.582446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.583011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.586366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.617124 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2236/4502] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:51 2022] GET /identity/v3/roles => generated 1880 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:08:51.618090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.641914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669bd63-41d8-4986-b45d-d35b01e647ab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.651032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.651690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.651972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.652245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/groups/9f6e763527be4374b70c3f78ae5479be` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.653435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.654157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.654373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.654639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] PATH_INFO: `/v3/projects/c32a09b65e7e418caf96ce95f1430263/users/1b745fd42fe74510a74152a1fb8716ae/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.656130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9f6e763527be4374b70c3f78ae5479be)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.657487 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:51.657487 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:51.657487 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:51.658811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.685650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:51.690332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32a09b65e7e418caf96ce95f1430263, user_id=1b745fd42fe74510a74152a1fb8716ae, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.699853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:51.734949 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2237/4503] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:51 2022] PUT /identity/v3/projects/c32a09b65e7e418caf96ce95f1430263/users/1b745fd42fe74510a74152a1fb8716ae/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:51.738466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.813895 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2267/4504] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:08:51 2022] DELETE /identity/v3/groups/9f6e763527be4374b70c3f78ae5479be => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:51.817969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:51.892960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c046bc-ee49-4da6-bff8-f633f34eae6f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.972247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e5177-b479-4d4f-a810-bfb838d9744e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:51.990439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:51.990719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:51.991008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:51.991436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles/628ca455255d49898c15d8c408a97572` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:51.997877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_role(role_id=628ca455255d49898c15d8c408a97572)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:51.999055 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:08:51.999055 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:08:51.999055 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:08:52.000119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.023486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:52.025440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.025891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.026300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.027148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:52.029162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.055984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2238/4505] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:51 2022] GET /identity/v3/roles => generated 1880 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:52.063555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:52.073190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:52.083059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafadd68-86f7-4dc5-b9f3-0a756fd5c5f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:52.094060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role 628ca455255d49898c15d8c408a97572 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:52.094268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.095341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.097347 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2268/4506] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:51 2022] DELETE /identity/v3/roles/628ca455255d49898c15d8c408a97572 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:52.102205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:52.105498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:52.117332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:52.119980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.120507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.121798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] PATH_INFO: `/v3/projects/c32a09b65e7e418caf96ce95f1430263/users/1b745fd42fe74510a74152a1fb8716ae/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.125552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32a09b65e7e418caf96ce95f1430263, user_id=1b745fd42fe74510a74152a1fb8716ae, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:52.129412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b12c0-97fe-4de9-8a45-54ad360aae61 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.165973 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2239/4507] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:52 2022] PUT /identity/v3/projects/c32a09b65e7e418caf96ce95f1430263/users/1b745fd42fe74510a74152a1fb8716ae/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:52.168305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.168305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.168586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.228951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] MFA Rules not processed for user `1b745fd42fe74510a74152a1fb8716ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:52.230009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:52.364871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b42d4-8319-4431-be86-0ad1e1707959 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:52.393028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2240/4508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:08:52.408316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:52.409982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:52.476668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:52.523861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:52.524533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.524819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.525575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/c5ab075215f849819c7784024ae354b3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.526628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c5ab075215f849819c7784024ae354b3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:52.528266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.588954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.589745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.632216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ecc28-3269-4a6d-ac7e-210472ed0494 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:52.645985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.646636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.654166 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2269/4509] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:08:52 2022] PATCH /identity/v3/domains/c5ab075215f849819c7784024ae354b3 => generated 277 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:52.654811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:52.659693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:52.750920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:52.751714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.751998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.752269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.755847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:52.794297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:52.803171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168053-b799-4822-83f7-24d0c183e9f5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:52.816542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:52.817207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:52.817491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:52.817769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/c5ab075215f849819c7784024ae354b3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:52.843079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c5ab075215f849819c7784024ae354b3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:52.845747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.893943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:52.896782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:52.899286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.903951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c5ab075215f849819c7784024ae354b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:52.937891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2241/4510] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:08:53.024653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.053467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.065614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.089131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project c5ab075215f849819c7784024ae354b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:53.089662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.090607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.094975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:53.117288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.126917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.128682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c5ab075215f849819c7784024ae354b3', 'request_id': 'req-d9590dec-8a8a-4b52-bef7-b0aab0527124'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.145471 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2270/4511] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:52 2022] DELETE /identity/v3/domains/c5ab075215f849819c7784024ae354b3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:53.150233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:53.176002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623edc9-7f9e-4dc0-a73c-1e488afe9c05 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:53.375167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:53.375857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:53.376139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:53.376416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/696781bc7c1d40359e02bdde7d93c51a/users/0971171a32934e5dbb099615c02100d4/roles/b8a30867108142c7b82deea10e6dbfda` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:53.395980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=696781bc7c1d40359e02bdde7d93c51a, user_id=0971171a32934e5dbb099615c02100d4, role_id=b8a30867108142c7b82deea10e6dbfda)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:53.404700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:53.430033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role b8a30867108142c7b82deea10e6dbfda was removed from user 0971171a32934e5dbb099615c02100d4 on domain 696781bc7c1d40359e02bdde7d93c51a. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:53.430382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.433437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.488662 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2242/4512] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Oct 28 10:08:53 2022] DELETE /identity/v3/domains/696781bc7c1d40359e02bdde7d93c51a/users/0971171a32934e5dbb099615c02100d4/roles/b8a30867108142c7b82deea10e6dbfda => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:53.492856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:53.494537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:53.520746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9590dec-8a8a-4b52-bef7-b0aab0527124 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:53.698850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:53.702355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:53.702953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:53.704181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles/b8a30867108142c7b82deea10e6dbfda` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:53.711098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b8a30867108142c7b82deea10e6dbfda)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:53.716147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:53.821308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role b8a30867108142c7b82deea10e6dbfda has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:53.821932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.823204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:53.828768 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2271/4513] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:53 2022] DELETE /identity/v3/roles/b8a30867108142c7b82deea10e6dbfda => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:53.833663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:53.836167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:53.855334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:53.858997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:53.881498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b7b5-763e-4fe3-a389-3848a7c10d20 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:54.047266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a4950-ea54-4100-af47-f23a8e491ee2 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:54.055346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:54.056564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:54.057179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:54.057719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] PATH_INFO: `/v3/users/9ebeaedc29354553b5ad818c9a7760f5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:54.059426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebeaedc29354553b5ad818c9a7760f5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:54.062299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:54.062845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:54.063503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:54.063781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:54.064190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/696781bc7c1d40359e02bdde7d93c51a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:54.068705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=696781bc7c1d40359e02bdde7d93c51a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:54.071244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:54.125953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.126727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.177539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.178250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebeaedc29354553b5ad818c9a7760f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.179011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.179615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebeaedc29354553b5ad818c9a7760f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.196527 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2243/4514] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:08:53 2022] PATCH /identity/v3/domains/696781bc7c1d40359e02bdde7d93c51a => generated 276 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:54.198176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:54.198438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:54.200319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:54.206373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebeaedc29354553b5ad818c9a7760f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.228229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebeaedc29354553b5ad818c9a7760f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.232303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1ff5b29-367e-474a-a471-cc513d363619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebeaedc29354553b5ad818c9a7760f5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.270774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:54.290441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2272/4515] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:53 2022] DELETE /identity/v3/users/9ebeaedc29354553b5ad818c9a7760f5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:54.300042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:54.301236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:54.301711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:54.359207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:54.360713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:54.413795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d4743-433a-4ef7-9149-58488d08e551 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:54.632427 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2273/4516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:54.643209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:54.649777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:54.681509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:54.682414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:54.682698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:54.686212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/696781bc7c1d40359e02bdde7d93c51a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:54.733964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=696781bc7c1d40359e02bdde7d93c51a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:54.738749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:54.805947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.809866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.865601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4432f-a1d0-409b-a14b-f2e57e5ad9b6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:54.879365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:54.880140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:54.880278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:54.880550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:54.905849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:54.907299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:54.926866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2274/4517] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:54.927733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:54.934044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.934561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:54.948665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:54.962602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb904-6ad6-4d5a-926a-8466b079b3bd service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:54.967131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.009670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project 696781bc7c1d40359e02bdde7d93c51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:55.009994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.010688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.046318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.058055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.061751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '696781bc7c1d40359e02bdde7d93c51a', 'request_id': 'req-ef370495-a559-475c-b9d2-33987f8f4001'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.095650 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2244/4518] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:08:54 2022] DELETE /identity/v3/domains/696781bc7c1d40359e02bdde7d93c51a => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:08:55.101317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:55.106895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.124522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:55.125783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.126436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.126808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.127389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.129549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.164687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:55.269427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.272790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abfe97-2923-4ace-ade7-1ae9d129824c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.300493 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2275/4519] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:55.303287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9f6d-5dbd-48dd-8b0e-9eda1c044f87 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.303563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9f6d-5dbd-48dd-8b0e-9eda1c044f87 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.303837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9f6d-5dbd-48dd-8b0e-9eda1c044f87 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.310191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370495-a559-475c-b9d2-33987f8f4001 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:55.316896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2276/4520] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:08:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:08:55.319425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.321479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.321791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.324640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.326439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.327166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.327602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.330515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.336789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.359588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2245/4521] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:55.363612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:55.392605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21172-5ef8-4c51-8a69-f879e3d00291 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:55.416719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.417066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.417407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.418208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.422170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(project_id=be3e00aa68b54f9b8d5705017c02e3f3, user_id=dac6153e37a8419db9ef3c28c92b0f75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.424135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:55.425000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.427796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.458298 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2277/4522] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:55.462290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2246/4523] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:55 2022] PUT /identity/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:55.469629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:55.478890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:55.481596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.496505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a570-6daf-4f33-acfb-5332ad6aa817 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:55.643207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac02681-d51d-4c7f-86bc-34cc27ac52db tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:55.654303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.655484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.655731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.656000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.671156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.671957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.673357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.673572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.674671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.675773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aacea1-d85e-4762-8d7d-4df2553f8404 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.681326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.682984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.703379 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2247/4524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:08:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:55.715007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:55.725968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.792193 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2278/4525] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:08:55 2022] GET /identity/v3/auth/projects => generated 828 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:55.794902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.795438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.795774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.841415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:55.842695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:55.847075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb74b-105e-4e01-a9e6-075d5a829fac service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:55.853052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:55.853698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:55.853977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:55.854355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] PATH_INFO: `/v3/projects/60bde2e33c1e44ccac5322aa8d66ca43` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:55.855403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bde2e33c1e44ccac5322aa8d66ca43)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:55.857365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:55.917777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:55.927543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:55.965010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bde2e33c1e44ccac5322aa8d66ca43', 'request_id': 'req-7fd4341d-651c-4c87-8c43-8d6d691cb75a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:55.996832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bde2e33c1e44ccac5322aa8d66ca43', 'request_id': 'req-7fd4341d-651c-4c87-8c43-8d6d691cb75a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.001390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2279/4526] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:56.003367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.037476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e400d-7f64-4a7b-a742-adc550eab703 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:56.043884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bde2e33c1e44ccac5322aa8d66ca43', 'request_id': 'req-7fd4341d-651c-4c87-8c43-8d6d691cb75a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.067751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] The token cache is being invalidate because project 60bde2e33c1e44ccac5322aa8d66ca43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:56.068621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.069615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.071321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2248/4527] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:55 2022] DELETE /identity/v3/projects/60bde2e33c1e44ccac5322aa8d66ca43 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:56.072657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.075149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:56.166676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:56.167442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:56.167727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:56.168134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:56.172994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=be3e00aa68b54f9b8d5705017c02e3f3, user_id=dac6153e37a8419db9ef3c28c92b0f75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:56.177602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:56.191044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4341d-651c-4c87-8c43-8d6d691cb75a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:56.195327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role 2f6026da89244dcf8bb34fbb1d317246 was removed from user dac6153e37a8419db9ef3c28c92b0f75 on project be3e00aa68b54f9b8d5705017c02e3f3. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:56.195699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.196446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.198032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:56.198811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:56.199223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:56.199616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:56.202409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:56.235116 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2280/4528] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:08:56 2022] DELETE /identity/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3/users/dac6153e37a8419db9ef3c28c92b0f75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:56.236080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.240942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:56.277916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:56.279643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:56.315095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2249/4529] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:08:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:56.316159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.321014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:56.370600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91992-2502-4868-b38f-4ab069b23f11 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:56.454135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b0e3-56fc-4925-8b88-daf28c3f90f1 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:56.460127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:56.461248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:56.461758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:56.462232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] PATH_INFO: `/v3/users/1b745fd42fe74510a74152a1fb8716ae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:56.463880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b745fd42fe74510a74152a1fb8716ae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:56.466199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:56.538676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:56.563962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:56.564997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:56.565293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:56.565562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:56.566302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:56.569268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:56.579310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b745fd42fe74510a74152a1fb8716ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.584785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b745fd42fe74510a74152a1fb8716ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.597119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b745fd42fe74510a74152a1fb8716ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.609264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b745fd42fe74510a74152a1fb8716ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.609778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b745fd42fe74510a74152a1fb8716ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:56.613907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:56.625362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2250/4530] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:56 2022] POST /identity/v3/users => generated 323 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:56.628099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.645005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:56.662187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2281/4531] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:56 2022] DELETE /identity/v3/users/1b745fd42fe74510a74152a1fb8716ae => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:56.672626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57da62-862e-41c7-8c9e-8e21efcbe2f6 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:56.776245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:56.777058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:56.777762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:56.778042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:56.779222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:56.782311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:56.837008 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2251/4532] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:56 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:56.841413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:56.864370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116bf1-0b16-4cf3-b104-ee38e7dfd602 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:57.014227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:57.015101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.015588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.016113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.017284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:57.021546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:57.068866 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2282/4533] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:56 2022] POST /identity/v3/projects => generated 364 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:57.070154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:57.095572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d1f8-2a53-40d7-a63b-a3ed9faf3ea7 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:57.137748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:57.144104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:57.283705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:57.284474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.284862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.285218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.285900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:57.287748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4405ac-4e72-4629-9a93-ba913b028306 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:57.307985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3e9b-50ac-44d9-b0da-c183e073536e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:57.316055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2252/4534] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:08:57 2022] POST /identity/v3/roles => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:57.317905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088981-fe24-4773-988a-c096247b515e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.318330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088981-fe24-4773-988a-c096247b515e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.318829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088981-fe24-4773-988a-c096247b515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.335450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:57.336113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.336387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.336655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] PATH_INFO: `/v3/projects/c32a09b65e7e418caf96ce95f1430263` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.340731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32a09b65e7e418caf96ce95f1430263)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:57.343766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:57.353268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e3088981-fe24-4773-988a-c096247b515e None None] MFA Rules not processed for user `90aefa22b02749e8a6b03d16378a0a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:57.354932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e3088981-fe24-4773-988a-c096247b515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:57.426866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32a09b65e7e418caf96ce95f1430263', 'request_id': 'req-3b901517-d3f4-42d0-990c-550558645a0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.439357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32a09b65e7e418caf96ce95f1430263', 'request_id': 'req-3b901517-d3f4-42d0-990c-550558645a0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.453156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32a09b65e7e418caf96ce95f1430263', 'request_id': 'req-3b901517-d3f4-42d0-990c-550558645a0f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.466537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:57.472018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:57.479274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] The token cache is being invalidate because project c32a09b65e7e418caf96ce95f1430263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:57.481195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.490284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.499109 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2283/4535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:57 2022] DELETE /identity/v3/projects/c32a09b65e7e418caf96ce95f1430263 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:57.499109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:57.502679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:57.508295 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2253/4536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:57.510173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088981-fe24-4773-988a-c096247b515e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:57.515928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e3088981-fe24-4773-988a-c096247b515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:57.545463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088981-fe24-4773-988a-c096247b515e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:57.683323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901517-d3f4-42d0-990c-550558645a0f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:57.695925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:57.697893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.707688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.708132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/fbde7d318e054ae9a601ffe376bac751/users/92f8af68883f4b86b5ebb415280d1632/roles/ce4c896137764650a9cf6ea4e0ce7ec7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.730549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fbde7d318e054ae9a601ffe376bac751, user_id=92f8af68883f4b86b5ebb415280d1632, role_id=ce4c896137764650a9cf6ea4e0ce7ec7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:57.734558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f8b5f-4615-4bf5-8289-493178f39311 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:57.742294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:57.742963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.743601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.744131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] PATH_INFO: `/v3/users/6b0638e280d940d1ba1f3c78c02351c0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.758085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0638e280d940d1ba1f3c78c02351c0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:57.760115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:57.782107 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2284/4537] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:57 2022] PUT /identity/v3/projects/fbde7d318e054ae9a601ffe376bac751/users/92f8af68883f4b86b5ebb415280d1632/roles/ce4c896137764650a9cf6ea4e0ce7ec7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:57.786386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d2a8-02f9-4700-8978-0c70b38d0771 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:57.789677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d2a8-02f9-4700-8978-0c70b38d0771 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:57.790081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d2a8-02f9-4700-8978-0c70b38d0771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:57.850913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c485d2a8-02f9-4700-8978-0c70b38d0771 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:57.865344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c485d2a8-02f9-4700-8978-0c70b38d0771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:57.907864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0638e280d940d1ba1f3c78c02351c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.908578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0638e280d940d1ba1f3c78c02351c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.909257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0638e280d940d1ba1f3c78c02351c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.921541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0638e280d940d1ba1f3c78c02351c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.930408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0638e280d940d1ba1f3c78c02351c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:57.978122 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2254/4538] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:57 2022] DELETE /identity/v3/users/6b0638e280d940d1ba1f3c78c02351c0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:57.978122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:57.978122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.003225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2285/4539] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:58.018947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.019564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.019835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.059167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:58.061639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.116344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c70b-ab1b-4a2f-8e4a-bd5640fc54fe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.122056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.124079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.124430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.124712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/8df59b237c6547059d678de7a195f16f/users/92f8af68883f4b86b5ebb415280d1632/roles/ce4c896137764650a9cf6ea4e0ce7ec7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.127106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8df59b237c6547059d678de7a195f16f, user_id=92f8af68883f4b86b5ebb415280d1632, role_id=ce4c896137764650a9cf6ea4e0ce7ec7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.129958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ecdd7-7bdd-406e-9fa5-ff6f0cf4de22 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.154340 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2255/4540] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:57 2022] PUT /identity/v3/projects/8df59b237c6547059d678de7a195f16f/users/92f8af68883f4b86b5ebb415280d1632/roles/ce4c896137764650a9cf6ea4e0ce7ec7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:58.157467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ea56-5088-47d3-8f4d-2c763088f881 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.157664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ea56-5088-47d3-8f4d-2c763088f881 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.157936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ea56-5088-47d3-8f4d-2c763088f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.190086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:58.190609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2286/4541] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:58.194291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:58.207060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6461ea56-5088-47d3-8f4d-2c763088f881 None None] MFA Rules not processed for user `92f8af68883f4b86b5ebb415280d1632`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:58.208860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6461ea56-5088-47d3-8f4d-2c763088f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.218250 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2256/4542] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:58.219451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984042e-99d2-415c-b462-d5131777cfb6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.221586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.221816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.222229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.236555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] MFA Rules not processed for user `92f8af68883f4b86b5ebb415280d1632`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:58.238342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.245580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:58.309396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.313851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.314174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.314453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.315953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:58.316741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.318532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.343615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2257/4543] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 28 10:08:58.345096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:58.355528 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2287/4544] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:58.361037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:58.387755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f20-80fb-4e31-8816-11c8bc97bd62 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.402443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.402761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.403014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.403292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.404545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.406506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.468039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2288/4545] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:58.468643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:58.476739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738dce-f7b8-4ac6-b0d0-da76de5d4fae None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.477767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.594801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.595378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.595627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.595913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.596017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c01b-e1fc-4cd6-b99f-2ff5d2919e90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.613380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.614187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.615206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.615868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] PATH_INFO: `/v3/projects/669c6c5d2876466193ec4abce33def69` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.618576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669c6c5d2876466193ec4abce33def69)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.624693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.704290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:58.708989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.710996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.717965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669c6c5d2876466193ec4abce33def69', 'request_id': 'req-a2586242-2f00-4cd5-95f7-b1b58e8c9658'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:58.725360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669c6c5d2876466193ec4abce33def69', 'request_id': 'req-a2586242-2f00-4cd5-95f7-b1b58e8c9658'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:58.735936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669c6c5d2876466193ec4abce33def69', 'request_id': 'req-a2586242-2f00-4cd5-95f7-b1b58e8c9658'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:58.736177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2258/4546] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Oct 28 10:08:58 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:58.741281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:58.774094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1a098-1c73-4286-8f3c-b6e6e40265e3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:58.775850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] The token cache is being invalidate because project 669c6c5d2876466193ec4abce33def69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:58.777431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:58.780546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2586242-2f00-4cd5-95f7-b1b58e8c9658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:58.782023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2289/4547] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:58 2022] DELETE /identity/v3/projects/669c6c5d2876466193ec4abce33def69 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:58.784224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0d84a-66a7-4071-bf5b-7dfe7842a54c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.787496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0d84a-66a7-4071-bf5b-7dfe7842a54c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.787952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0d84a-66a7-4071-bf5b-7dfe7842a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.833251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-eab0d84a-66a7-4071-bf5b-7dfe7842a54c None None] MFA Rules not processed for user `0a40eaa5eefa439bb590a7511814f61c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:58.834830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eab0d84a-66a7-4071-bf5b-7dfe7842a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.856652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:58.916918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:58.917915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.919646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.920618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.923137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:58.925816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59fcb-6fc6-4e18-87eb-e9f6965bf099 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:58.957623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2290/4548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:58.959592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.960045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.960323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.963214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2259/4549] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:58.965629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:58.965911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:58.969591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:58.970317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:58.980717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] MFA Rules not processed for user `92f8af68883f4b86b5ebb415280d1632`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:58.981975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a9a61bc-c604-4a1d-a881-69b81b77414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.002417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:59.003900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.024318 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2260/4550] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:59.024318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.024318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.036073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2748ba-543b-4495-bde1-7dc146a9569f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.041993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.042683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.042961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.043239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.043942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.046511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.081088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2261/4551] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:59 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:59.082233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.084069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.132102 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2291/4552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 28 10:08:59.136674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.137916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.139668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.181331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:59.182889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.197109 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2292/4553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:08:59.198033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807fa29-2ed5-4a8c-91a3-414c636c9b2e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.200102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.203720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.204347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.204625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.204898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.205573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.207494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.214034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883d92-f2ba-4395-b3cb-de554d0d3136 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.219383 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2262/4554] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:59 2022] GET /identity/v3/roles => generated 1651 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:59.220240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.222968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.223869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.224987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.225273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.225855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.227540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.233828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.304425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2293/4555] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:08:59 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:59.305628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.320700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:59.335921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a8849-fb2c-4211-bb11-a878f68bff45 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.341371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.342031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.342356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.342643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.343488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:08:59.343931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.345973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.398319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2e62-9736-4e47-8857-2ba2245212da admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.408393 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2294/4556] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:08:59.412811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.419606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.420307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.423544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.423884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/roles/ce4c896137764650a9cf6ea4e0ce7ec7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.430922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ce4c896137764650a9cf6ea4e0ce7ec7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.432587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.494213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299a3f9-e8f2-462b-bce6-8dc0511aec59 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.510275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.514064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.514366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.517528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.518304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.521338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.576847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2295/4557] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:59 2022] GET /identity/v3/roles => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:59.577962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.584573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invalidating the token cache because role ce4c896137764650a9cf6ea4e0ce7ec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:08:59.584878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:59.585645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:08:59.587559 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2263/4558] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:08:59 2022] DELETE /identity/v3/roles/ce4c896137764650a9cf6ea4e0ce7ec7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:59.588329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.592759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.633571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51818bf-3709-4984-8bab-e7d309a9fd54 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.748736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.749396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.749690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.749948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.750591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.752365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.765868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8534e-bb55-4c16-ab3e-36a63cbafd50 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.769865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2296/4559] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:08:59.770180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.771961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.782319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.783535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.783535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.783735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:59.783822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.784132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.790258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.790402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497b87-51b2-44ea-91fc-4e65bdeceb25 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:08:59.798869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:08:59.800386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:59.800683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:59.801056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] PATH_INFO: `/v3/projects/f79e42e0383b47ec82ea6b9cb38b80fe/users/45ada20da9214728b2a4e16c66b37b0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:59.822380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79e42e0383b47ec82ea6b9cb38b80fe, user_id=45ada20da9214728b2a4e16c66b37b0a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:08:59.825774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:08:59.866163 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2297/4560] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:59 2022] PUT /identity/v3/projects/f79e42e0383b47ec82ea6b9cb38b80fe/users/45ada20da9214728b2a4e16c66b37b0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:08:59.867372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.870092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.908871 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2264/4561] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:08:59 2022] POST /identity/v3/projects => generated 397 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:08:59.912279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:08:59.934003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:59.980656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbddb58-8762-4001-89b0-9af7a31b95e4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.054107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07d49-4ed8-4afd-8e4b-c42959d45ec8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.056781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.057528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.057817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.058158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/8df59b237c6547059d678de7a195f16f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.059298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.059859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8df59b237c6547059d678de7a195f16f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.060119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.060435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.061124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] PATH_INFO: `/v3/projects/63ba0caa044245efa44111b366231ea8/users/f60ed4d46390452eba5a3948941beaf5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.062971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.082036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ba0caa044245efa44111b366231ea8, user_id=f60ed4d46390452eba5a3948941beaf5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.088182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1411e3-4368-44d9-986c-a78d3b6e6577 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.121909 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2265/4562] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:08:59 2022] PUT /identity/v3/projects/63ba0caa044245efa44111b366231ea8/users/f60ed4d46390452eba5a3948941beaf5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:00.125953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.125953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.125953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.144393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df59b237c6547059d678de7a195f16f', 'request_id': 'req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:00.152803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df59b237c6547059d678de7a195f16f', 'request_id': 'req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:00.165576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df59b237c6547059d678de7a195f16f', 'request_id': 'req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:00.165801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] MFA Rules not processed for user `45ada20da9214728b2a4e16c66b37b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:00.167798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:00.180578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:00.191806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project 8df59b237c6547059d678de7a195f16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:00.191806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:00.192224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:00.210857 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2298/4563] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:59 2022] DELETE /identity/v3/projects/8df59b237c6547059d678de7a195f16f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:00.212135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.214750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:00.257932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:00.314235 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2266/4564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:00.315326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.319558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:00.397154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5fe3-e68e-4d60-b17c-e31ae18be9b3 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.417236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.418289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.418419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.419712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.421842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.424079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.472873 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2299/4565] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:00 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:00.472873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.473173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090abd6-bbba-468d-9aa8-dec1daf4a551 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.476035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:00.487175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.487759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.488110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.488223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.489291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.490738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.518741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2267/4566] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:00.518741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.524287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:00.563810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8633b-d7cc-4f26-834a-6fd1eb768b02 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.576091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.576812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.577116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.577400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.578014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.579941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.632880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2018b-964e-46b0-a19f-8c9d3f0e2187 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.641595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.642408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.643079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.643727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/8df59b237c6547059d678de7a195f16f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.646510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2268/4567] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:00 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:00.648886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.656509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8df59b237c6547059d678de7a195f16f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.659020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Could not find project: 8df59b237c6547059d678de7a195f16f.: keystone.exception.ProjectNotFound: Could not find project: 8df59b237c6547059d678de7a195f16f. Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 28 10:09:00.685923 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8df59b237c6547059d678de7a195f16f. Oct 28 10:09:00.687543 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:00.696680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2300/4568] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:00 2022] DELETE /identity/v3/projects/8df59b237c6547059d678de7a195f16f => generated 113 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:09:00.697736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.720950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88663621-444a-4b57-9c7c-3d00d7961cd9 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.820572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25488-758a-4260-abd9-1e7fbd394a2c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.833625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.837618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.838029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.838404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.839169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.840923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.874228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2269/4569] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:00.875367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.890104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.892008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.892409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.892813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] PATH_INFO: `/v3/projects/63ba0caa044245efa44111b366231ea8/users/f60ed4d46390452eba5a3948941beaf5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.896720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ba0caa044245efa44111b366231ea8, user_id=f60ed4d46390452eba5a3948941beaf5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.899557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:00.900547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260fa2d-ec23-46b6-9244-de0adf9b912f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:00.933841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2301/4570] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:00 2022] PUT /identity/v3/projects/63ba0caa044245efa44111b366231ea8/users/f60ed4d46390452eba5a3948941beaf5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:00.938832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:00.943647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:00.947541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:00.949984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:00.950351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:00.953417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:00.960165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.006410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2270/4571] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:00 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:01.008765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:01.030756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:01.044567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442e7b0-004e-4348-ab3d-b06a033b7feb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.048316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:01.126216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fea53-d733-44cb-9480-8b4664809548 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.140118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.141549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.144749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.145389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/projects/fbde7d318e054ae9a601ffe376bac751` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.147995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fbde7d318e054ae9a601ffe376bac751)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.150227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.212664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.213547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.216137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.216491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.218838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.222625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.249659 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2271/4572] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:01.251992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:01.273447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbde7d318e054ae9a601ffe376bac751', 'request_id': 'req-78915791-753b-4366-bee6-d1074752692e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.283329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbde7d318e054ae9a601ffe376bac751', 'request_id': 'req-78915791-753b-4366-bee6-d1074752692e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.299588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72db-e037-47c4-810f-017e392d025c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.302852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbde7d318e054ae9a601ffe376bac751', 'request_id': 'req-78915791-753b-4366-bee6-d1074752692e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.327538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] The token cache is being invalidate because project fbde7d318e054ae9a601ffe376bac751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:01.327906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.329339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.331376 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2302/4573] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:00 2022] DELETE /identity/v3/projects/fbde7d318e054ae9a601ffe376bac751 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:01.332157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:01.340367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:01.483578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.486642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.487650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.489161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.491667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.493771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.519683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915791-753b-4366-bee6-d1074752692e tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.527813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2272/4574] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:01.531877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:01.534637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:01.535501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.536410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.536645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.536947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] PATH_INFO: `/v3/projects/1db5a7e70c534021893d95bf2ae5a7d8/users/59dbe73883424ac29253f33bb681f622/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.595054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db5a7e70c534021893d95bf2ae5a7d8, user_id=59dbe73883424ac29253f33bb681f622, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.598451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.626263 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2303/4575] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:01 2022] PUT /identity/v3/projects/1db5a7e70c534021893d95bf2ae5a7d8/users/59dbe73883424ac29253f33bb681f622/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:01.627101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:01.637979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:01.736640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:01.745284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaca7a-7d5e-476d-8e85-d209da0152fc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.776058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850fab9-b199-4f41-8cda-428f6d63db37 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:01.780887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.781607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.781890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.782163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] PATH_INFO: `/v3/projects/4fba2995e0924f539322ae48db3149b7/users/40d1bf650e0a4d8bb6ca1de1df02c375/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.798204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fba2995e0924f539322ae48db3149b7, user_id=40d1bf650e0a4d8bb6ca1de1df02c375, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.800815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c21370-490e-4bef-bcd0-be14d779f84f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.821420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:01.824879 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2304/4576] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:01 2022] PUT /identity/v3/projects/4fba2995e0924f539322ae48db3149b7/users/40d1bf650e0a4d8bb6ca1de1df02c375/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:01.827814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.828276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.828694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.865761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:01.866564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:01.866923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:01.867266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/users/92f8af68883f4b86b5ebb415280d1632` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:01.868744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=92f8af68883f4b86b5ebb415280d1632)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:01.870869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:01.893490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:01.895661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:01.969066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f8af68883f4b86b5ebb415280d1632'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.972176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f8af68883f4b86b5ebb415280d1632'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.973096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f8af68883f4b86b5ebb415280d1632'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:01.990801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f8af68883f4b86b5ebb415280d1632'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:02.014232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f8af68883f4b86b5ebb415280d1632'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:02.061801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2273/4577] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:01 2022] DELETE /identity/v3/users/92f8af68883f4b86b5ebb415280d1632 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:02.062758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.069863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:02.083660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2305/4578] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:02.108774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.111081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:02.192098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939f1b0-bd6c-4265-ab03-a323f62d9d75 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.198140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.198775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.199114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.199424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.200077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:02.201846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed05d0-3edc-4bc3-b7c1-7ab1aaf5990c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:02.210082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97ca8-da3b-4a8a-892a-966db1766f95 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.220288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2274/4579] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:02.222001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.222440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.222882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.257637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:02.259409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:02.303908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.304565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.304849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.305151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/efbf616e831c4183ba8a604cf38c18bc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.326030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Could not find domain: efbf616e831c4183ba8a604cf38c18bc.: keystone.exception.DomainNotFound: Could not find domain: efbf616e831c4183ba8a604cf38c18bc. Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: efbf616e831c4183ba8a604cf38c18bc. Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:02.352683 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:02.353910 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: efbf616e831c4183ba8a604cf38c18bc. Oct 28 10:09:02.354877 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:02.355924 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2306/4580] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:09:02 2022] PATCH /identity/v3/domains/efbf616e831c4183ba8a604cf38c18bc => generated 112 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:09:02.355924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.377452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d328fb-3c4e-466e-88f8-b83ba1960f81 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.392150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.393704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.409158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.410797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] PATH_INFO: `/v3/projects/4fba2995e0924f539322ae48db3149b7/users/40d1bf650e0a4d8bb6ca1de1df02c375/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.421490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fba2995e0924f539322ae48db3149b7, user_id=40d1bf650e0a4d8bb6ca1de1df02c375, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:02.437416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:02.439278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2275/4581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:02.441521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:02.455389 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2307/4582] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:02 2022] PUT /identity/v3/projects/4fba2995e0924f539322ae48db3149b7/users/40d1bf650e0a4d8bb6ca1de1df02c375/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:02.456689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.456975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.459092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:02.487192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:02.501776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6160e1-af65-45d8-822f-e5ff0ee64894 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.637284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.637542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.638053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.639421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/19eb506efd5647cdbd0cd00470f72746` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.653867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:09:02.662413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b5349-cb64-4b36-a5da-ca22a54d6da2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.671164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.671861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.672321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.672698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-8f037760-8dd3-44c9-89bf-5326a0b0bca5 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Could not find domain: 19eb506efd5647cdbd0cd00470f72746.: keystone.exception.DomainNotFound: Could not find domain: 19eb506efd5647cdbd0cd00470f72746. Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 19eb506efd5647cdbd0cd00470f72746. Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:02.673313 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:02.674347 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 19eb506efd5647cdbd0cd00470f72746. Oct 28 10:09:02.675296 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:02.676170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2276/4583] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:09:02 2022] PATCH /identity/v3/domains/19eb506efd5647cdbd0cd00470f72746 => generated 112 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:09:02.676235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654916b-dda0-4154-8a51-c4c26451b0ef None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.676520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654916b-dda0-4154-8a51-c4c26451b0ef None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.676795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654916b-dda0-4154-8a51-c4c26451b0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.730368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3654916b-dda0-4154-8a51-c4c26451b0ef None None] MFA Rules not processed for user `40d1bf650e0a4d8bb6ca1de1df02c375`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:02.731633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3654916b-dda0-4154-8a51-c4c26451b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:02.834513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:02.839106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:02.876321 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2308/4584] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:02.877326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:02.939880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431b61-8340-4fda-9c3a-176f13b8727e service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:02.949417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2277/4585] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:02.951081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.952091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.952605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.957937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:02.958605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:02.958894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:02.959167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/c5ab075215f849819c7784024ae354b3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:02.985958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Could not find domain: c5ab075215f849819c7784024ae354b3.: keystone.exception.DomainNotFound: Could not find domain: c5ab075215f849819c7784024ae354b3. Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c5ab075215f849819c7784024ae354b3. Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:02.997487 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:02.998688 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c5ab075215f849819c7784024ae354b3. Oct 28 10:09:02.999504 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:03.009154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2309/4586] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:09:02 2022] PATCH /identity/v3/domains/c5ab075215f849819c7784024ae354b3 => generated 112 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:09:03.010122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:03.010353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:03.011818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.016567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.030900 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2278/4587] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:03.031997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:03.061388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad92e-f86c-42b2-b7fd-dbaace35ad9e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:03.083375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dac6153e37a8419db9ef3c28c92b0f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859422360d14a50b0f5cde619d687d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:03.084056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.084681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.084681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] PATH_INFO: `/v3/domains/696781bc7c1d40359e02bdde7d93c51a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.099489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0078b4fc-1f94-4a42-be61-d2fa58ebd9ac tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Could not find domain: 696781bc7c1d40359e02bdde7d93c51a.: keystone.exception.DomainNotFound: Could not find domain: 696781bc7c1d40359e02bdde7d93c51a. Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 696781bc7c1d40359e02bdde7d93c51a. Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:03.119706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:03.124567 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 696781bc7c1d40359e02bdde7d93c51a. Oct 28 10:09:03.125949 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:03.127729 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2279/4588] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:09:03 2022] PATCH /identity/v3/domains/696781bc7c1d40359e02bdde7d93c51a => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:09:03.130786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.131150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.131425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.171303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:03.172570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.196452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2280/4589] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:03.204025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:03.206735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.218237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03caf32-f97b-43f3-8ebe-428832867512 tempest-TokensV3TestJSON-1352463077 tempest-TokensV3TestJSON-1352463077-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:03.230583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:03.231497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.231915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.232366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.301784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:03.308302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7914-9e3c-4bfc-b9e0-f487da4fc53a service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:03.343428 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2310/4590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:03.345669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21499d-a359-4d0a-9b36-dcbb9077107e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.345963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21499d-a359-4d0a-9b36-dcbb9077107e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.346237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21499d-a359-4d0a-9b36-dcbb9077107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.370820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:03.410708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bf21499d-a359-4d0a-9b36-dcbb9077107e None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:03.412852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf21499d-a359-4d0a-9b36-dcbb9077107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.441697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2311/4591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:03.495591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.495988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.496275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.502765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6799-b930-4f17-a926-95d4ba147a63 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:03.512587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:03.513420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.513828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.514198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] PATH_INFO: `/v3/users/d6192ec6daa74c5993f81b7789fd91f3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.517435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6192ec6daa74c5993f81b7789fd91f3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:03.520336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:03.526950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:03.558784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] MFA Rules not processed for user `59dbe73883424ac29253f33bb681f622`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:03.563787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.590285 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2312/4592] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:03.628028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:03.635360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.694961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025f20-157a-410b-bcdb-c34a99ac0d34 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:03.715951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6192ec6daa74c5993f81b7789fd91f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.717396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6192ec6daa74c5993f81b7789fd91f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.718183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:03.719214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6192ec6daa74c5993f81b7789fd91f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.719687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.720119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.721436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] PATH_INFO: `/v3/users/59dbe73883424ac29253f33bb681f622` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.723656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=59dbe73883424ac29253f33bb681f622)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:03.725853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:03.738871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6192ec6daa74c5993f81b7789fd91f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.751223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dde2c0a7-48c7-4734-988a-747cc8dc7007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6192ec6daa74c5993f81b7789fd91f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.813203 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2281/4593] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:03 2022] DELETE /identity/v3/users/d6192ec6daa74c5993f81b7789fd91f3 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:03.815151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.815454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.815730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.861368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59dbe73883424ac29253f33bb681f622'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.861715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:03.862403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59dbe73883424ac29253f33bb681f622'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.862953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:03.887002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59dbe73883424ac29253f33bb681f622'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.918642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59dbe73883424ac29253f33bb681f622'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.925355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10190bb6-6ee7-42fc-8101-0a9604e76ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59dbe73883424ac29253f33bb681f622'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:03.983291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2313/4594] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:03 2022] DELETE /identity/v3/users/59dbe73883424ac29253f33bb681f622 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:03.988334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:03.988760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:03.989188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:03.995631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2282/4595] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:04.036202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:04.037973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:04.051683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:04.055342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:04.161673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2314/4596] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:04.195279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:04.199597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:04.228240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0139bf-41c6-4c83-869f-a9f74d60a2ed None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:04.296084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:04.301891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4b170-c486-46a2-bda2-3fe90c488a67 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:04.307549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:04.308253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:04.308685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:04.309012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:04.322610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:04.323448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:04.324100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:04.324519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:04.324826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:04.325100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:04.343948 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2315/4597] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:09:04.354106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:04.356216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:04.391685 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2283/4598] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:05.521900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:05.523420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:05.539895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeb545-192e-461a-b8f5-56b133ba036b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:05.546306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:05.547115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:05.547398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:05.547724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] PATH_INFO: `/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:05.549724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3e00aa68b54f9b8d5705017c02e3f3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:05.551626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:05.553474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:05.653456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3e00aa68b54f9b8d5705017c02e3f3', 'request_id': 'req-4bb19d5c-c6bc-4e9d-89da-9a1384093500'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:05.661420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3e00aa68b54f9b8d5705017c02e3f3', 'request_id': 'req-4bb19d5c-c6bc-4e9d-89da-9a1384093500'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:05.673393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3e00aa68b54f9b8d5705017c02e3f3', 'request_id': 'req-4bb19d5c-c6bc-4e9d-89da-9a1384093500'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:05.689448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] The token cache is being invalidate because project be3e00aa68b54f9b8d5705017c02e3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:05.691267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:05.692202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:05.697880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2316/4599] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:05 2022] DELETE /identity/v3/projects/be3e00aa68b54f9b8d5705017c02e3f3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:05.698152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:05.710768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516e964-6da1-4c08-b1f3-466d68d02d9d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:05.843053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:05.845970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:05.848231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:05.848667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] PATH_INFO: `/v3/users/dac6153e37a8419db9ef3c28c92b0f75` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:05.854321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac6153e37a8419db9ef3c28c92b0f75)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:05.865238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.021690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac6153e37a8419db9ef3c28c92b0f75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.023271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac6153e37a8419db9ef3c28c92b0f75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.024562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac6153e37a8419db9ef3c28c92b0f75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.040020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac6153e37a8419db9ef3c28c92b0f75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.051537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac6153e37a8419db9ef3c28c92b0f75'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.096481 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2284/4600] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:05 2022] DELETE /identity/v3/users/dac6153e37a8419db9ef3c28c92b0f75 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:06.151654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.153424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.169790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19d5c-c6bc-4e9d-89da-9a1384093500 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.290360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.292467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.339490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.340629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.341086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.341506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] PATH_INFO: `/v3/users/45ada20da9214728b2a4e16c66b37b0a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.343442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ada20da9214728b2a4e16c66b37b0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.345650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.412251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10563b19-574a-4c38-9b60-c9777369c34e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.418584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.419531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.419904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.420961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] PATH_INFO: `/v3/projects/1db5a7e70c534021893d95bf2ae5a7d8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.422429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db5a7e70c534021893d95bf2ae5a7d8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.424601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.427419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:06.455324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ada20da9214728b2a4e16c66b37b0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.457646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ada20da9214728b2a4e16c66b37b0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.477284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ada20da9214728b2a4e16c66b37b0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.488899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ada20da9214728b2a4e16c66b37b0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.489940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96025a0a-8d01-49c7-82ea-72a7f80aed53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ada20da9214728b2a4e16c66b37b0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.517173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db5a7e70c534021893d95bf2ae5a7d8', 'request_id': 'req-b1098be9-5898-4d6c-b827-4bcaf4d16884'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.526325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db5a7e70c534021893d95bf2ae5a7d8', 'request_id': 'req-b1098be9-5898-4d6c-b827-4bcaf4d16884'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.529053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2317/4601] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:06 2022] DELETE /identity/v3/users/45ada20da9214728b2a4e16c66b37b0a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:06.534534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42382-a58c-4505-970f-515db33ef41c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.535110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42382-a58c-4505-970f-515db33ef41c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.535333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42382-a58c-4505-970f-515db33ef41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.535505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db5a7e70c534021893d95bf2ae5a7d8', 'request_id': 'req-b1098be9-5898-4d6c-b827-4bcaf4d16884'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.551113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] The token cache is being invalidate because project 1db5a7e70c534021893d95bf2ae5a7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:06.551465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.552117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b1098be9-5898-4d6c-b827-4bcaf4d16884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.558625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2285/4602] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:06 2022] DELETE /identity/v3/projects/1db5a7e70c534021893d95bf2ae5a7d8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:06.562933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-97a42382-a58c-4505-970f-515db33ef41c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:06.563485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0e5-82f8-4b02-9c60-d267569e564a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.563845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0e5-82f8-4b02-9c60-d267569e564a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.564190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c0e5-82f8-4b02-9c60-d267569e564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.564967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-97a42382-a58c-4505-970f-515db33ef41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.569881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:06.598474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f185c0e5-82f8-4b02-9c60-d267569e564a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:06.598474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f185c0e5-82f8-4b02-9c60-d267569e564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.640169 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2318/4603] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:06.653212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42382-a58c-4505-970f-515db33ef41c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.656596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-97a42382-a58c-4505-970f-515db33ef41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.706065 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2286/4604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:06.727513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.728129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.728574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.754783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42382-a58c-4505-970f-515db33ef41c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.756547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:06.757811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.760011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.760693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.761056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.761395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.770692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2287/4605] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:06.770692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.773874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.775531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.775698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.790001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18222c2e-e94f-40a6-8543-97a7f6b8f310 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.790236 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2319/4606] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:06.791137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.799202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.800113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.800540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.801126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] PATH_INFO: `/v3/users/6859db32b98f4caba7379962eaef9de3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.802159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b7c5c-0b41-43a3-b859-a5eead058fb4 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.803346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6859db32b98f4caba7379962eaef9de3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.807570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.808250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.808750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.808870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.809132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.809738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:06.810100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.812055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.828749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2320/4607] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:06.835159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.859422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9660d-4cc1-408a-8346-fdf956cfd82a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:06.866752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:06.867964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:06.868247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:06.868522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:06.869200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:06.871912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:06.925507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6859db32b98f4caba7379962eaef9de3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.926191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6859db32b98f4caba7379962eaef9de3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.927198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6859db32b98f4caba7379962eaef9de3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.932369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2321/4608] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:06 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:06.933466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:06.935360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:06.947449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6859db32b98f4caba7379962eaef9de3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:06.973464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6859db32b98f4caba7379962eaef9de3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.000121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:07.016954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2288/4609] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:06 2022] DELETE /identity/v3/users/6859db32b98f4caba7379962eaef9de3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:07.049641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fce89-a363-481e-bedd-c962b2c1933e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.087502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:07.147659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.148386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.148733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.149448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.149948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.151990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.196337 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2322/4610] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:06 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:07.203861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.228560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766005-0cf8-4b57-a5f7-38cae7fa9d82 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.236670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.239705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.239705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.239705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.239705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.242186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.255776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2289/4611] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:07.260461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.282392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebaea7-98a9-44d7-a385-6baa336d1da9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.283284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.287542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.311981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67904d1-8bbb-4d48-8aec-63ebba4b7361 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.321346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.325420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.325709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.325987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.327680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.329371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.329665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.330321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.330990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.331266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] PATH_INFO: `/v3/projects/5859422360d14a50b0f5cde619d687d7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.332671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5859422360d14a50b0f5cde619d687d7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.334796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.355302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2323/4612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:07.360316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.372291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2077ae6-767a-49fd-96e8-aad704c7d880 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.381421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.382158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.382513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.382860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] PATH_INFO: `/v3/projects/e5d457e3c222434cafad30e44c02a42a/users/8ebcf3f5f6914d0bb0511b8844198d51/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.433282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5859422360d14a50b0f5cde619d687d7', 'request_id': 'req-5ff79188-2027-4f32-b063-999cae029e16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.437515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d457e3c222434cafad30e44c02a42a, user_id=8ebcf3f5f6914d0bb0511b8844198d51, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.441564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5859422360d14a50b0f5cde619d687d7', 'request_id': 'req-5ff79188-2027-4f32-b063-999cae029e16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.450454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75cba2-af25-43a7-822f-e4b4ef87f4e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.453594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5859422360d14a50b0f5cde619d687d7', 'request_id': 'req-5ff79188-2027-4f32-b063-999cae029e16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.483222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] The token cache is being invalidate because project 5859422360d14a50b0f5cde619d687d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:07.484464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.489346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.490066 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2324/4613] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:07 2022] PUT /identity/v3/projects/e5d457e3c222434cafad30e44c02a42a/users/8ebcf3f5f6914d0bb0511b8844198d51/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:07.491903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.492089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.492367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.508652 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2290/4614] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:07 2022] DELETE /identity/v3/projects/5859422360d14a50b0f5cde619d687d7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:07.510453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.514479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.537448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:07.540308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.696493 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2325/4615] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:07.697738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.702326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.707290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff79188-2027-4f32-b063-999cae029e16 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.713703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.714373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.714748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.715028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] PATH_INFO: `/v3/users/0971171a32934e5dbb099615c02100d4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.716250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0971171a32934e5dbb099615c02100d4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.719258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.727757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8401-f24a-4905-9818-f74c11e602d1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.741095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:07.742691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:07.744256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:07.744934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] PATH_INFO: `/v3/projects/9ebe8016f5094b2a856a520ad1e5d4cf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:07.746190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebe8016f5094b2a856a520ad1e5d4cf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:07.752335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:07.829125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.829821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.830654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.840714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.850146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0971171a32934e5dbb099615c02100d4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.859839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:07.871975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebe8016f5094b2a856a520ad1e5d4cf', 'request_id': 'req-d81de134-e3bd-4e55-ab12-8cd068241e8e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.876165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2291/4616] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:07 2022] DELETE /identity/v3/users/0971171a32934e5dbb099615c02100d4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:07.877210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.878682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.884875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebe8016f5094b2a856a520ad1e5d4cf', 'request_id': 'req-d81de134-e3bd-4e55-ab12-8cd068241e8e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.895225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebe8016f5094b2a856a520ad1e5d4cf', 'request_id': 'req-d81de134-e3bd-4e55-ab12-8cd068241e8e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.915972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] The token cache is being invalidate because project 9ebe8016f5094b2a856a520ad1e5d4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:07.916367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.917251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:07.920830 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2326/4617] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:07 2022] DELETE /identity/v3/projects/9ebe8016f5094b2a856a520ad1e5d4cf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:07.926531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:07.928147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:07.937774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:07.988070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c286b-c644-44c4-b133-dce56bfc6980 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:07.999573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.001269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.001801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.003553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] PATH_INFO: `/v3/projects/f79e42e0383b47ec82ea6b9cb38b80fe` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.006470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79e42e0383b47ec82ea6b9cb38b80fe)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.008779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.069341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de134-e3bd-4e55-ab12-8cd068241e8e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.119757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79e42e0383b47ec82ea6b9cb38b80fe', 'request_id': 'req-11bc2606-812e-43df-becc-8b40151174ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.127609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79e42e0383b47ec82ea6b9cb38b80fe', 'request_id': 'req-11bc2606-812e-43df-becc-8b40151174ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.139815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79e42e0383b47ec82ea6b9cb38b80fe', 'request_id': 'req-11bc2606-812e-43df-becc-8b40151174ca'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.165878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] The token cache is being invalidate because project f79e42e0383b47ec82ea6b9cb38b80fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:08.167857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.168655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-11bc2606-812e-43df-becc-8b40151174ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.178421 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2292/4618] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:07 2022] DELETE /identity/v3/projects/f79e42e0383b47ec82ea6b9cb38b80fe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:08.179988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1fe9-38a0-4cdb-b381-e81bffa0132f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.180274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1fe9-38a0-4cdb-b381-e81bffa0132f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.180546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1fe9-38a0-4cdb-b381-e81bffa0132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.188263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.188892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.189197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.189467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.194038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.221885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.223352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.245237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c6cc1fe9-38a0-4cdb-b381-e81bffa0132f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:08.246486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6cc1fe9-38a0-4cdb-b381-e81bffa0132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.247567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2327/4619] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:08.250338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.255774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.283619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355b1f7-3304-4154-9beb-04e3d7b48003 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.403257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.404073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.404463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.404806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] PATH_INFO: `/v3/users/40d1bf650e0a4d8bb6ca1de1df02c375` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.413772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d1bf650e0a4d8bb6ca1de1df02c375)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.415173 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2293/4620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:08.422878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.423728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.424088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.424431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.453973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:08.458312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.473466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2294/4621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:08.474962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.496076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af6d3-e189-4d4b-a0c7-3fcf48053cd4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.505330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.505947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.506221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.506485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.507350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:08.508106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.510176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.510884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d1bf650e0a4d8bb6ca1de1df02c375'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.511485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d1bf650e0a4d8bb6ca1de1df02c375'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.533654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d1bf650e0a4d8bb6ca1de1df02c375'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.537424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:08.543658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2295/4622] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:08.548691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.548858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d1bf650e0a4d8bb6ca1de1df02c375'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.549482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d1bf650e0a4d8bb6ca1de1df02c375'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.550947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:08.552842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.575933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7cad-045c-4576-8b3e-7884cb9df187 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.590800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2328/4623] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:08 2022] DELETE /identity/v3/users/40d1bf650e0a4d8bb6ca1de1df02c375 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:08.594417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.596421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:08.596700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.597558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.597847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.598117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.598828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.604739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.671722 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2296/4624] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:08 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:08.676475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.738946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a72647-be7c-4b84-8cf3-d5b4506535d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.793086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b15e-358b-4907-b4b1-fb8b7bf75110 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.799211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.800596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.801094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.801382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.802106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.804316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.826893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.828441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.828825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.829216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] PATH_INFO: `/v3/projects/2337eb04488241eab3aecd80e9fc51c0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.831499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2337eb04488241eab3aecd80e9fc51c0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.833994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.841510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2297/4625] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:08 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:08.845253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.860391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d0e1-9c66-4d51-9236-695a5b5a7edc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.869232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:08.870196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.870731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.871026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:08.871857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:08.874601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:08.890688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2298/4626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:09:08.894408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:08.916531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb809c-9470-407d-af64-90bc28c1c33b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:08.917433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2337eb04488241eab3aecd80e9fc51c0', 'request_id': 'req-2b548714-1d83-4eca-bf51-fff64aeb66d8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.927943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2337eb04488241eab3aecd80e9fc51c0', 'request_id': 'req-2b548714-1d83-4eca-bf51-fff64aeb66d8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.941435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2337eb04488241eab3aecd80e9fc51c0', 'request_id': 'req-2b548714-1d83-4eca-bf51-fff64aeb66d8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.957704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] The token cache is being invalidate because project 2337eb04488241eab3aecd80e9fc51c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:08.958026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.958760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b548714-1d83-4eca-bf51-fff64aeb66d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:08.964315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2329/4627] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:08 2022] DELETE /identity/v3/projects/2337eb04488241eab3aecd80e9fc51c0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:08.966123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42415-d360-4f70-9d83-806e63dbac71 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:08.966512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42415-d360-4f70-9d83-806e63dbac71 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:08.966944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a42415-d360-4f70-9d83-806e63dbac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.010163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f2a42415-d360-4f70-9d83-806e63dbac71 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:09.012214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2a42415-d360-4f70-9d83-806e63dbac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.017781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.020198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.020817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.021159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.022821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.023989 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2330/4628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:09.024892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.032384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.032674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.033020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.046567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2299/4629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:09.048149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.061948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.077741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:09.080447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.093234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4459-451e-4c1d-904e-fca450e510b8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.098005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.098764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.099028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.099312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] PATH_INFO: `/v3/projects/80974eba622d4830886ec598e50cad90/users/f4dc1824197d40e58d0dfdc8f55ab72d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.116278 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2331/4630] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:09.122094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.132259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80974eba622d4830886ec598e50cad90, user_id=f4dc1824197d40e58d0dfdc8f55ab72d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.135741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.137865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:09.154124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed37746-ed1f-4ce1-8f19-0cc70e45e32d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.165049 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2300/4631] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:09 2022] PUT /identity/v3/projects/80974eba622d4830886ec598e50cad90/users/f4dc1824197d40e58d0dfdc8f55ab72d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:09.173548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.192614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.265266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:09.313558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df26ab-d1ae-489c-9282-741c745f5fe5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.313834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.314557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.314909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.315249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.316007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:09.316383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.318094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701030-5bb6-4562-8cfc-3a961207b46e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.322220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.323289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.324004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.324477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] PATH_INFO: `/v3/projects/4fba2995e0924f539322ae48db3149b7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.326287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fba2995e0924f539322ae48db3149b7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.329946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.347409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2332/4632] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:09.348659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe81b-571a-4f5d-8b68-4cb7887ea520 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.348970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe81b-571a-4f5d-8b68-4cb7887ea520 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.349251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe81b-571a-4f5d-8b68-4cb7887ea520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.377143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-961fe81b-571a-4f5d-8b68-4cb7887ea520 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:09.378449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-961fe81b-571a-4f5d-8b68-4cb7887ea520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.402250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fba2995e0924f539322ae48db3149b7', 'request_id': 'req-83800060-5477-4ec2-a529-d7e12382bcd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:09.412583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fba2995e0924f539322ae48db3149b7', 'request_id': 'req-83800060-5477-4ec2-a529-d7e12382bcd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:09.424837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fba2995e0924f539322ae48db3149b7', 'request_id': 'req-83800060-5477-4ec2-a529-d7e12382bcd6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:09.441236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] The token cache is being invalidate because project 4fba2995e0924f539322ae48db3149b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:09.441667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:09.442644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:09.444609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2301/4633] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:09 2022] DELETE /identity/v3/projects/4fba2995e0924f539322ae48db3149b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:09.445592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.449279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.524670 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2333/4634] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:09.526025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.526313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.526588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.574774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:09.577729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.613889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2334/4635] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:09.615477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.616604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.623085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83800060-5477-4ec2-a529-d7e12382bcd6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.647119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.648034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.648422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.648808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.649605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.655071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0016ef2-4f29-47d6-a69f-ad6bc84439a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.698486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d328-5e6b-4178-82cb-8e8e7e5f575e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.703937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.704961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.705326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.706049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.725696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.727657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2302/4636] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:09.729403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.729621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.731455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.735037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.755630 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2335/4637] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:09.756353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.770556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31244891-d501-468b-ae2f-7398cd419812 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.774254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:09.777686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:09.864879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:09.887493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:09.912301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.913324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.913767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.914205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.915102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.917513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.928327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2303/4638] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:09.933261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.947964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2336/4639] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:09.952014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.952811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6e992-c74d-4dd2-9035-fbd66ae7dd3a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.958291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.959231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.959655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.960121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.960973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:09.961639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.963568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.977822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0683c0-633e-4a75-8d71-6f6bfc37edff admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:09.981455 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2304/4640] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:09.984751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:09.993880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:09.994678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:09.995059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:09.995428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:09.996177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:09.997944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:09.998794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25009-6865-4c10-9ca3-14f5438c7095 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.004987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.022094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.023344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.024052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2337/4641] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:09:10.024645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.026160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.029788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.036355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.050303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55616e-c8d8-43d9-bd2f-205fc44e40a5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.066754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.067528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.067925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.068296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.069071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.070790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.096628 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2338/4642] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:10.099185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2305/4643] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:09 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:10.100348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.103906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.120956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf5f-30c2-483b-95cb-35fdd9a7a321 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.230117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb500e47-3a8b-48c5-b9ab-92a7809424e6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.232895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.233664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.233944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.234213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] PATH_INFO: `/v3/projects/aa7fa104de19468db83f1cc8cbcdab7e/users/c70d9fc0c15c4c15a5189c5cac4fead7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.237480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.238367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.239811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.240285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.241302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.243463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.258049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7fa104de19468db83f1cc8cbcdab7e, user_id=c70d9fc0c15c4c15a5189c5cac4fead7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.261740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc53b-882c-4457-bee6-619b6bdc777e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.272555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2306/4644] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:10 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:10.276975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.289415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2339/4645] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:10 2022] PUT /identity/v3/projects/aa7fa104de19468db83f1cc8cbcdab7e/users/c70d9fc0c15c4c15a5189c5cac4fead7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:10.289922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89e3bd-aee0-43b2-b406-e9678fee6fcf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.380493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.381528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.382018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.401795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.402438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.403555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.403809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.407445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.411126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.433799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:10.434863 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2307/4646] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:10.436936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:10.438831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.458479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602ef76-c707-4450-9f95-bbec3a03deca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.471731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.473787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.474301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.475418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.477740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.484408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.513369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2308/4647] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:09:10.517240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.541416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb32-5efc-499e-a76d-ebeed52967ba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.552277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.555065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.568803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.569357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] PATH_INFO: `/v3/projects/f81fd8c19a3c4cbbaa1be0854ec623dd/users/313eab842ed7455f821148b26e0bce25/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.613582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81fd8c19a3c4cbbaa1be0854ec623dd, user_id=313eab842ed7455f821148b26e0bce25, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.620727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd29b-6d88-444e-9704-8638302ac3de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.626053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2340/4648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:10.630966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.641254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:10.655302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25880c-b4c3-419a-818d-70c36ca8d211 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.658173 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2309/4649] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:10 2022] PUT /identity/v3/projects/f81fd8c19a3c4cbbaa1be0854ec623dd/users/313eab842ed7455f821148b26e0bce25/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:10.669349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.669732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.669926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.684619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:10.743135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] MFA Rules not processed for user `313eab842ed7455f821148b26e0bce25`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:10.745619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:10.796481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.797397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.797568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.797845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.894421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:10.896227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2310/4650] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:10.909403 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2341/4651] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:10 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:10.909681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.913049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:11.021458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753b03-02d3-4872-a4be-e3e9fc0425b3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:11.026179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:11.027393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.027740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.028135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:11.046407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:11.047988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0af015-8cdb-44ac-bac3-b75706d78d4f service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:11.072582 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2311/4652] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:11.086276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:11.209776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841c6e4-b560-4aad-9e45-cd4ed80563a3 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:11.222873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:11.222873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.222873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.223173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] PATH_INFO: `/v3/users/313eab842ed7455f821148b26e0bce25` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:11.225837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=313eab842ed7455f821148b26e0bce25)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:11.227409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:11.330736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313eab842ed7455f821148b26e0bce25'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:11.331776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313eab842ed7455f821148b26e0bce25'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:11.349513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313eab842ed7455f821148b26e0bce25'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:11.359537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313eab842ed7455f821148b26e0bce25'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:11.360854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313eab842ed7455f821148b26e0bce25'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:11.417255 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2342/4653] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:11 2022] DELETE /identity/v3/users/313eab842ed7455f821148b26e0bce25 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:11.422895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c85b-c5a8-44bf-b760-9b605ea7ef75 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.423205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c85b-c5a8-44bf-b760-9b605ea7ef75 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.423441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c85b-c5a8-44bf-b760-9b605ea7ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:11.473082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-18c6c85b-c5a8-44bf-b760-9b605ea7ef75 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:11.474325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-18c6c85b-c5a8-44bf-b760-9b605ea7ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:11.616285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2312/4654] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:11.656851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:11.661021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:11.682335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:11.797532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c1b0-bf4a-490b-b575-c5734315ee7f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:11.802874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:11.803707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.804180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.804549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:11.823967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:11.825621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77f9ce-516c-4d65-aae4-2ae0b9a854f6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:11.853456 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2343/4655] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:11.914845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.915416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.915416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:11.947134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:11.949326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:11.965379 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2313/4656] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:11.967604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:11.967893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:11.968166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:12.014574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:12.016583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:12.239485 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2344/4657] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:12.243623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:12.262818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c012841-4622-462f-b8e8-b99cce2928d7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:12.279481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:12.280192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:12.280478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:12.280757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:12.379976 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 28 10:09:12.381067 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:12.381940 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2314/4658] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:12 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 188 bytes in 138 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:09:12.387310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:12.398626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954d50-b401-4f8d-aae1-103bd08eb429 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:12.409456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9019143-2ec6-4b43-9124-39c5d396a68b tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:12.410129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019143-2ec6-4b43-9124-39c5d396a68b tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:12.410405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019143-2ec6-4b43-9124-39c5d396a68b tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:12.410677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019143-2ec6-4b43-9124-39c5d396a68b tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-f9019143-2ec6-4b43-9124-39c5d396a68b tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:12.488689 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 28 10:09:12.489655 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:09:12.491598 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2345/4659] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:12 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 188 bytes in 105 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:09:12.495868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:12.502935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:12.517650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27721007-c35e-4269-af85-f39969dfb923 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:12.528828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:12.530654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:12.530654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:12.530654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:12.621515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:12.657749 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2315/4660] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:12 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:13.063551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.064444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.064444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.108332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] MFA Rules not processed for user `f60ed4d46390452eba5a3948941beaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:13.109935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.278140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2346/4661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:13.287369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:13.290408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.419268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:13.421228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.458512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d76b-7acb-4788-9363-7c3c37e17581 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:13.459702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4748-7146-404d-b5b0-f77e8ceca1b0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:13.471432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:13.473511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.476794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.478380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.482548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.486669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:13.489941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.494454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.494776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] PATH_INFO: `/v3/projects/f81fd8c19a3c4cbbaa1be0854ec623dd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.496076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81fd8c19a3c4cbbaa1be0854ec623dd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:13.506757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:13.616006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:13.656862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:13.674998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079fcb-a7ec-49b9-ac10-eff55fdc0390 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:13.691486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81fd8c19a3c4cbbaa1be0854ec623dd', 'request_id': 'req-7aeb59db-5557-47a8-948d-bd191f164f73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:13.709083 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2316/4662] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:13.712107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c1df-41d3-421f-a101-7d34a96b0704 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.712442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c1df-41d3-421f-a101-7d34a96b0704 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.712656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c1df-41d3-421f-a101-7d34a96b0704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.716927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81fd8c19a3c4cbbaa1be0854ec623dd', 'request_id': 'req-7aeb59db-5557-47a8-948d-bd191f164f73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:13.745037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81fd8c19a3c4cbbaa1be0854ec623dd', 'request_id': 'req-7aeb59db-5557-47a8-948d-bd191f164f73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:13.768837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] The token cache is being invalidate because project f81fd8c19a3c4cbbaa1be0854ec623dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:13.769156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:13.769828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7aeb59db-5557-47a8-948d-bd191f164f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:13.771479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2347/4663] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:13 2022] DELETE /identity/v3/projects/f81fd8c19a3c4cbbaa1be0854ec623dd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:13.776418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9519ae-427a-466e-99c4-eb772424c2f0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.776696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9519ae-427a-466e-99c4-eb772424c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.777003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9519ae-427a-466e-99c4-eb772424c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.805310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8c07c1df-41d3-421f-a101-7d34a96b0704 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:13.807596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c07c1df-41d3-421f-a101-7d34a96b0704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.830502 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2317/4664] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:13 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:13.831999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3e9519ae-427a-466e-99c4-eb772424c2f0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:13.833434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e9519ae-427a-466e-99c4-eb772424c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.834123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:13.834798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:13.835219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:13.866021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:13.867605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:13.993561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2318/4665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:13.999189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.015271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2348/4666] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:14.017648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2d85-fac6-4adf-acb2-d28679708398 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.024263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59759-f881-454e-839e-c245bad1050b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.024548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59759-f881-454e-839e-c245bad1050b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.024818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59759-f881-454e-839e-c245bad1050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.027535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.028368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.028919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.029534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.082031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8fa59759-f881-454e-839e-c245bad1050b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:14.084204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:14.084773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8fa59759-f881-454e-839e-c245bad1050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:14.131808 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2349/4667] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:14.137947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59759-f881-454e-839e-c245bad1050b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.169408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:14.173381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59759-f881-454e-839e-c245bad1050b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.196450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.196861 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2319/4668] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:13 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:14.197129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.197416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.197684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.205483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:14.205833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.207461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.250364 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2350/4669] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:14.255480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.273489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca30446-e8cf-471e-ba5a-625ca723e450 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.296350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.297059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.297344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.297617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.298267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.300546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.370795 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2320/4670] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:14 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:14.376045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.399726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f317a-7806-4cd9-88df-751d31089d2a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.562915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.563941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.564223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.564490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.565149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.567084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.614217 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2351/4671] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:14 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:14.619097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.640487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790fed2-fc7e-4c82-b356-d9a0327acdbb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.665651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.666508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.666794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.667842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.671039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.671039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.699577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2321/4672] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:14.699804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.715225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb38fd7-029b-4601-af5f-563cf7de740b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.726254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.729843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.730122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.730401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.731290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.738733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adfe61-154d-44d8-9578-1f53cefb4916 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.763487 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2352/4673] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:14.764842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:14.778943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612269-fde6-4c99-940d-2d257b9a4daa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:14.796247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:14.797845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.798149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.798993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] PATH_INFO: `/v3/projects/ed7d4db5adf848c182fcd84e40f8c18f/users/7d5f4105310841a788557bf7cc57aca2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.848786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7d4db5adf848c182fcd84e40f8c18f, user_id=7d5f4105310841a788557bf7cc57aca2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:14.856671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d01caf-f108-4610-9f88-ef57d187ca1b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:14.890409 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2322/4674] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:14 2022] PUT /identity/v3/projects/ed7d4db5adf848c182fcd84e40f8c18f/users/7d5f4105310841a788557bf7cc57aca2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:14.903308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:14.904139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:14.904635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:14.927607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:14.977216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] MFA Rules not processed for user `7d5f4105310841a788557bf7cc57aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:14.978567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:15.198512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e2f8-e610-4cab-acc5-fd7fe1fe4ec5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:15.198807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e2f8-e610-4cab-acc5-fd7fe1fe4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:15.199088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e2f8-e610-4cab-acc5-fd7fe1fe4ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:15.272425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1e82e2f8-e610-4cab-acc5-fd7fe1fe4ec5 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:15.280481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e82e2f8-e610-4cab-acc5-fd7fe1fe4ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:15.296731 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2323/4675] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:15 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:15.299539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:15.300020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:15.300533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:15.329660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2353/4676] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:15.362872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:15.369806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:15.391803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:15.392860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:15.524512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81de0c-08b3-40ca-bcf7-d5c799782496 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:15.530738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:15.531533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:15.532173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:15.532839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:15.556797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:15.578172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:15.610517 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2324/4677] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:15.611484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:15.650613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed0ee-6758-42ec-a36c-003d43dc5950 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:15.663030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2354/4678] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:15.710030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31f1a-7b72-49a6-99f4-ffc7564cf7c6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:15.710516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:15.710720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31f1a-7b72-49a6-99f4-ffc7564cf7c6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:15.711001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31f1a-7b72-49a6-99f4-ffc7564cf7c6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:15.721526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31f1a-7b72-49a6-99f4-ffc7564cf7c6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:15.930792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cc31f1a-7b72-49a6-99f4-ffc7564cf7c6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:15.964053 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2325/4679] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:15 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:15.973207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa5f8-daab-4304-8e41-3855b72b5e41 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:15.978621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:15.979627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:15.980398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:15.980398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] PATH_INFO: `/v3/users/7d5f4105310841a788557bf7cc57aca2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:15.984590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5f4105310841a788557bf7cc57aca2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:15.984590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:16.111625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:16.137243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5f4105310841a788557bf7cc57aca2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:16.138035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5f4105310841a788557bf7cc57aca2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:16.152164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5f4105310841a788557bf7cc57aca2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:16.174088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5f4105310841a788557bf7cc57aca2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:16.175507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5f4105310841a788557bf7cc57aca2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:16.205754 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2355/4680] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:15 2022] DELETE /identity/v3/users/7d5f4105310841a788557bf7cc57aca2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:16.211176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8a3d9-a5ea-4ecc-ad55-cd99e17226c9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:16.211601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8a3d9-a5ea-4ecc-ad55-cd99e17226c9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:16.211895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8a3d9-a5ea-4ecc-ad55-cd99e17226c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:16.260119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0ba8a3d9-a5ea-4ecc-ad55-cd99e17226c9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:16.262288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0ba8a3d9-a5ea-4ecc-ad55-cd99e17226c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:16.415955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:16.432637 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2326/4681] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:16.483530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:16.485321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:16.587823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15afd4-f959-473b-9ee2-3d769a15a0ef admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:16.592879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:16.596113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:16.596518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:16.596938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:16.614789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:16.616597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037065-fe11-424f-af02-6b1fc6b6df90 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:16.633199 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2356/4682] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:16.970037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:16.970336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:16.971404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:17.031083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:17.036200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:17.045249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2327/4683] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:17.050711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8e5-1214-4197-a846-87191d787879 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:17.051505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8e5-1214-4197-a846-87191d787879 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:17.052886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8e5-1214-4197-a846-87191d787879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:17.116287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1031b8e5-1214-4197-a846-87191d787879 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:17.118896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1031b8e5-1214-4197-a846-87191d787879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:17.178219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:17.180512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:17.294082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2357/4684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:17.303369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b8e5-1214-4197-a846-87191d787879 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:17.318839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b8e5-1214-4197-a846-87191d787879 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:17.326319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ff3f-c68d-4ffe-8df4-f455280fdda6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:17.326982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff3f-c68d-4ffe-8df4-f455280fdda6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:17.327263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff3f-c68d-4ffe-8df4-f455280fdda6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:17.327538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff3f-c68d-4ffe-8df4-f455280fdda6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:17.444954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20b1ff3f-c68d-4ffe-8df4-f455280fdda6 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:17.461592 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2358/4685] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:17 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:17.486355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0a003-deff-46bf-899e-69f0afa7eb2e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:17.509338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:17.509983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:17.510259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:17.510526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:17.519431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:17.571724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:17.577026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9940c10-0acb-4d43-b49d-f61f44d9844c service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:17.629092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2328/4686] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:18.055752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:18.056330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:18.056330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:18.123875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] MFA Rules not processed for user `05b11268812b415bbe36c1980bea37b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:18.123875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:18.191194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:18.288499 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2359/4687] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:18.467015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113320a-6e2d-4987-8f59-6f690e010d42 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:18.467517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113320a-6e2d-4987-8f59-6f690e010d42 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:18.467896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113320a-6e2d-4987-8f59-6f690e010d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:18.524540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3113320a-6e2d-4987-8f59-6f690e010d42 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:18.528132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3113320a-6e2d-4987-8f59-6f690e010d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:18.547223 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2329/4688] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:18.574366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:18.575747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:18.604260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fba3a1-b08a-48d5-89f2-eeea9683f20e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:18.618173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:18.619630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:18.622086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:18.622417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] PATH_INFO: `/v3/projects/ed7d4db5adf848c182fcd84e40f8c18f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:18.625810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7d4db5adf848c182fcd84e40f8c18f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:18.633336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:18.836118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7d4db5adf848c182fcd84e40f8c18f', 'request_id': 'req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:18.869705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7d4db5adf848c182fcd84e40f8c18f', 'request_id': 'req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:18.903182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7d4db5adf848c182fcd84e40f8c18f', 'request_id': 'req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:18.928196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] The token cache is being invalidate because project ed7d4db5adf848c182fcd84e40f8c18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:18.928358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:18.933347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c7cd8714-b1ab-43d4-9abc-ee64b0b04436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:18.935538 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2360/4689] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:18 2022] DELETE /identity/v3/projects/ed7d4db5adf848c182fcd84e40f8c18f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:18.941040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:18.941643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:18.942119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.001715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:19.004070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:19.224794 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2330/4690] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:19.233715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.234948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.235386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.296828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:19.302233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:19.332174 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2361/4691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:19.336779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:19.351518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc7c68-6352-4631-87d4-714d5ac1867b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:19.363953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:19.365750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.367137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.368047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.369333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:19.370352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:19.380829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:19.406197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2331/4692] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:19.407339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:19.422329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa5b3b-82e9-4f24-a9f7-ee96409d958b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:19.429176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:19.430586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.431145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.431669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.432521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:19.434940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04079f6-6a70-40b9-a6c0-aa2d6db3cbdd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:19.500034 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2362/4693] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:19.504567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:19.519978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b73cd4-5b7d-41ae-97c0-9dfe33df2d40 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:19.553127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130d46-7b7e-4c4a-82b3-c2848bab8bef None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.553586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130d46-7b7e-4c4a-82b3-c2848bab8bef None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.553969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce130d46-7b7e-4c4a-82b3-c2848bab8bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.614781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ce130d46-7b7e-4c4a-82b3-c2848bab8bef None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:19.616377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ce130d46-7b7e-4c4a-82b3-c2848bab8bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:19.701968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:19.729598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:19.730240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.730525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.730800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.731474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:19.740861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:19.764873 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2363/4694] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:19.773655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c090-b96d-479c-9827-d7c8829156e4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.773944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c090-b96d-479c-9827-d7c8829156e4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.774228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c090-b96d-479c-9827-d7c8829156e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.805117 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2332/4695] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:19.811588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:19.835172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1ef0c090-b96d-479c-9827-d7c8829156e4 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:19.836406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ef0c090-b96d-479c-9827-d7c8829156e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:19.848603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8992-5b7a-42b5-97b6-0cca17eec529 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:19.852707 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2364/4696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 10:09:19.857087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598680-7071-4fba-98eb-31963a95cda9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.857372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598680-7071-4fba-98eb-31963a95cda9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.864064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598680-7071-4fba-98eb-31963a95cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.869409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:19.870717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.871225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.871954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.874182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:19.878643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:19.914311 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2333/4697] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:19.916520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:19.940060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2ad2-f9f2-4e78-86ed-1b880bf7230f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:19.957899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:19.960274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:19.960723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:19.961295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:19.965024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:19.969726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:19.972471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:20.000986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2334/4698] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:20.002510 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.application [None req-00598680-7071-4fba-98eb-31963a95cda9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:09:20.007017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2365/4699] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 149 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:09:20.007200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:20.008882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed2ab-74a6-4476-9959-e12f06c962c4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:20.009197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed2ab-74a6-4476-9959-e12f06c962c4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:20.009476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eed2ab-74a6-4476-9959-e12f06c962c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:20.055084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0894f3-ea1d-4742-aecd-47fcfc9c9441 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:20.069829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:20.070534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:20.070816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:20.071440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] PATH_INFO: `/v3/projects/475c071e24ad4d36a509710b064bc30d/users/46b718bf848b48e3a5d784b8658b1c24/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:20.108266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475c071e24ad4d36a509710b064bc30d, user_id=46b718bf848b48e3a5d784b8658b1c24, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:20.111104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9508048-a22c-4c8e-847a-c942ac0691d2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:20.134278 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.application [None req-52eed2ab-74a6-4476-9959-e12f06c962c4 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:09:20.144029 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2335/4700] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:20 2022] PUT /identity/v3/projects/475c071e24ad4d36a509710b064bc30d/users/46b718bf848b48e3a5d784b8658b1c24/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:20.145383 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2366/4701] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 137 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:09:20.154906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:20.155236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:20.155463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:20.277391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f0dc-524b-46be-8706-9c92b17173b8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:20.277951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f0dc-524b-46be-8706-9c92b17173b8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:20.277951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f0dc-524b-46be-8706-9c92b17173b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:20.305175 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.server.flask.application [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:09:20.308431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2336/4702] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 162 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:09:20.380940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad55f0dc-524b-46be-8706-9c92b17173b8 None None] MFA Rules not processed for user `46b718bf848b48e3a5d784b8658b1c24`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:20.385620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad55f0dc-524b-46be-8706-9c92b17173b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:20.598101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2367/4703] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:20.610070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:20.611905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:20.786167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fb330-bdfa-42dd-bea4-99bbd5a6b5fc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:20.796200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:20.796852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:20.797406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:20.797686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:20.826482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:20.828617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e1452-acd8-4edd-ae9a-eb7701b14c20 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:20.861279 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2337/4704] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:21.620333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:21.621406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:21.622867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:21.717575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] MFA Rules not processed for user `f4dc1824197d40e58d0dfdc8f55ab72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:21.723641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:21.921847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2368/4705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:21.922954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a29ec-c9cd-4d59-ae98-7bbb639ab8bf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:21.923410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a29ec-c9cd-4d59-ae98-7bbb639ab8bf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:21.923506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a29ec-c9cd-4d59-ae98-7bbb639ab8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:21.961153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ea1a29ec-c9cd-4d59-ae98-7bbb639ab8bf None None] MFA Rules not processed for user `f4dc1824197d40e58d0dfdc8f55ab72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:21.962385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ea1a29ec-c9cd-4d59-ae98-7bbb639ab8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:21.986744 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2338/4706] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:09:21.992332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:21.994601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:22.072335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:22.102847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aff815-f9b3-480f-aed0-95d97f8c7033 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:22.111146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:22.112745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:22.113162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:22.113473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:22.126235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:22.128170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:22.142960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2369/4707] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:22.367151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26990e-5725-45d8-8831-c96820565f8a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:22.367683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26990e-5725-45d8-8831-c96820565f8a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:22.368188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26990e-5725-45d8-8831-c96820565f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:22.471126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bc26990e-5725-45d8-8831-c96820565f8a None None] MFA Rules not processed for user `8ebcf3f5f6914d0bb0511b8844198d51`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:22.472556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc26990e-5725-45d8-8831-c96820565f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:22.647345 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2339/4708] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:22.669512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:22.677371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:22.716520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58e08-12c4-43da-b7d9-19b4ab934da6 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:22.732219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:22.732846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:22.733163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:22.733435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:22.752401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:22.753542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5364c8-4dcd-4194-a1ff-464643734fab service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:22.770759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2370/4709] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:23.511595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:23.512443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:23.512938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:23.542903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] MFA Rules not processed for user `f4dc1824197d40e58d0dfdc8f55ab72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:23.545112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:23.573635 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2340/4710] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:31.319700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07f6a-d87d-48bb-8ccd-fad8c3e90b3e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:31.320241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07f6a-d87d-48bb-8ccd-fad8c3e90b3e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:31.320241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb07f6a-d87d-48bb-8ccd-fad8c3e90b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:31.457465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0bb07f6a-d87d-48bb-8ccd-fad8c3e90b3e None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:31.461254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0bb07f6a-d87d-48bb-8ccd-fad8c3e90b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:31.476437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2371/4711] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:31.478027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:31.483784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:31.651161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18cdcc-c322-44ed-a692-517570d37765 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:31.657215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8349140-6a0e-4f1f-b4f5-820a4be51c80 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:31.658352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349140-6a0e-4f1f-b4f5-820a4be51c80 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:31.658861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349140-6a0e-4f1f-b4f5-820a4be51c80 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:31.659351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349140-6a0e-4f1f-b4f5-820a4be51c80 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:31.732412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8349140-6a0e-4f1f-b4f5-820a4be51c80 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:31.769165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2341/4712] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:31 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:32.781293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03689-d42c-4a09-a437-a0a751f3b964 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:32.782458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03689-d42c-4a09-a437-a0a751f3b964 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:32.782891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03689-d42c-4a09-a437-a0a751f3b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:32.828345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4ed03689-d42c-4a09-a437-a0a751f3b964 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:32.830190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4ed03689-d42c-4a09-a437-a0a751f3b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:32.840137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce014b3-d8f7-4870-afcc-ccc37bbafe78 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:32.841629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce014b3-d8f7-4870-afcc-ccc37bbafe78 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:32.842273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce014b3-d8f7-4870-afcc-ccc37bbafe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:32.852422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2372/4713] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-0ce014b3-d8f7-4870-afcc-ccc37bbafe78 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 28 10:09:32.937319 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:32.938654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:09:32.939602 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:09:32.942228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2342/4714] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:32 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:09:32.951512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:32.952038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:32.952472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:33.090454 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.application [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:09:33.096052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2373/4715] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:32 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 149 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:09:33.097976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f380-f262-4350-af74-0b92cc0b2952 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:33.098634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f380-f262-4350-af74-0b92cc0b2952 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:33.099008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f380-f262-4350-af74-0b92cc0b2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:33.188614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1361f380-f262-4350-af74-0b92cc0b2952 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:33.190158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1361f380-f262-4350-af74-0b92cc0b2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:33.214116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2343/4716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:33.218581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:33.242650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d377e9d-84d6-4644-94a4-94e052649306 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:33.253631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab446774-6dca-4bdf-9493-c6acbeff9bbd tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:33.256167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446774-6dca-4bdf-9493-c6acbeff9bbd tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:33.257488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446774-6dca-4bdf-9493-c6acbeff9bbd tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:33.258589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446774-6dca-4bdf-9493-c6acbeff9bbd tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:33.376291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab446774-6dca-4bdf-9493-c6acbeff9bbd tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:33.393205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2374/4717] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:33 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:34.397928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:34.398490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:34.398490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:34.441842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:34.451655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:34.467406 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2344/4718] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:34.469661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132095-99bc-4005-bdec-3e8240584436 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:34.470137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132095-99bc-4005-bdec-3e8240584436 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:34.470214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132095-99bc-4005-bdec-3e8240584436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:34.538421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c6132095-99bc-4005-bdec-3e8240584436 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:34.542474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c6132095-99bc-4005-bdec-3e8240584436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:34.572939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2375/4719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:34.575460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:34.591521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1344e9f-8363-4386-bd1e-49f7c0ff6897 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:34.603903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9aeda-c6a2-44fe-a1b9-992f0e6121f5 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:34.605343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9aeda-c6a2-44fe-a1b9-992f0e6121f5 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:34.607400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9aeda-c6a2-44fe-a1b9-992f0e6121f5 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:34.608173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9aeda-c6a2-44fe-a1b9-992f0e6121f5 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:34.706883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af9aeda-c6a2-44fe-a1b9-992f0e6121f5 tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:34.737682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2345/4720] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:34 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:35.743449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:35.744034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:35.744034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:35.782963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:35.788952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:35.812450 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2376/4721] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:35.814729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecbfb-42f7-44c8-94b4-0d83bb98c978 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:35.815576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecbfb-42f7-44c8-94b4-0d83bb98c978 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:35.816018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecbfb-42f7-44c8-94b4-0d83bb98c978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:35.876268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d7fecbfb-42f7-44c8-94b4-0d83bb98c978 None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:35.877762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d7fecbfb-42f7-44c8-94b4-0d83bb98c978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:35.895080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2346/4722] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:35.898514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:35.922299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89402c6-1331-4ead-9539-7051b2b910de None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:35.943674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70d9fc0c15c4c15a5189c5cac4fead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa7fa104de19468db83f1cc8cbcdab7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:35.946000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:35.948784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:35.949159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:36.138000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:36.182108 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2377/4723] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:09:35 2022] POST /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7/password => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:37.193593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbed-6268-4923-8543-773570e1f1ea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:37.194766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbed-6268-4923-8543-773570e1f1ea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:37.195260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbed-6268-4923-8543-773570e1f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:37.258471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-947dfbed-6268-4923-8543-773570e1f1ea None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:37.259699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-947dfbed-6268-4923-8543-773570e1f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:37.274755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2347/4724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:37.442831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:37.445393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:37.549836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775dbe7-695e-48ef-b1c3-0e20c6050f5d tempest-IdentityV3UsersTest-1601132746 tempest-IdentityV3UsersTest-1601132746-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:37.554139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:37.555057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:37.555545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:37.555997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:37.558565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:37.578798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:37.690898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:37.692438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:37.722478 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2378/4725] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:38.288671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e983-ef58-40ce-8c43-b5d9bd0817ed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:38.288671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e983-ef58-40ce-8c43-b5d9bd0817ed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:38.288671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e983-ef58-40ce-8c43-b5d9bd0817ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:38.322405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8475e983-ef58-40ce-8c43-b5d9bd0817ed None None] MFA Rules not processed for user `c70d9fc0c15c4c15a5189c5cac4fead7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:38.324477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8475e983-ef58-40ce-8c43-b5d9bd0817ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:38.347997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2348/4726] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:38.350320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:38.353382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:38.373210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2940-de39-432d-a3ce-b9a2383de332 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:38.392775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:38.393815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:38.394308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:38.394779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] PATH_INFO: `/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:38.397852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70d9fc0c15c4c15a5189c5cac4fead7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:38.400527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:38.639290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:38.641179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:38.655643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:38.679443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:38.681356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70d9fc0c15c4c15a5189c5cac4fead7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:38.727566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2379/4727] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:38 2022] DELETE /identity/v3/users/c70d9fc0c15c4c15a5189c5cac4fead7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:38.734073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:38.734411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:38.734797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:38.777936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:38.779380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:38.912237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:38.957452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2349/4728] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:38.991207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:38.993511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.090026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ff95-817d-407b-b546-4e6f5eeb352b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:39.095147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:39.095954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:39.096382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:39.096948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:39.110224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:39.112403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c0a3-d30f-43f0-aa50-238d7f31bf31 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:39.127920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2380/4729] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:39.323073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:39.325595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.344503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4f92-4a29-4277-9ad7-aa5323e7bee9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:39.371262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:39.372220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:39.372652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:39.373231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] PATH_INFO: `/v3/users/46b718bf848b48e3a5d784b8658b1c24` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:39.374611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b718bf848b48e3a5d784b8658b1c24)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:39.376731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:39.471311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b718bf848b48e3a5d784b8658b1c24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.472306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b718bf848b48e3a5d784b8658b1c24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.473161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b718bf848b48e3a5d784b8658b1c24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.484671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b718bf848b48e3a5d784b8658b1c24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.499503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b718bf848b48e3a5d784b8658b1c24'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.528591 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2350/4730] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:39 2022] DELETE /identity/v3/users/46b718bf848b48e3a5d784b8658b1c24 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:39.530860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:39.531116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:39.531392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:39.570321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:39.571930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.605937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:39.607366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.638295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:39.732976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a75ca-e0ec-40d5-a091-14faac68945d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:39.747361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:39.748350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:39.748774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:39.749228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] PATH_INFO: `/v3/users/8ebcf3f5f6914d0bb0511b8844198d51` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:39.752443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebcf3f5f6914d0bb0511b8844198d51)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:39.758145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2381/4731] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:39.759138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:39.768140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:39.769829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.823186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebcf3f5f6914d0bb0511b8844198d51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.824302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebcf3f5f6914d0bb0511b8844198d51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.825581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebcf3f5f6914d0bb0511b8844198d51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.836215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebcf3f5f6914d0bb0511b8844198d51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.863431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebcf3f5f6914d0bb0511b8844198d51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:39.877927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:39.881252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad032a0-4b88-4d7d-9401-988c9d39b745 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:39.892682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:39.893810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:39.895509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:39.895992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:39.900604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:39.905249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2351/4732] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:39 2022] DELETE /identity/v3/users/8ebcf3f5f6914d0bb0511b8844198d51 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:39.932779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:39.934593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:39.952757 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2382/4733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:40.689368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:40.692658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:40.696348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:40.699248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:40.729980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effd87-02ad-4791-af46-087f23fdf8ff service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:40.912587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:40.913432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:40.913715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:40.913990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] PATH_INFO: `/v3/projects/e5d457e3c222434cafad30e44c02a42a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:40.915413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d457e3c222434cafad30e44c02a42a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:40.917389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:40.925323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018fcb0-206d-4ab2-9e89-c38d29c23466 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:40.931753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:40.932686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:40.933327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:40.933820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] PATH_INFO: `/v3/projects/aa7fa104de19468db83f1cc8cbcdab7e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:40.935984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7fa104de19468db83f1cc8cbcdab7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:40.938692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.007073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d457e3c222434cafad30e44c02a42a', 'request_id': 'req-7faf842d-324c-4b2b-ab43-e08daffc1612'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.014826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d457e3c222434cafad30e44c02a42a', 'request_id': 'req-7faf842d-324c-4b2b-ab43-e08daffc1612'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.024837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d457e3c222434cafad30e44c02a42a', 'request_id': 'req-7faf842d-324c-4b2b-ab43-e08daffc1612'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.032128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7fa104de19468db83f1cc8cbcdab7e', 'request_id': 'req-70119663-d2e7-40fc-9b1c-e6517a94d771'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.036011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:41.043058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] The token cache is being invalidate because project e5d457e3c222434cafad30e44c02a42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:41.044233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.044491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7fa104de19468db83f1cc8cbcdab7e', 'request_id': 'req-70119663-d2e7-40fc-9b1c-e6517a94d771'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.045637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7faf842d-324c-4b2b-ab43-e08daffc1612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.053001 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2383/4734] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:40 2022] DELETE /identity/v3/projects/e5d457e3c222434cafad30e44c02a42a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:41.057387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7447-3070-418b-8c7c-efe6b60c0db8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.057903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7447-3070-418b-8c7c-efe6b60c0db8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.060249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7447-3070-418b-8c7c-efe6b60c0db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.073837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7fa104de19468db83f1cc8cbcdab7e', 'request_id': 'req-70119663-d2e7-40fc-9b1c-e6517a94d771'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.109690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] The token cache is being invalidate because project aa7fa104de19468db83f1cc8cbcdab7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:41.110052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.110704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70119663-d2e7-40fc-9b1c-e6517a94d771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.120625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2352/4735] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:40 2022] DELETE /identity/v3/projects/aa7fa104de19468db83f1cc8cbcdab7e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:41.123431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.123725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.124007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.132061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5aac7447-3070-418b-8c7c-efe6b60c0db8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.133532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5aac7447-3070-418b-8c7c-efe6b60c0db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.170598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.171828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.266462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2353/4736] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.268633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.273738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.289414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1857a3-fd68-4860-bc67-d0c72da499f5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.293140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2384/4737] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.294891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.295735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.296249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.296626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] PATH_INFO: `/v3/projects/475c071e24ad4d36a509710b064bc30d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.298039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=475c071e24ad4d36a509710b064bc30d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.300222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.300782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870e3-efd3-47f8-86ee-feccdd517091 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.302322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870e3-efd3-47f8-86ee-feccdd517091 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.303378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870e3-efd3-47f8-86ee-feccdd517091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.318812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:41.328475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-68a870e3-efd3-47f8-86ee-feccdd517091 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.330042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68a870e3-efd3-47f8-86ee-feccdd517091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.348823 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2385/4738] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.350531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be922a6-48af-4925-a86d-635b814d913e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.350916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be922a6-48af-4925-a86d-635b814d913e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.351291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be922a6-48af-4925-a86d-635b814d913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.365040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475c071e24ad4d36a509710b064bc30d', 'request_id': 'req-24a095ab-0119-40a5-969b-9f34fe9653ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.375580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475c071e24ad4d36a509710b064bc30d', 'request_id': 'req-24a095ab-0119-40a5-969b-9f34fe9653ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.378749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0be922a6-48af-4925-a86d-635b814d913e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.380367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0be922a6-48af-4925-a86d-635b814d913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.387321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475c071e24ad4d36a509710b064bc30d', 'request_id': 'req-24a095ab-0119-40a5-969b-9f34fe9653ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.406104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] The token cache is being invalidate because project 475c071e24ad4d36a509710b064bc30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:41.406620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.407571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:41.410284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2354/4739] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:41 2022] DELETE /identity/v3/projects/475c071e24ad4d36a509710b064bc30d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:41.411244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.412886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.462521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2386/4740] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.464240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.464695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.464997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.494273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.495859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.505529 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2387/4741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.512388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a095ab-0119-40a5-969b-9f34fe9653ec admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.513825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.517600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.518350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.518728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.519250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.520157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:41.520720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.522602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41ff31-4493-4839-94f8-a45635004e21 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.526146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34db4-7268-4f6b-930b-7b39b7adaed6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.531724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.532536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.533232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.533680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.534488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:41.534973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.536883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.541196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2355/4742] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:41.545038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.545038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.545038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.557671 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2388/4743] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:41.558607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.588616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4ecd-ee01-4ae7-94f2-730e41df1de2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.596983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:41.598913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:41.601678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.603069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.603356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.605064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.612755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2356/4744] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:41.614096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.616209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.621360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.633825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e621-0535-430e-a919-c91660e52792 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.643920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.647684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.648102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.648474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.649263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.652176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.674877 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2389/4745] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:41.674877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.732570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2357/4746] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:41.736725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.783960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:41.803863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897b3b-9c80-46b1-8e1a-4acd2c8fcab3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.832948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922125c3-7bb3-4c64-8921-af721c78916a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.858380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.859176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.859386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.859537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.860365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.862414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.892896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:41.939392 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2358/4747] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:41.940663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:41.947655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.949012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.951345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.953871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.957124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:41.957575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.962555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ed160-e01d-4ca0-b5a3-bae19e7d103e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:41.963786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.979892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:41.986494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:41.986891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:41.987278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:41.988132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:41.990345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:41.996613 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2390/4748] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:41.997837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.016299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43cc83-4c5b-4275-b42d-4cd260a0919d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.017349 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2359/4749] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:41 2022] POST /identity/v3/users => generated 287 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:42.018992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.022608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.023414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.023845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.024306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.025160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.026938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.035470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcd555-28fe-45d3-a051-399836da2ec9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.040867 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2391/4750] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.042031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.047420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.050368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.050785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.051170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.052802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.055895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8605ad-5e7b-42d0-b308-10d1a3e159d7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.061499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.062427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.062849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.063279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.064074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.064274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.066151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.080444 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2392/4751] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.081717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.094523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2e809-4a4a-4421-bd59-6322eaad5966 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.100525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.101382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.101952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.102374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.103342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.105612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.120979 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2393/4752] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.122838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.138262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2360/4753] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:42 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:42.139122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.142787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96923dd-7e32-4f27-8f10-01d63b8bbe50 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.228209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.229600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.229600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.229977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.231885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.234063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.250766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2394/4754] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.250766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.267409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b76a4-c783-4e38-992a-25b401ffc5cd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.275759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.276395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.276682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.277084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.278149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.288353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.298092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1e7d-1d3c-43e7-9e82-b26e6a2acef8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.303790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.304757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.305236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.305673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] PATH_INFO: `/v3/projects/73d03ef8cf94409da575aa14c03511c2/users/1a009402b70744a8bba7843764d3eb41/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.326035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d03ef8cf94409da575aa14c03511c2, user_id=1a009402b70744a8bba7843764d3eb41, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.329628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.346352 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2395/4755] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:42 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:42.346352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.365846 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2361/4756] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:42 2022] PUT /identity/v3/projects/73d03ef8cf94409da575aa14c03511c2/users/1a009402b70744a8bba7843764d3eb41/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:42.366912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.378022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67071c58-8329-49f2-a8dc-eb156b3a9148 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.430492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:42.462797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.463530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.464418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.464418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] PATH_INFO: `/v3/projects/049f7aef45f441358e772bdaf76bdcd9/users/bd44565079024214b972eaa04d77e2fb/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.474344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc502b-14d5-4e96-8729-6e640c755357 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.493048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] RBAC: Authorizing `identity:create_grant(project_id=049f7aef45f441358e772bdaf76bdcd9, user_id=bd44565079024214b972eaa04d77e2fb, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.493048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bde61-5441-4b24-bdef-dabe53f7568d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.496927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.496927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.496927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.497238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.497917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.500139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700307-a832-4b94-85a8-6cb5734cad53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.503845 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2396/4757] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:42 2022] PUT /identity/v3/projects/049f7aef45f441358e772bdaf76bdcd9/users/bd44565079024214b972eaa04d77e2fb/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:42.505511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.505970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.506459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.519984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2362/4758] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.519984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.520528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.520740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.542611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:42.544372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:42.545853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] MFA Rules not processed for user `1a009402b70744a8bba7843764d3eb41`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:42.547227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:42.591531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:42.632118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2397/4759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:42.633649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.655135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2363/4760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:42.656479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.658022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:42.738734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de252-3e1f-43f1-95e8-5b1f2976ed88 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.749538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.750416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.750750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.751020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.751665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.751785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88ef5-f58f-4c46-b9a7-83f9075fe82c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.753353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.756565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.757299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.757654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.758002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.767387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2398/4761] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:42.768618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.775214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.776832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.782246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281626e-88c0-4383-8112-ea7be4b4ce35 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.787063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2364/4762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:42.787988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:42.788764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.789494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.789864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.790191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.802043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c033c8-985b-4fa8-b054-c5c8cbff5455 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:42.803936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.805511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a26f78-4055-41b2-bf0a-d2c7c2eba39d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.818942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2399/4763] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:42.821631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:42.822478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.823115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.823499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] PATH_INFO: `/v3/projects/ca11825073104399a044d8280cbc143b/users/a6e3699c613c4be98dc5563c35555d33/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.850055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11825073104399a044d8280cbc143b, user_id=a6e3699c613c4be98dc5563c35555d33, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:42.855006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:42.874708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2365/4764] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:42 2022] PUT /identity/v3/projects/ca11825073104399a044d8280cbc143b/users/a6e3699c613c4be98dc5563c35555d33/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:42.886280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:42.886737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:42.887222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:42.919945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] MFA Rules not processed for user `a6e3699c613c4be98dc5563c35555d33`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:42.921440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:42.946209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:43.014571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2400/4765] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:43.056229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:43.058444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:43.206031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9335-8eaa-4cc7-904b-91c81bb05562 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:43.210727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:43.211412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:43.211874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:43.212205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:43.226300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:43.228536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66b0c7-9963-46d4-aa08-d421bbca624d service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:43.244554 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2366/4766] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:43.262990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:43.416569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010cc2c-482c-4bb7-b601-718e10098a0f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:43.422852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:43.423980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:43.424496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:43.425007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] PATH_INFO: `/v3/users/a6e3699c613c4be98dc5563c35555d33` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:43.428024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e3699c613c4be98dc5563c35555d33)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:43.430644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:43.511173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e3699c613c4be98dc5563c35555d33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:43.511950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e3699c613c4be98dc5563c35555d33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:43.539770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e3699c613c4be98dc5563c35555d33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:43.555407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e3699c613c4be98dc5563c35555d33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:43.557164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e3699c613c4be98dc5563c35555d33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:43.612355 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2401/4767] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:43 2022] DELETE /identity/v3/users/a6e3699c613c4be98dc5563c35555d33 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:43.616394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:43.617368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:43.618140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:43.663852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:43.666723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:43.772531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:43.786503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2367/4768] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:43.851154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:43.853703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:43.953697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:43.987485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c719bb-8275-4f64-b77d-73cd7e63d908 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:43.992233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:43.993336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:43.993609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:43.993870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.019093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:44.021341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ebae-4922-43f9-b20b-d31fe9ef487d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:44.033173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2402/4769] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:44.479473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:44.490972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:44.509406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312be0e0-cc54-4fe6-833f-3eea91cc1c2c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:44.515976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:44.516654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:44.516982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:44.517257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] PATH_INFO: `/v3/projects/ca11825073104399a044d8280cbc143b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.518532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca11825073104399a044d8280cbc143b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:44.521322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:44.600223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca11825073104399a044d8280cbc143b', 'request_id': 'req-2bb8d492-5a54-4f51-9804-545660d3b4e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:44.611741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca11825073104399a044d8280cbc143b', 'request_id': 'req-2bb8d492-5a54-4f51-9804-545660d3b4e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:44.623637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca11825073104399a044d8280cbc143b', 'request_id': 'req-2bb8d492-5a54-4f51-9804-545660d3b4e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:44.639334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] The token cache is being invalidate because project ca11825073104399a044d8280cbc143b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:44.640029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:44.641280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bb8d492-5a54-4f51-9804-545660d3b4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:44.646657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2368/4770] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:44 2022] DELETE /identity/v3/projects/ca11825073104399a044d8280cbc143b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:44.648591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839167cc-7f06-49af-a380-be369621718f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:44.648984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839167cc-7f06-49af-a380-be369621718f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:44.649335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839167cc-7f06-49af-a380-be369621718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.691297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-839167cc-7f06-49af-a380-be369621718f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:44.692560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-839167cc-7f06-49af-a380-be369621718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:44.801823 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2403/4771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:44.809078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:44.810529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:44.810797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.850870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:44.852307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:44.877588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2369/4772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:44.879486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839167cc-7f06-49af-a380-be369621718f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:44.908871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839167cc-7f06-49af-a380-be369621718f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:44.919288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:44.920409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:44.920936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:44.922500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.925147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:44.925671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:44.927749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:44.950521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2404/4773] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:44.950997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:44.961880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeae71a-18fb-476e-bed4-0315888bc7a5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:44.969095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:44.969821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:44.970222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:44.970592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:44.971384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:44.973581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.021919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2370/4774] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:44 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:45.026722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:45.051784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842eb9-766d-4936-853d-84cbd9fa93ce admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:45.186658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:45.187671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.188186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.188868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.189613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:45.191792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.230575 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2405/4775] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:45 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:45.235860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:45.260550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596b111-1f83-4a45-a361-978137fc9424 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:45.280238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:45.282278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.282565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.282838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.285434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:45.288300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.348794 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2371/4776] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:45.353790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:45.372139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d354-c3bd-42b3-8da6-33f6e8829a5f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:45.392317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:45.393325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.394008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.394398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.396424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:45.398174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5492a-7cc1-4df8-88f9-61b6b75aab13 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.423382 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2406/4777] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:45.425116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:45.439738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c284dd-8ca1-4742-9660-1eddab560ddd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:45.450610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:45.451743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.454021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.454637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] PATH_INFO: `/v3/projects/431aed60d50e42538d478f95eb470abd/users/eceac9adab30466e8eb081c4609eac66/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.475616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431aed60d50e42538d478f95eb470abd, user_id=eceac9adab30466e8eb081c4609eac66, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:45.478821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.501712 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2372/4778] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:45 2022] PUT /identity/v3/projects/431aed60d50e42538d478f95eb470abd/users/eceac9adab30466e8eb081c4609eac66/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:45.507579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.507904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.508896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.532740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:45.534124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:45.611541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:45.666502 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2407/4779] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:45.677212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:45.679365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:45.771164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b82d3-19bf-4cf5-b2f8-8df8d7ec7405 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:45.778665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:45.779269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:45.779629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:45.779966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:45.795623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:45.797735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:45.826190 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2373/4780] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:49.837792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:49.841787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:49.865590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ce30-34aa-4e8e-9e92-e6cecca3fa95 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:49.908838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:49.914666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:49.915278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:49.917298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] PATH_INFO: `/v3/users/90aefa22b02749e8a6b03d16378a0a6c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:49.928368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90aefa22b02749e8a6b03d16378a0a6c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:49.932213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:50.052183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90aefa22b02749e8a6b03d16378a0a6c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:50.057217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90aefa22b02749e8a6b03d16378a0a6c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:50.073652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90aefa22b02749e8a6b03d16378a0a6c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:50.087449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90aefa22b02749e8a6b03d16378a0a6c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:50.090517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9415a443-4e11-4a72-8c16-16fe67521aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90aefa22b02749e8a6b03d16378a0a6c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:50.184490 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2408/4781] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:49 2022] DELETE /identity/v3/users/90aefa22b02749e8a6b03d16378a0a6c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:51.208134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:51.229887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9ea5-5fb0-4e51-9795-67405304ccd5 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:51.287015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:51.392161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:51.392820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:51.393140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:51.393406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] PATH_INFO: `/v3/projects/cd6225eaaa5f4d4db1afcb9c6ffeeb3a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:51.394580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6225eaaa5f4d4db1afcb9c6ffeeb3a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:51.397303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:51.501309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'request_id': 'req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:51.515150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'request_id': 'req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:51.532246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'request_id': 'req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:51.554992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] The token cache is being invalidate because project cd6225eaaa5f4d4db1afcb9c6ffeeb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:51.555786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:51.556761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91d34d1b-5b33-4f0b-9fc0-ff29f48e7f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:51.559215 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2374/4782] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:51 2022] DELETE /identity/v3/projects/cd6225eaaa5f4d4db1afcb9c6ffeeb3a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:51.564314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:51.565375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:51.565705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:51.607052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:51.608586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:51.770531 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2409/4783] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:51.780027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:51.780302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:51.780744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:51.841381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:51.845237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:51.865164 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2375/4784] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:51.869747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:51.888680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56060cf-a553-42fa-a3dd-7938b7054ccf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:51.920481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:51.921205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:51.921484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:51.921749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:51.922411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:51.922709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:51.927185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:51.977046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2410/4785] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:09:51.982102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.008000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80274dbf-ec08-4377-812a-8cefb1f774e8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:52.020467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:52.021702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.022231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.022712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.023601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:52.044564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:52.128744 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2376/4786] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:51 2022] POST /identity/v3/projects => generated 397 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:52.130889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.145509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0b79-e129-4e7f-b2ab-27de39d98532 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:52.298599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:52.323189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:52.324661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.324661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.324890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.325421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:52.327371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:52.371468 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2411/4787] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:52 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:52.376171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.388813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f327a1-271f-4435-9d06-865a0522d78b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:52.394365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:52.395230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.395730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.396186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.397106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:52.399579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:52.421313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2377/4788] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:52.423512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.438688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d8-3215-4f1b-86d5-f9de69848fde admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:52.450197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:52.450838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.451115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.451389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.454141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:52.458715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e672688-042b-43c4-9065-fcc0dc095629 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:52.495462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.501461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2412/4789] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:52.510918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d703-7887-4e6a-99ed-171c490ba1a7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:52.521643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:52.522340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.522623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.522896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] PATH_INFO: `/v3/projects/b9f4721cf3f24aa88d37e97742262ac7/users/e6c8a25f1acc4df29ce6ad74c372b8ef/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.571388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f4721cf3f24aa88d37e97742262ac7, user_id=e6c8a25f1acc4df29ce6ad74c372b8ef, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:52.574260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:52.625753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2378/4790] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:52 2022] PUT /identity/v3/projects/b9f4721cf3f24aa88d37e97742262ac7/users/e6c8a25f1acc4df29ce6ad74c372b8ef/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:52.638370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd649c4-2b12-4422-84cd-5334d7b3843e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:52.638938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd649c4-2b12-4422-84cd-5334d7b3843e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:52.638938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd649c4-2b12-4422-84cd-5334d7b3843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:52.698957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7bd649c4-2b12-4422-84cd-5334d7b3843e None None] MFA Rules not processed for user `e6c8a25f1acc4df29ce6ad74c372b8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:52.700111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7bd649c4-2b12-4422-84cd-5334d7b3843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:52.937705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2413/4791] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:52.952618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:52.954737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:53.086055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:53.129137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1399c-2f0c-4d13-bf11-01994673a96d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:53.138452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:53.139335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:53.139687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:53.140337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:53.153625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:53.155244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:53.175531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2379/4792] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:53.255237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097c82-8813-41fd-bf79-ba31987447ce None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:53.255520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097c82-8813-41fd-bf79-ba31987447ce None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:53.255789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097c82-8813-41fd-bf79-ba31987447ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:53.294460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8a097c82-8813-41fd-bf79-ba31987447ce None None] MFA Rules not processed for user `e6c8a25f1acc4df29ce6ad74c372b8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:53.295726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a097c82-8813-41fd-bf79-ba31987447ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:53.317692 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2414/4793] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:54.028508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:54.257030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801428ff-df32-499f-b368-aaeba351a741 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:54.280106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:54.280822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:54.281249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:54.281578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] PATH_INFO: `/v3/users/e6c8a25f1acc4df29ce6ad74c372b8ef` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:54.286807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c8a25f1acc4df29ce6ad74c372b8ef)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:54.290611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:54.469735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c8a25f1acc4df29ce6ad74c372b8ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:54.471665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c8a25f1acc4df29ce6ad74c372b8ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:54.473346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c8a25f1acc4df29ce6ad74c372b8ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:54.492603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c8a25f1acc4df29ce6ad74c372b8ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:54.512823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c8a25f1acc4df29ce6ad74c372b8ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:54.573464 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2380/4794] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:09:54 2022] DELETE /identity/v3/users/e6c8a25f1acc4df29ce6ad74c372b8ef => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:54.578257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb8aa-2fc5-4364-ae75-fe5409a145a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:54.578738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb8aa-2fc5-4364-ae75-fe5409a145a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:54.578819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb8aa-2fc5-4364-ae75-fe5409a145a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:54.618521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3a1bb8aa-2fc5-4364-ae75-fe5409a145a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:54.620186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a1bb8aa-2fc5-4364-ae75-fe5409a145a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:54.735257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2415/4795] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:54.779770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:54.782115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:54.969830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0d3f-25da-47be-b63f-12f4d50d5856 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:54.981870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:54.982514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:54.983089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:54.985981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:55.000596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:55.002000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:55.003553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:55.024465 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2381/4796] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:56.576567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:56.576567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:56.576567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:56.650131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] MFA Rules not processed for user `eceac9adab30466e8eb081c4609eac66`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:56.669084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:56.740663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:56.743730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:56.751667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:56.770005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c0c9-b7ea-4434-937f-a191a54e16a2 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:56.781224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:56.781875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:56.782152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:56.782414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] PATH_INFO: `/v3/projects/b9f4721cf3f24aa88d37e97742262ac7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:56.783923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f4721cf3f24aa88d37e97742262ac7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:56.787439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:56.813912 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2416/4797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:56.818419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:56.820038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:56.874728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1daaf8-7514-432e-b1f8-05e0da9a28e7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:56.881514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f4721cf3f24aa88d37e97742262ac7', 'request_id': 'req-cd4763dc-28d3-4d96-b127-b93813764dd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:56.889959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f4721cf3f24aa88d37e97742262ac7', 'request_id': 'req-cd4763dc-28d3-4d96-b127-b93813764dd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:56.904362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f4721cf3f24aa88d37e97742262ac7', 'request_id': 'req-cd4763dc-28d3-4d96-b127-b93813764dd0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:56.925444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] The token cache is being invalidate because project b9f4721cf3f24aa88d37e97742262ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:09:56.926056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:56.927319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cd4763dc-28d3-4d96-b127-b93813764dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:09:56.929991 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2382/4798] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:56 2022] DELETE /identity/v3/projects/b9f4721cf3f24aa88d37e97742262ac7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:56.937346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf111d-fb1d-4c78-bd9b-cf564f537d4c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:56.937897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf111d-fb1d-4c78-bd9b-cf564f537d4c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:56.938385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf111d-fb1d-4c78-bd9b-cf564f537d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:56.991846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f8cf111d-fb1d-4c78-bd9b-cf564f537d4c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:56.994880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f8cf111d-fb1d-4c78-bd9b-cf564f537d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:57.029333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.030473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.030858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.031278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.032208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.034734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.085766 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2383/4799] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:57.091090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.091381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.091653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.098062 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2417/4800] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:56 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:57.102988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.105115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:57.143070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:57.144336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:57.236445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee73c6-afec-4a5b-b2db-705eb84ba2d7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.248100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.248650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.249147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.250190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.250883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.253537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.271615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2384/4801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:57.275473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.301790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c0d7-13de-4937-a20d-af43223dcc27 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.312712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.317891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.318317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2418/4802] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:57 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:57.318662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.319607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.321006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.326203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:09:57.326833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.328795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.354651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4801-e4f4-44b6-b942-7b68f8bb3d0c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.355876 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2385/4803] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:09:57.360676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.368607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.369501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.371644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.372120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.374222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.377661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.385194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99265b3c-2237-46ed-956e-7d8ef33c3c19 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.398470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.399941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.400231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.400523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.404400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.408255 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2419/4804] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:57.409397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.409520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.419337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:57.429419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d4bc-f4b3-4771-9f45-2062214565c9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.442230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.442913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.443191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.443483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] PATH_INFO: `/v3/projects/d30110a8f094413783dd89d360deaf82/users/d606bf627267479fa932f51cebbf4877/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.473601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30110a8f094413783dd89d360deaf82, user_id=d606bf627267479fa932f51cebbf4877, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.477643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.492682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2386/4805] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:09:57 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:57.504991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.508396 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2420/4806] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:57 2022] PUT /identity/v3/projects/d30110a8f094413783dd89d360deaf82/users/d606bf627267479fa932f51cebbf4877/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:57.510458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.575453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:57.670162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf80e3-babb-4422-8794-858c23b08d03 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.695055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.695868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.697298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.698150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.701470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.703712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.717630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7699-2c58-4e64-8ea2-96630b9d25fa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.742763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.745286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.746944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.749317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.751286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.756503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.770717 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2387/4807] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:09:57 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:09:57.778217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.807064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2421/4808] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:57.809403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711df5e-b4e0-4d78-a5e1-a563d9c9bc02 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.812686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.826480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.827120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.827394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.827791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.828421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.830111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.838444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762aab-01b8-48b1-84ef-5bdb0636eaeb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.852625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2388/4809] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:57.853147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.853693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:57.864641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.865202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.865664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] PATH_INFO: `/v3/projects/d30110a8f094413783dd89d360deaf82/users/d606bf627267479fa932f51cebbf4877/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.868807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30110a8f094413783dd89d360deaf82, user_id=d606bf627267479fa932f51cebbf4877, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.870276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee590a-3cdc-44e2-af68-1e6f21c93329 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:57.872117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.875813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:57.876523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:57.876870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:57.877245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:57.877986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:57.879678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2785c6-1472-4f33-8e0d-c724287711b4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:57.886843 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2422/4810] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:57 2022] PUT /identity/v3/projects/d30110a8f094413783dd89d360deaf82/users/d606bf627267479fa932f51cebbf4877/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:09:57.901425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2389/4811] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:09:57.903061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:58.033589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46461-d228-4ec6-9fb0-10c4e9ae69e8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:58.053892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:58.057796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:58.059225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:58.061762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] PATH_INFO: `/v3/projects/332f1ee007fd480f9a7c2e23c309ec31/users/606397ab27814a67887f1b47f8602adf/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:58.101331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332f1ee007fd480f9a7c2e23c309ec31, user_id=606397ab27814a67887f1b47f8602adf, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:58.112143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:58.143402 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2423/4812] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:09:57 2022] PUT /identity/v3/projects/332f1ee007fd480f9a7c2e23c309ec31/users/606397ab27814a67887f1b47f8602adf/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:09:58.148274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e9f5-7a99-4eea-9a5e-058910cd4bb4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:58.148555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e9f5-7a99-4eea-9a5e-058910cd4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:58.148826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e9f5-7a99-4eea-9a5e-058910cd4bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:58.205563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f6c9e9f5-7a99-4eea-9a5e-058910cd4bb4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:58.207068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6c9e9f5-7a99-4eea-9a5e-058910cd4bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:58.418022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2390/4813] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:58.505315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:58.507887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:58.673571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c07a9-e34a-4f46-a9c9-2958e1352f38 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:58.683884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:58.686087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:58.686374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:58.686688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:58.716246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:58.722251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6397a24-61b6-4c56-8824-eaa6eb9892a3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:58.753122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2424/4814] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:59.813977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:59.814533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:59.814533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:59.881360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] MFA Rules not processed for user `bd44565079024214b972eaa04d77e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:59.882603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:00.026635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:00.079527 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2391/4815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:00.081174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3990-84ee-45e1-9a16-ff2b487a9fdd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:00.081629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3990-84ee-45e1-9a16-ff2b487a9fdd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:00.081816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3990-84ee-45e1-9a16-ff2b487a9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:00.165408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-228d3990-84ee-45e1-9a16-ff2b487a9fdd None None] MFA Rules not processed for user `bd44565079024214b972eaa04d77e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:00.168784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-228d3990-84ee-45e1-9a16-ff2b487a9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:00.207639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2425/4816] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:00.503051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:00.504592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:00.703316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee6ba-eb02-4cd8-885a-393fe01f101c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:00.717159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:00.718303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:00.718827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:00.719202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:00.735495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:00.749400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:00.769329 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2392/4817] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:10.144033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:10.758394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=42 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:11.862418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:11.862876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:11.862876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:11.922464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] MFA Rules not processed for user `d606bf627267479fa932f51cebbf4877`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:11.924794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:12.141780 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2426/4818] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:12.148215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:12.149714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:12.180387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527902-4bd1-4ccb-a5f2-e196ca1a3bd7 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:12.200423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:12.201092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:12.201361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:12.201635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:12.221721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:12.223590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:12.273575 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2393/4819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:12.441782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:12.462583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:12.497561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82d2bf-d0ec-4cab-b832-4db5f7283918 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:12.513692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:12.514329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:12.514612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:12.514880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:12.524354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:12.566563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:12.568034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204769ef-c3af-4e42-b63e-21fa1d361af9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:12.621342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2427/4820] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:13.674296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:13.675973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:13.827199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4d5dc-24d8-49fb-8e06-3fe36883d128 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:13.834159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:13.835225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:13.836050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:13.836392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:13.839351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:13.879215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:13.882449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755dcaf-052d-4fa2-92e8-7592bc22678f service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:13.913394 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2394/4821] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:13.983255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcf88-2cdf-4690-b4bf-82b17dbf0a8f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:13.983737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcf88-2cdf-4690-b4bf-82b17dbf0a8f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:13.983832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcf88-2cdf-4690-b4bf-82b17dbf0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:14.021494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c6bcf88-2cdf-4690-b4bf-82b17dbf0a8f None None] MFA Rules not processed for user `0a40eaa5eefa439bb590a7511814f61c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:14.022732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c6bcf88-2cdf-4690-b4bf-82b17dbf0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:14.201664 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2428/4822] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:14.207010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:14.207322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:14.207591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:14.268550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] MFA Rules not processed for user `0a40eaa5eefa439bb590a7511814f61c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:14.270720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:14.334885 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2395/4823] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:15.413572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7a10-9cd0-493e-87fb-0b085c18c4f6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:15.414412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7a10-9cd0-493e-87fb-0b085c18c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:15.414899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7a10-9cd0-493e-87fb-0b085c18c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:15.459067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-942a7a10-9cd0-493e-87fb-0b085c18c4f6 None None] MFA Rules not processed for user `606397ab27814a67887f1b47f8602adf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:15.460417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-942a7a10-9cd0-493e-87fb-0b085c18c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:15.646962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2429/4824] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:16.355907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:16.391487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab72f6f-2268-456d-acd1-33423d56f610 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:16.422059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:16.422703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:16.422980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:16.423252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:16.470186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:16.471956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:16.495905 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2396/4825] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:20.915496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39540-8056-4a2b-8798-cefb39337f8b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:20.915943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39540-8056-4a2b-8798-cefb39337f8b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:20.916020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39540-8056-4a2b-8798-cefb39337f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:20.945863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:20.964858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-00e39540-8056-4a2b-8798-cefb39337f8b None None] MFA Rules not processed for user `606397ab27814a67887f1b47f8602adf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:20.968660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-00e39540-8056-4a2b-8798-cefb39337f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:20.985282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2430/4826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:22.584356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:22.586382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:22.623154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a6bf1-eb73-4f34-b0e9-a89f6fde2d62 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:22.631001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:22.631655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:22.635088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:22.635444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] PATH_INFO: `/v3/users/1a009402b70744a8bba7843764d3eb41` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:22.640640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a009402b70744a8bba7843764d3eb41)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:22.642913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:22.803588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a009402b70744a8bba7843764d3eb41'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:22.804523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a009402b70744a8bba7843764d3eb41'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:22.805525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a009402b70744a8bba7843764d3eb41'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:22.820462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a009402b70744a8bba7843764d3eb41'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:22.836111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a009402b70744a8bba7843764d3eb41'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:22.862832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2397/4827] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:22 2022] DELETE /identity/v3/users/1a009402b70744a8bba7843764d3eb41 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:22.867654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:22.868156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:22.868851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:22.913671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:22.915149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:23.108216 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2431/4828] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:23.117980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:23.119548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:23.211027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:23.278308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d94c7-2e4f-4ca2-8400-b9ef438c87fb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:23.283720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:23.284344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:23.284664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:23.285018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:23.303360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:23.304809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6101-5b24-4da5-bfbf-e9060833aa3d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:23.331156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2398/4829] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:23.779915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:23.783342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:23.823783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a402075-b7dd-4020-9503-7907cea5d6ae None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:23.843245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:23.844160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:23.845262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:23.845690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] PATH_INFO: `/v3/projects/73d03ef8cf94409da575aa14c03511c2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:23.847022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d03ef8cf94409da575aa14c03511c2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:23.849671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:23.951337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d03ef8cf94409da575aa14c03511c2', 'request_id': 'req-a2c8e2d1-1638-4172-a777-02e6f341596e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:23.981119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d03ef8cf94409da575aa14c03511c2', 'request_id': 'req-a2c8e2d1-1638-4172-a777-02e6f341596e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:24.006620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d03ef8cf94409da575aa14c03511c2', 'request_id': 'req-a2c8e2d1-1638-4172-a777-02e6f341596e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:24.045270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] The token cache is being invalidate because project 73d03ef8cf94409da575aa14c03511c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:24.047861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:24.049415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a2c8e2d1-1638-4172-a777-02e6f341596e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:24.056783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2432/4830] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:23 2022] DELETE /identity/v3/projects/73d03ef8cf94409da575aa14c03511c2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:24.057383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.057834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.057960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.127018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:24.131221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:24.282162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2399/4831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:24.290045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.290314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.293854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.366294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:24.367752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:24.390328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2433/4832] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:24.395701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.411393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3720a-7507-4495-88ef-519e68dd7fb2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.438502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.441770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.443498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.447412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.448254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:24.448566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:24.454511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:24.491380 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2400/4833] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:24.495987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.512398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152cef3-1871-4d5f-be14-42cce3fb8dfa None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.518264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.519309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.519810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.520286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.521155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:24.523741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:24.590605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2434/4834] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:24.594654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.629393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bf35-7194-410b-ae42-64e9be229344 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.732208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.734432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.734890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.736374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.737337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:24.742379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:24.803053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.803607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2401/4835] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:24 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:24.819092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e069677-1327-4cd2-844a-e16e08aa3bc9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.834255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.834801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.835077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.835351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.837707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:24.840183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:24.864175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.872290 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2435/4836] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:24.882758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908556-4af9-4ded-a76e-5aceee752167 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.904103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.904103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.904103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.904103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:24.904597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:24.904597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1fdb-68fd-4c1a-a308-ad9f984c58d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:24.921993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:24.930223 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2402/4837] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:24.935158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac598ce8-7952-4cae-aa6f-3d63a987e6ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:24.942144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:24.943649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:24.944271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:24.945477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] PATH_INFO: `/v3/projects/749fccc5af554fae9f093a7ef15f17f1/users/d6a1ef8f9241432dbb7c15d1bddaef00/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:25.000631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749fccc5af554fae9f093a7ef15f17f1, user_id=d6a1ef8f9241432dbb7c15d1bddaef00, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:25.009570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:25.051084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:25.051439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:25.051647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:25.061721 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2436/4838] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:24 2022] PUT /identity/v3/projects/749fccc5af554fae9f093a7ef15f17f1/users/d6a1ef8f9241432dbb7c15d1bddaef00/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:25.124695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] MFA Rules not processed for user `d6a1ef8f9241432dbb7c15d1bddaef00`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:25.126128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:25.167765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:25.277686 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2403/4839] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:25.298918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:25.301784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:25.352168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:25.468684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d9d-093d-4f9e-bfa1-0168092dc010 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:25.492574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:25.493311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:25.493593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:25.494087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:25.535435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:25.538597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:25.569120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2437/4840] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:30.578731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:30.594628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441446b-3e71-4093-8472-9c6f2e8571d6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:30.607727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:30.608713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:30.609277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:30.609698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:30.611909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:30.778589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:30.780047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:30.799375 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2404/4841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:35.550125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=21 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:38.738092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:38.739614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:38.894587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0096c-2555-4037-99ec-04a09b3bcfff service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:38.908136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:38.908992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:38.909274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:38.909545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] PATH_INFO: `/v3/users/eceac9adab30466e8eb081c4609eac66` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:38.912855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eceac9adab30466e8eb081c4609eac66)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:38.915414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:39.019220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eceac9adab30466e8eb081c4609eac66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:39.024205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eceac9adab30466e8eb081c4609eac66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:39.047178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eceac9adab30466e8eb081c4609eac66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:39.060739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eceac9adab30466e8eb081c4609eac66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:39.061782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eceac9adab30466e8eb081c4609eac66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:39.089724 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2438/4842] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:38 2022] DELETE /identity/v3/users/eceac9adab30466e8eb081c4609eac66 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:39.814378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:39.835465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c35-89dc-4752-aa09-d84a3b2605da service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:39.998974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:39.999799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:40.000083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:40.000533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] PATH_INFO: `/v3/projects/431aed60d50e42538d478f95eb470abd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:40.001894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431aed60d50e42538d478f95eb470abd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:40.004854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:40.088728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431aed60d50e42538d478f95eb470abd', 'request_id': 'req-a3eac2be-2ee9-450d-a4f7-d8463087aea0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.097476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:40.102329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431aed60d50e42538d478f95eb470abd', 'request_id': 'req-a3eac2be-2ee9-450d-a4f7-d8463087aea0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.113494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431aed60d50e42538d478f95eb470abd', 'request_id': 'req-a3eac2be-2ee9-450d-a4f7-d8463087aea0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.132800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] The token cache is being invalidate because project 431aed60d50e42538d478f95eb470abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:40.133301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.134138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.140955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2405/4843] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:39 2022] DELETE /identity/v3/projects/431aed60d50e42538d478f95eb470abd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:40.143132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:40.145382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:40.165132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c7d4-33fc-4c08-9d0c-1924750d9d57 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:40.255498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:40.256390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:40.256390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:40.256737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] PATH_INFO: `/v3/users/d606bf627267479fa932f51cebbf4877` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:40.257939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d606bf627267479fa932f51cebbf4877)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:40.259911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:40.290389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:40.328314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd606bf627267479fa932f51cebbf4877'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.329151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd606bf627267479fa932f51cebbf4877'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.338873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd606bf627267479fa932f51cebbf4877'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.349815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd606bf627267479fa932f51cebbf4877'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.350701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74437442-86ba-4af3-b304-5d082246efd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd606bf627267479fa932f51cebbf4877'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:40.375940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2439/4844] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:40 2022] DELETE /identity/v3/users/d606bf627267479fa932f51cebbf4877 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:41.023349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:41.027489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:41.068095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac2be-2ee9-450d-a4f7-d8463087aea0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:41.224716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:41.225520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.225810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.226086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] PATH_INFO: `/v3/projects/d30110a8f094413783dd89d360deaf82` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.227885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30110a8f094413783dd89d360deaf82)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:41.233396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:41.331713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30110a8f094413783dd89d360deaf82', 'request_id': 'req-c7170a5f-796d-4b3b-90cc-5fdc340c249d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:41.343425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30110a8f094413783dd89d360deaf82', 'request_id': 'req-c7170a5f-796d-4b3b-90cc-5fdc340c249d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:41.354547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30110a8f094413783dd89d360deaf82', 'request_id': 'req-c7170a5f-796d-4b3b-90cc-5fdc340c249d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:41.370468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] The token cache is being invalidate because project d30110a8f094413783dd89d360deaf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:41.371168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:41.372089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c7170a5f-796d-4b3b-90cc-5fdc340c249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:41.376829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2406/4845] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:41 2022] DELETE /identity/v3/projects/d30110a8f094413783dd89d360deaf82 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:41.381946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.382452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.382553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.413492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:41.417089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:41.555409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2440/4846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:41.564149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.564429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.564706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.609320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:41.610682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:41.625633 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2407/4847] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:41.626237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:41.643368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898beb5-32be-44ba-9db6-245595dadc9c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:41.659516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:41.661350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.661761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.663948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.665928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:41.667249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:41.671295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:41.717914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2441/4848] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:41.719137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:41.737103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66aedb-84ff-4d8a-8093-a8317d762716 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:41.746064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:41.746807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.747186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.747639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.749231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:41.751355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:41.813943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2408/4849] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:41 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:41.814839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:41.830360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70f81-b8f3-4f1b-b961-c4fc86256f5f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:41.989216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:41.991053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.991474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.991927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.992772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:41.995607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:42.038351 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2442/4850] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:41 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:10:42.044292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:42.057788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381842ba-5721-4ed0-aa41-600350b82649 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:42.080525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:42.081194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:42.086181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:42.086559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:42.087175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:42.093472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:42.136209 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2409/4851] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:42.137809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:42.151603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91776a33-3dc3-41c7-8b3a-0668b46f1ae2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:42.164297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:42.165150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:42.165425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:42.165734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:42.166540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:42.168144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665683e8-1fd5-4c77-b20f-89f05aa1e48a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:42.184952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2443/4852] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:42.189345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:42.202281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94892d47-673e-4baf-9d3a-081990258510 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:42.209075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:42.209726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:42.210130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:42.210562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] PATH_INFO: `/v3/projects/bd304d4926d34ba085d1a1f1bd0b7fdd/users/26ff90455642401986673d1abae1bf16/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:42.228332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd304d4926d34ba085d1a1f1bd0b7fdd, user_id=26ff90455642401986673d1abae1bf16, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:42.231822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:42.249998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2410/4853] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:42 2022] PUT /identity/v3/projects/bd304d4926d34ba085d1a1f1bd0b7fdd/users/26ff90455642401986673d1abae1bf16/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:42.255000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:42.255611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:42.255888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:42.267479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:42.300836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:42.305062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:42.398411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2444/4854] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:42.490931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:42.493265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:42.522378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:42.621684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5726ac-5854-48eb-8b14-11daad6b4366 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:42.626418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:42.627224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:42.627502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:42.628084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:42.645762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:42.647354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:42.658466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2411/4855] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:44.344357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:44.374299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f578f-4fc3-4987-91c7-df43d8120161 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:44.384086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:44.386293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:44.386919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:44.387352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:44.391998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:44.410416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:44.413280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:44.426594 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2445/4856] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:46.138171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:46.140420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:46.161425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b920-1708-4ea7-80be-fae62ef54bca service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:46.167606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:46.168562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:46.169088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:46.169526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] PATH_INFO: `/v3/users/bd44565079024214b972eaa04d77e2fb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:46.171023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd44565079024214b972eaa04d77e2fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:46.173288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:46.249328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd44565079024214b972eaa04d77e2fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:46.250469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd44565079024214b972eaa04d77e2fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:46.251082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd44565079024214b972eaa04d77e2fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:46.264568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd44565079024214b972eaa04d77e2fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:46.274244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a8ca91b-fee1-4b12-a778-c9faa742a8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd44565079024214b972eaa04d77e2fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:46.298263 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2412/4857] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:46 2022] DELETE /identity/v3/users/bd44565079024214b972eaa04d77e2fb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:47.343026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:47.362553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.363049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.363325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:47.364809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cd932-1f99-42a9-a3f1-79c6e9ca917a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:47.421216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] MFA Rules not processed for user `26ff90455642401986673d1abae1bf16`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:47.422505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:47.494756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:47.495404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.495681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.495951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] PATH_INFO: `/v3/projects/049f7aef45f441358e772bdaf76bdcd9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:47.497130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049f7aef45f441358e772bdaf76bdcd9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:47.499034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:47.567364 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2413/4858] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:47.572063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:47.574057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:47.609677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7b21f-9723-4b05-a80e-45b685ac5129 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:47.620694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049f7aef45f441358e772bdaf76bdcd9', 'request_id': 'req-60bdad63-aaf4-421c-a27c-c05a33b64371'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:47.629587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:47.635274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049f7aef45f441358e772bdaf76bdcd9', 'request_id': 'req-60bdad63-aaf4-421c-a27c-c05a33b64371'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:47.652402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049f7aef45f441358e772bdaf76bdcd9', 'request_id': 'req-60bdad63-aaf4-421c-a27c-c05a33b64371'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:47.688398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] The token cache is being invalidate because project 049f7aef45f441358e772bdaf76bdcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:47.688765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:47.693645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60bdad63-aaf4-421c-a27c-c05a33b64371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:47.695556 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2446/4859] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:47 2022] DELETE /identity/v3/projects/049f7aef45f441358e772bdaf76bdcd9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:47.701115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8922-a4fe-4d36-b292-0c8443b3bed8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.701412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8922-a4fe-4d36-b292-0c8443b3bed8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.701660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8922-a4fe-4d36-b292-0c8443b3bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:47.742189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:47.742928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.743521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.743733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:47.744691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:47.746199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d3ce8922-a4fe-4d36-b292-0c8443b3bed8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:47.747464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3ce8922-a4fe-4d36-b292-0c8443b3bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:47.751741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:47.777946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2447/4860] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:47.789221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.789880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.790961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:47.805285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2414/4861] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:47 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:10:47.808629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:47.812848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:47.848378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:47.850623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:47.887228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:47.976752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b43f-aace-4062-9106-86dfb2b0fe49 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:47.994453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2448/4862] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:47.998109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:47.998656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:47.999294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:47.999583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:47.999838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.000468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.002449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.014162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8502450-bc0c-4d0f-a27d-7cc4da466950 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.020130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.021025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.021437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.021862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.022922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:48.023426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.029223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.044547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2415/4863] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:47 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:48.048457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2449/4864] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:48.049631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.049762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.060822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b25e3-ce7b-499f-87fd-543b095defd9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.061725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514027c-8b04-487d-b262-58c9524fb39e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.066596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.067552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.067938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.068337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.068759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.068878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.069310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.069687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.070022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.070685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.072712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.073800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.086803 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2416/4865] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:48.090875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.104679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442d71-b043-4aef-b520-53e5159bf1b1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.110103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.110989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.111433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.111839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] PATH_INFO: `/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1/users/a97a74b543814f94968142e6c28b8a62/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.124396 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2450/4866] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:48 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:48.128552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.135450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26cf6a5e1c84c8bb3d0eea77ad8cae1, user_id=a97a74b543814f94968142e6c28b8a62, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.138814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.163169 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2417/4867] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:48 2022] PUT /identity/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1/users/a97a74b543814f94968142e6c28b8a62/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:48.168204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.209116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafba-d10b-4b42-8bed-e8ed2b955a33 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.294147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:48.314386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.315022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.315300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.315572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.316161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f516d-da63-4ef3-a708-97dc084ca6ac admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.316285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.318382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.323766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.325126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.325621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.326102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.327092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.330443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.347730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2418/4868] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:48.352183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.360680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2451/4869] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:48 2022] POST /identity/v3/users => generated 282 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:10:48.361569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.367701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8852d-e2cc-4406-b8a8-b7fa1acb7035 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.373744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76102357-70cf-410e-80cf-0d9d8bd99b37 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.375726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.376616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.377088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.377644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] PATH_INFO: `/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1/users/a97a74b543814f94968142e6c28b8a62/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.380150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.381028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.381379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.381539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26cf6a5e1c84c8bb3d0eea77ad8cae1, user_id=a97a74b543814f94968142e6c28b8a62, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.381788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.382664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.384951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.390444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.399970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2452/4870] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:48.404104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.407106 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2419/4871] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:48 2022] PUT /identity/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1/users/a97a74b543814f94968142e6c28b8a62/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:48.417987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867e69-2a08-4084-aeb6-b1cbbf03a5f6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.428499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:48.515787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.516511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.516786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.517289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.517873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.520408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fddaf-70de-40bf-9d03-5ba1bdffeb20 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.534972 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2453/4872] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:48.540979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.568292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cefe9-fd5a-4c99-a975-db85fdbe05f4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.574409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.575434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.576316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.576754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] PATH_INFO: `/v3/projects/e8d830cc830d4a27843d465d8c0f3c93/users/ffefc570beb34abba030de53ca6a6a0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.597794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d830cc830d4a27843d465d8c0f3c93, user_id=ffefc570beb34abba030de53ca6a6a0a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.605648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.671756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2420/4873] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:48 2022] PUT /identity/v3/projects/e8d830cc830d4a27843d465d8c0f3c93/users/ffefc570beb34abba030de53ca6a6a0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:48.681980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.682264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.682560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.727945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] MFA Rules not processed for user `ffefc570beb34abba030de53ca6a6a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:48.729325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:48.852175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2454/4874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:48.862043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.863440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:49.009233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe511a-ab16-411c-a3ed-99fd5aa936ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:49.016368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:49.017233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.017663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.018168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.030162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:49.032802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4edaf-3252-4445-84ac-d88f01d25bd4 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:49.054871 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2421/4875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:49.123080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:49.248283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c0585-8824-4e15-b188-a657c2e9e1e5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:49.254205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:49.254986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.255458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.255738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] PATH_INFO: `/v3/users/ffefc570beb34abba030de53ca6a6a0a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.257412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffefc570beb34abba030de53ca6a6a0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:49.259928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:49.327855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:49.342010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffefc570beb34abba030de53ca6a6a0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.343002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffefc570beb34abba030de53ca6a6a0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.363932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffefc570beb34abba030de53ca6a6a0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.376157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffefc570beb34abba030de53ca6a6a0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.377084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffefc570beb34abba030de53ca6a6a0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.410966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.412252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.412252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.415227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2455/4876] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:49 2022] DELETE /identity/v3/users/ffefc570beb34abba030de53ca6a6a0a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:49.444029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:49.446288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:49.561476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2422/4877] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:49.572782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:49.574310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:49.689921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbb795-8dd6-479e-a1bc-d9a097a1c9a4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:49.695923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:49.696572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.696858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.697176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.712694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:49.715523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:49.730952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2456/4878] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:50.481205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:50.482706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:50.496193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fdbf-daad-4561-bff8-b5483fc4dea2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:50.500210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:50.501103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:50.501383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:50.501656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:50.503431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:50.515236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:50.516897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:50.527888 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2423/4879] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:50.891048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:50.893995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:50.908866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a871e44-fd06-4eea-bef9-38081b46bdd7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:50.914388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:50.915148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:50.916008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:50.916372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] PATH_INFO: `/v3/users/05b11268812b415bbe36c1980bea37b6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:50.917736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b11268812b415bbe36c1980bea37b6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:50.919679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:50.984443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b11268812b415bbe36c1980bea37b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:50.985609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b11268812b415bbe36c1980bea37b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.001777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b11268812b415bbe36c1980bea37b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.011483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b11268812b415bbe36c1980bea37b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.012313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-046fb39a-f8f7-4f91-b815-0f3bfcf357bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b11268812b415bbe36c1980bea37b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.032047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2457/4880] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:50 2022] DELETE /identity/v3/users/05b11268812b415bbe36c1980bea37b6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:51.084044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:51.086738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:51.104448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8867b-86c2-4404-bbb3-2f4ffbec8b6d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:51.132878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:51.207330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:51.207968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.208751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.209187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] PATH_INFO: `/v3/projects/e8d830cc830d4a27843d465d8c0f3c93` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.210486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d830cc830d4a27843d465d8c0f3c93)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:51.213147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:51.294136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d830cc830d4a27843d465d8c0f3c93', 'request_id': 'req-725b1a75-cf2f-4e48-b1e6-41648b9425bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.301407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d830cc830d4a27843d465d8c0f3c93', 'request_id': 'req-725b1a75-cf2f-4e48-b1e6-41648b9425bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.315702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d830cc830d4a27843d465d8c0f3c93', 'request_id': 'req-725b1a75-cf2f-4e48-b1e6-41648b9425bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.330829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] The token cache is being invalidate because project e8d830cc830d4a27843d465d8c0f3c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:51.331150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.331872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-725b1a75-cf2f-4e48-b1e6-41648b9425bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:51.333755 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2424/4881] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:51 2022] DELETE /identity/v3/projects/e8d830cc830d4a27843d465d8c0f3c93 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:51.342462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.342843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.343678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.373477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:51.375028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:51.411441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:51.466949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2458/4882] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:51.469480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.469838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.470182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.495569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:51.497676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:51.528011 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2425/4883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:51.532320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:51.552157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c63c5-c592-42d7-bf35-a6bd4234586b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:51.562831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:51.563667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.564097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.564521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.566211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:51.566664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:51.569177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cab99e-993f-471e-8c36-77068dca3315 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:51.596981 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2459/4884] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:51.602581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:51.615455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.615957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.616342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.626145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d35ef-c947-4d1e-964f-20deb5116dfd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:51.661450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:51.662168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.662448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.662718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.663466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:51.665404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:51.697573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] MFA Rules not processed for user `a97a74b543814f94968142e6c28b8a62`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:51.698803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:51.723822 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2426/4885] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:51 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:51.728463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:51.732521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:51.857811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fba4d5-986d-4c3e-9880-4c0a0f3afcd2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:51.874243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:51.874910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:51.875169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:51.875440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] PATH_INFO: `/v3/projects/938d52ca99bf461d9175ab267ef56ae5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:51.876599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] RBAC: Authorizing `identity:delete_project(project_id=938d52ca99bf461d9175ab267ef56ae5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:51.878545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:51.942651 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2460/4886] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:51.943737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:51.956522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:51.968673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6c0a-e928-4f5b-b675-85ff6169410a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.014510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938d52ca99bf461d9175ab267ef56ae5', 'request_id': 'req-d82d2304-723c-4c02-95ff-0c47c869949c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:52.021007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938d52ca99bf461d9175ab267ef56ae5', 'request_id': 'req-d82d2304-723c-4c02-95ff-0c47c869949c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:52.037312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938d52ca99bf461d9175ab267ef56ae5', 'request_id': 'req-d82d2304-723c-4c02-95ff-0c47c869949c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:52.054924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] The token cache is being invalidate because project 938d52ca99bf461d9175ab267ef56ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:52.055581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:52.057058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d82d2304-723c-4c02-95ff-0c47c869949c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:52.062881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2427/4887] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:51 2022] DELETE /identity/v3/projects/938d52ca99bf461d9175ab267ef56ae5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:52.064600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68853-7c6b-487d-9945-6a204ee3eb82 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.064896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68853-7c6b-487d-9945-6a204ee3eb82 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.065173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f68853-7c6b-487d-9945-6a204ee3eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.075695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.076406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.077005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.077509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.078235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.081524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417bc5-a633-4276-aacf-3b23c4dd070a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.102575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f2f68853-7c6b-487d-9945-6a204ee3eb82 None None] MFA Rules not processed for user `26ff90455642401986673d1abae1bf16`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:52.103959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2f68853-7c6b-487d-9945-6a204ee3eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.114755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2461/4888] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:51 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:52.115229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.117920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.117920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.146254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:52.148690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.163504 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2462/4889] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:52.163504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.165274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.182660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2e40-4324-4728-8533-c86f188577ea None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.191663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.192284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.193130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.193570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.194502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.196746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.200724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2428/4890] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:52.202303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.202960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.203438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.214394 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2463/4891] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:52.215573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.217343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.234521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:52.236125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:52.236687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.249455 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2429/4892] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:52.250512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.263470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b521832-f715-42d7-bb56-a2c58769d425 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.269876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.270817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.271332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.271871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.272733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.275588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.288944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2430/4893] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:52.290030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.304152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fecb-ed61-4ed4-9f0b-73c2addb3e6b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.309275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.309883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.310278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.310560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.311199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:52.311498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.313101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.326367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154770a6-fea9-4894-8558-74991c8762ec admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.332132 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2431/4894] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:52.333097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.341037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.341906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.342376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.342938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.345514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b6e0-90c9-4ff2-8e12-ede7a413091a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.347955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.351445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.352604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.353504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.354017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] PATH_INFO: `/v3/projects/3e01283a65424b6cbc9055b688e14250/users/1ff0cf50f6124f2789a7ccd2a6298b16/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.360354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.362012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.374375 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2464/4895] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:52.375091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.376051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e01283a65424b6cbc9055b688e14250, user_id=1ff0cf50f6124f2789a7ccd2a6298b16, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.378908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f8720-2c7c-409c-9dfc-3ec3f363c592 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.386763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85753b22-66a6-4fc2-ac80-0045b4ed9881 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.393523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.394404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.394772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.395363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.396086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.398220 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2432/4896] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:52 2022] PUT /identity/v3/projects/3e01283a65424b6cbc9055b688e14250/users/1ff0cf50f6124f2789a7ccd2a6298b16/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:52.399442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.411075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.411519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.411990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.466542 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2465/4897] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:52.467441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.471472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] MFA Rules not processed for user `1ff0cf50f6124f2789a7ccd2a6298b16`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:52.473096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:52.590153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:52.617593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa100-aad8-423c-8fbb-71ba9533eb3f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.622479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2433/4898] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:52.624954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.625697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.626459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.626907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.627276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.628267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.631805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.665748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2466/4899] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:52.669323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48264a9-018b-4e29-96aa-a91f23c4eb07 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.670145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.681986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.683006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.683571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.684276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.685489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f86ae-4f60-4675-8d4a-44f7ec857511 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.686179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.688616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.690755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.691505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.691890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.692244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.693690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.695434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.707562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2467/4900] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:52.711874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.725337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eaccc-6bc6-4169-b806-af036e9a29ec admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.731440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.732278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.732656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.733329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.734425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.736251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.743881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2434/4901] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:52.744954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.753451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2468/4902] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:52.755201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.767415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceb3b-dc38-4cd7-9eb6-4b8a3de0e77d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.825750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:52.852526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12151-bbfb-434a-95f1-695f4436c2a2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.855843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.856589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.856976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.857440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] PATH_INFO: `/v3/projects/9b12cfc0bbd64e7ea4a64277b566dfd8/users/b28b625c3a9340c888d9fab29f82ffa3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.858108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:52.858926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.859415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.859778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.861071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.864810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.876792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b12cfc0bbd64e7ea4a64277b566dfd8, user_id=b28b625c3a9340c888d9fab29f82ffa3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:52.880022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221648b1-c654-4d7c-bf55-345a85224eb3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:52.896348 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2435/4903] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:52.897688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2469/4904] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:52 2022] PUT /identity/v3/projects/9b12cfc0bbd64e7ea4a64277b566dfd8/users/b28b625c3a9340c888d9fab29f82ffa3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:52.902264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:52.903828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59264-3917-4028-9404-30fc6044c62c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:52.904277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59264-3917-4028-9404-30fc6044c62c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:52.904547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59264-3917-4028-9404-30fc6044c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:52.918044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597aede-6b3d-4c81-9e07-d014dedfa517 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:52.926517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-acb59264-3917-4028-9404-30fc6044c62c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:52.927742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acb59264-3917-4028-9404-30fc6044c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:53.006852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.007707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.009888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.010375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.011099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.012981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.016648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2470/4905] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:53.027247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59264-3917-4028-9404-30fc6044c62c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.028056 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2436/4906] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:53.028893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acb59264-3917-4028-9404-30fc6044c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:53.031461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.045966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5052c-708b-4830-8d8a-23e8c92de942 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.051401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.052058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.052334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.052926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] PATH_INFO: `/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40/users/895912aaa34e41029ed8dfb521716157/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.071957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9db2240a278466c8a4f7df2ea1f1c40, user_id=895912aaa34e41029ed8dfb521716157, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.074988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.090642 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2437/4907] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:53 2022] PUT /identity/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40/users/895912aaa34e41029ed8dfb521716157/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:53.092305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59264-3917-4028-9404-30fc6044c62c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.094424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.138055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:53.156782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.157728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.158049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.158380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.169447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeffc2-3d6a-4e1a-b694-ac9c71d80dd9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.170068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.171811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.174874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.175592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.175941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.176281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.177031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.179245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f2a20-1e90-4347-874b-54a114b32623 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.184963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2471/4908] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:10:53.210689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2438/4909] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:53.215393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.229425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb7ad-9674-4cd0-a668-3f481be4111c service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.234532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.235373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.235655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.235925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] PATH_INFO: `/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40/users/895912aaa34e41029ed8dfb521716157/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.238042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9db2240a278466c8a4f7df2ea1f1c40, user_id=895912aaa34e41029ed8dfb521716157, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.240707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.256408 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2472/4910] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:53 2022] PUT /identity/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40/users/895912aaa34e41029ed8dfb521716157/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:53.267258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.267469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.267703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.299646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] MFA Rules not processed for user `895912aaa34e41029ed8dfb521716157`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:53.300887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:53.410827 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2439/4911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:53.412358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.430135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214b03-83b3-475a-8458-32fc0093b9a0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.436195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.437053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.437418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.437780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.438540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.440279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invalid input for field 'name': '' is too short Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: On instance['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: On instance['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: '' Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise error Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application '' Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.447838 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:10:53.449639 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application '' Oct 28 10:10:53.450857 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:53.455371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2473/4912] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:10:53 2022] POST /identity/v3/domains => generated 283 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:10:53.458171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.473822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ce042-86f7-45e5-bab0-1462efae8496 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.479968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.480616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.481082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.481326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.482026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.483708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: On instance['name']: Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: On instance['name']: Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.502885 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 28 10:10:53.504341 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['name']: Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:10:53.505622 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.510662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.510819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2440/4913] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:10:53 2022] POST /identity/v3/domains => generated 412 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:10:53.522318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36724-ee69-4382-9f80-73582de8ff65 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.531183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.532637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.533517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.534134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.535123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.537383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.542077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:53.563413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2474/4914] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:10:53 2022] POST /identity/v3/domains => generated 274 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:53.567265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.587217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7c96d-7576-481a-936f-a669544fa676 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.675746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.676311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.676660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.677465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/08fd970df0e247a584d0ebcd1ca97123` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.696451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08fd970df0e247a584d0ebcd1ca97123)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.698265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 28 10:10:53.718019 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 28 10:10:53.719033 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:53.719504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2441/4915] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:10:53 2022] DELETE /identity/v3/domains/08fd970df0e247a584d0ebcd1ca97123 => generated 120 bytes in 152 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:10:53.725063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.740862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ba9b-f9b7-4cc8-aa35-7fc9313deb7a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.749867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.751273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.751562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.751830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/08fd970df0e247a584d0ebcd1ca97123` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:53.753540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08fd970df0e247a584d0ebcd1ca97123)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:53.755856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:53.825679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:53.825951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:53.871658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:53.872338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:53.875068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2475/4916] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:10:53 2022] PATCH /identity/v3/domains/08fd970df0e247a584d0ebcd1ca97123 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:10:53.879993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:53.882048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:53.902127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06660b21-651a-4466-a0ce-7729dd9b941a tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:53.955881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:53.992539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:53.993683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:53.994072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:53.994442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/08fd970df0e247a584d0ebcd1ca97123` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.008156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08fd970df0e247a584d0ebcd1ca97123)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:54.009958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:54.076471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.082775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.157565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.164431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.176188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.193305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] The token cache is being invalidate because project 08fd970df0e247a584d0ebcd1ca97123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:54.193870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.194739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.205265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.210572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.212403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08fd970df0e247a584d0ebcd1ca97123', 'request_id': 'req-f3767c30-8b81-4844-9f25-b2942978e140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.229352 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2442/4917] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:10:53 2022] DELETE /identity/v3/domains/08fd970df0e247a584d0ebcd1ca97123 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:54.230924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:54.242174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a62f7-651d-41aa-a5fc-332162b56283 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:54.342033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:54.342946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:54.343307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:54.343599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/571da47bc82e4899b10bbebad1528131` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.354886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Could not find domain: 571da47bc82e4899b10bbebad1528131.: keystone.exception.DomainNotFound: Could not find domain: 571da47bc82e4899b10bbebad1528131. Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 571da47bc82e4899b10bbebad1528131. Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:54.362156 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:10:54.363185 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:10:54.364112 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 571da47bc82e4899b10bbebad1528131. Oct 28 10:10:54.365252 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.365252 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2476/4918] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:10:54 2022] DELETE /identity/v3/domains/571da47bc82e4899b10bbebad1528131 => generated 112 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:10:54.369397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:54.371305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:54.393348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3767c30-8b81-4844-9f25-b2942978e140 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:54.400482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:54.401930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:54.402468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:54.403091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.404036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:54.406512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:54.429344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2443/4919] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:10:54 2022] POST /identity/v3/domains => generated 252 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:54.433809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:54.465211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13818758-49e5-44ff-8106-6490abcac430 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:54.576955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:54.578478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:54.578604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:54.578792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.579906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:54.582939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:54.603227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.sql.core [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-667642838' for key 'project.ixu_project_name_domain_id'") Oct 28 10:10:54.603227 n-d-zed-1 devstack@keystone.service[88452]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 10:10:54.603227 n-d-zed-1 devstack@keystone.service[88452]: [parameters: {'id': '386360eafff341ddb13c6fde0849c7b9', 'name': 'tempest-domain-dup-667642838', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 10:10:54.603227 n-d-zed-1 devstack@keystone.service[88452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-667642838.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-667642838. Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:10:54.611904 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-667642838' for key 'project.ixu_project_name_domain_id'") Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 10:10:54.629759 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application yield resource Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise self.value Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application session.commit() Oct 28 10:10:54.631072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.flush() Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application compat.raise_( Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 10:10:54.632368 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 10:10:54.634848 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application conn.query(q) Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result.read() Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:10:54.639033 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-667642838' for key 'project.ixu_project_name_domain_id'") Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [parameters: {'id': '386360eafff341ddb13c6fde0849c7b9', 'name': 'tempest-domain-dup-667642838', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.641072 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-667642838. Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:54.643296 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-667642838. Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:10:54.646779 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2477/4920] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:10:54 2022] POST /identity/v3/domains => generated 211 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 10:10:54.648810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:54.648810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e89e-9c83-41ae-8e56-713329e6139f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:54.673220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:54.674035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:54.674718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:54.674952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/889704804dbc405a9be1e1950411bfa4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.694173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=889704804dbc405a9be1e1950411bfa4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:54.698955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:54.737533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.739425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.801404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.802182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.807719 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2444/4921] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:10:54 2022] PATCH /identity/v3/domains/889704804dbc405a9be1e1950411bfa4 => generated 253 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:54.811816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:54.813566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:54.828809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540c25-f8ce-4e0a-aec7-95ee8a75256f tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:54.895231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:54.915869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:54.916646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:54.917031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:54.917774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/889704804dbc405a9be1e1950411bfa4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:54.936732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=889704804dbc405a9be1e1950411bfa4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:54.938554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:54.976561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:54.980220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '889704804dbc405a9be1e1950411bfa4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.061659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.067502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.077300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.091558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] The token cache is being invalidate because project 889704804dbc405a9be1e1950411bfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:55.091917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.092523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.100692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.105257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.106012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '889704804dbc405a9be1e1950411bfa4', 'request_id': 'req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.112130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2478/4922] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:10:54 2022] DELETE /identity/v3/domains/889704804dbc405a9be1e1950411bfa4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:55.116582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:55.127720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974932a-2dc8-4cd0-afd8-de94edb25092 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:55.138450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:55.200655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895912aaa34e41029ed8dfb521716157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9db2240a278466c8a4f7df2ea1f1c40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:55.201739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:55.201739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:55.202047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] PATH_INFO: `/v3/domains/08fd970df0e247a584d0ebcd1ca97123` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:55.211824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-dc5ceed5-adb9-4598-9622-c05315f1e839 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Could not find domain: 08fd970df0e247a584d0ebcd1ca97123.: keystone.exception.DomainNotFound: Could not find domain: 08fd970df0e247a584d0ebcd1ca97123. Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08fd970df0e247a584d0ebcd1ca97123. Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:10:55.217597 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:10:55.218713 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:10:55.219672 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08fd970df0e247a584d0ebcd1ca97123. Oct 28 10:10:55.220768 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:10:55.220768 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2445/4923] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:10:55 2022] PATCH /identity/v3/domains/08fd970df0e247a584d0ebcd1ca97123 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:10:55.225764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:55.227192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:55.323823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddc40-9cd9-4fdc-bc31-f3f3141aac93 tempest-DomainsNegativeTestJSON-1437447743 tempest-DomainsNegativeTestJSON-1437447743-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:55.328599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:55.329326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:55.329643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:55.329916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] PATH_INFO: `/v3/users/1ff0cf50f6124f2789a7ccd2a6298b16` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:55.331123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff0cf50f6124f2789a7ccd2a6298b16)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:55.333198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:55.384877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:55.414688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff0cf50f6124f2789a7ccd2a6298b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.415387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff0cf50f6124f2789a7ccd2a6298b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.427623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff0cf50f6124f2789a7ccd2a6298b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.440939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff0cf50f6124f2789a7ccd2a6298b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.440939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff0cf50f6124f2789a7ccd2a6298b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:55.467443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2479/4924] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:55 2022] DELETE /identity/v3/users/1ff0cf50f6124f2789a7ccd2a6298b16 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:55.471846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:55.472148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:55.472402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:55.494409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:55.495669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:55.590812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2446/4925] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:55.602080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:55.603877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:55.714286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6848-2a86-4d74-aa6a-3b45048e1554 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:55.719402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:55.720130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:55.720413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:55.720818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:55.733101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:55.735164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:55.749480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2480/4926] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:56.178797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:56.180673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:56.195106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39543120-b48b-4b6e-a340-85e4967db28c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:56.200804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:56.201094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:56.201381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:56.201660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] PATH_INFO: `/v3/projects/3e01283a65424b6cbc9055b688e14250` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:56.202842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e01283a65424b6cbc9055b688e14250)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:56.205050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:56.325949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e01283a65424b6cbc9055b688e14250', 'request_id': 'req-08c22214-df20-413d-8df5-380ab935c49f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.333588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e01283a65424b6cbc9055b688e14250', 'request_id': 'req-08c22214-df20-413d-8df5-380ab935c49f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.345765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e01283a65424b6cbc9055b688e14250', 'request_id': 'req-08c22214-df20-413d-8df5-380ab935c49f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.380231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] The token cache is being invalidate because project 3e01283a65424b6cbc9055b688e14250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:56.380450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.381731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.383797 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2447/4927] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:56 2022] DELETE /identity/v3/projects/3e01283a65424b6cbc9055b688e14250 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:56.388205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:56.400430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb05be-a31a-4480-a237-a4cd08d4c258 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:56.466912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:56.467238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:56.467516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:56.468158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] PATH_INFO: `/v3/users/895912aaa34e41029ed8dfb521716157` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:56.469205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895912aaa34e41029ed8dfb521716157)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:56.471684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:56.552533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895912aaa34e41029ed8dfb521716157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.555026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895912aaa34e41029ed8dfb521716157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.559503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:56.568153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895912aaa34e41029ed8dfb521716157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.604118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895912aaa34e41029ed8dfb521716157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.605464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae163f9e-b35d-4ced-b9a8-bb637a6746e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895912aaa34e41029ed8dfb521716157'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:56.643619 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2481/4928] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:56 2022] DELETE /identity/v3/users/895912aaa34e41029ed8dfb521716157 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:57.224447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:57.226174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:57.246926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c22214-df20-413d-8df5-380ab935c49f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:57.309684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:57.355543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:57.356629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:57.357171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:57.357654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] PATH_INFO: `/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:57.359833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9db2240a278466c8a4f7df2ea1f1c40)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:57.364981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:57.451435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9db2240a278466c8a4f7df2ea1f1c40', 'request_id': 'req-5af90380-7479-448c-bdca-927991b640bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:57.460608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9db2240a278466c8a4f7df2ea1f1c40', 'request_id': 'req-5af90380-7479-448c-bdca-927991b640bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:57.475603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9db2240a278466c8a4f7df2ea1f1c40', 'request_id': 'req-5af90380-7479-448c-bdca-927991b640bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:57.501701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] The token cache is being invalidate because project d9db2240a278466c8a4f7df2ea1f1c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:57.502625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:57.503399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5af90380-7479-448c-bdca-927991b640bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:57.508394 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2448/4929] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:57 2022] DELETE /identity/v3/projects/d9db2240a278466c8a4f7df2ea1f1c40 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:57.510970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:57.511463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:57.513343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:57.549842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:57.557775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:57.747228 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2482/4930] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:57.748766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:57.748766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:57.748766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:57.784754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:57.786365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:57.805234 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2449/4931] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:57.806312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:57.818080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93478a6-9b53-429d-9926-5810b1ede866 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:57.824435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:57.825217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:57.825510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:57.825785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:57.826445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:10:57.826911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:57.828495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:57.853748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2483/4932] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:57.854794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:57.867847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8c73-c2aa-47de-96b9-2cc193231851 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:57.893752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:57.904929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:57.904929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:57.905187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:57.906018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:57.909443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:57.984832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:57.988353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:58.001364 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2450/4933] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:57 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:58.002885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:58.143971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f02-f071-4f81-8efa-3f1d478e4587 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.150276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.152505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.153094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.153634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.156498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.159907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.183318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfbb0-a57b-4661-8229-bf1c5230cef0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.197687 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2451/4934] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:58 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:58.204112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:58.240426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b157a-c412-4e26-b48d-d7f45414f428 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.252455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.254667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.255041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.255479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.256808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.258347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.276568 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2452/4935] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:58.279703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:58.287156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:58.299682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e62c-3a91-47ef-9571-5cd79d801ad8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.318324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.320666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.321250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.322968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.323132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.323879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.324159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.324424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.325515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.329324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.335750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:58.346363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2453/4936] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:58.347796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:58.357277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:58.371144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cae3e-3a39-425a-9ac3-640f170ae979 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.390116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.390889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.393954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.393954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] PATH_INFO: `/v3/projects/d1a43d22d6be44b890bf5169077e58df/users/fefb64497cab4627ae5588755323005f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.432516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a43d22d6be44b890bf5169077e58df, user_id=fefb64497cab4627ae5588755323005f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.443796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dbf81-cc47-46b0-9136-e835f6a0464e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.456441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.458089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.474222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2454/4937] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:58 2022] PUT /identity/v3/projects/d1a43d22d6be44b890bf5169077e58df/users/fefb64497cab4627ae5588755323005f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:58.476160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.476439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.476809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.508401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2484/4938] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:10:58.696210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] MFA Rules not processed for user `fefb64497cab4627ae5588755323005f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:58.697544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:58.817641 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2455/4939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:10:58.823547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:58.845844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d2c2-730c-45f5-b280-474755181fea service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:58.946504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:58.947132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:58.947413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:58.949216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:58.950082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:58.951872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:58.986606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2485/4940] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:58 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:58.990672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.003052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d644a1-b7d7-4048-b784-685fb39e185b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.068548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.069199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.069475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.069738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.070358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.072775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.100389 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2456/4941] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:10:58 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:59.104398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.115927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8dea-21b7-4953-9186-49d6f901aa65 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.120857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.121524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.121800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.122068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.123474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.126238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.141206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2486/4942] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:10:59.142376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.153901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87dca-5701-4a79-8feb-154b0fb15b3c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.159715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.159715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.160091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.160386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] PATH_INFO: `/v3/projects/87f537469667469788436c36559efe98/users/15a65d5c1b37450cb5f0257aa6ec960f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.178908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f537469667469788436c36559efe98, user_id=15a65d5c1b37450cb5f0257aa6ec960f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.181674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.198645 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2457/4943] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:59 2022] PUT /identity/v3/projects/87f537469667469788436c36559efe98/users/15a65d5c1b37450cb5f0257aa6ec960f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:59.202351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.213298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c5e3a-db30-42c7-b498-bbad35146821 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.286327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:59.303928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.305325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.305867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.306331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.307152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.309251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424ff29-acdb-481c-84a2-fa4923647dea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.323011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2487/4944] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:10:59.326524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.344425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858a89-a628-42c8-9827-118121e8e6fd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.351320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.352219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.352622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.353016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] PATH_INFO: `/v3/projects/87f537469667469788436c36559efe98/users/15a65d5c1b37450cb5f0257aa6ec960f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.356228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f537469667469788436c36559efe98, user_id=15a65d5c1b37450cb5f0257aa6ec960f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.359524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.372852 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2458/4945] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:10:59 2022] PUT /identity/v3/projects/87f537469667469788436c36559efe98/users/15a65d5c1b37450cb5f0257aa6ec960f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:10:59.384522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.384838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.385114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.415645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] MFA Rules not processed for user `15a65d5c1b37450cb5f0257aa6ec960f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:10:59.417656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:59.498572 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2488/4946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:10:59.502792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.514580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2748e-f087-4211-8aa1-1780f5261a72 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.519666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.520269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.520589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.520806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.521492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.523079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.549288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2459/4947] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/services => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:59.551156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.563269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06fbb-37f6-4676-9113-b42b1e66c057 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.607183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.607691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.607974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.608253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.609741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.610832 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:10:59.610832 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:10:59.610832 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:10:59.611731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.641273 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-44652864. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:10:59.641273 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:10:59.641273 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:10:59.675814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2489/4948] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/endpoints => generated 356 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:59.679902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.691400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c86bac-3141-43ec-92b1-b141b831dbc0 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.699153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:59.712212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.712359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.712602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.712992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-44652864` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.714215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-44652864)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.715360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.717681 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2460/4949] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 10:10:59 2022] GET /identity/v3/regions/tempest-region-44652864 => generated 176 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:10:59.721154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.734193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add8d0c-b9ee-4e1b-b9f7-70d9c3e7cfde tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.740636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.741924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.742586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.743625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.744716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.746891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.766815 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2490/4950] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/services => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:10:59.771274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.781752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b5b7-ec69-4cf2-b08a-e2e1cbfaa23e tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.798741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.799612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.799982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.800344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.801457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.802334 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:10:59.802334 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:10:59.802334 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:10:59.803399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.835506 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1675265289. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:10:59.835506 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:10:59.835506 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:10:59.863156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2461/4951] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/endpoints => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:59.867058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.879118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d28c29-1b13-43f5-88ea-8927210b54e1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.894580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.895218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.895499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.895773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1675265289` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.896349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1675265289)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.897450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.899303 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2491/4952] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 10:10:59 2022] GET /identity/v3/regions/tempest-region-1675265289 => generated 180 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:10:59.903769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.914236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0afd-4321-4bcb-b2b2-fd9d242996b3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.919414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.920011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.920290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.920559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.921264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.922844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:59.941497 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1684768823. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:10:59.941497 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:10:59.941497 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:10:59.966116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2462/4953] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:10:59 2022] POST /identity/v3/endpoints => generated 361 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:10:59.970237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:59.981122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022760a4-cf6f-4af1-847c-f742381ae136 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:59.997097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:59.997755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:59.998034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:59.998304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1684768823` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:59.998874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1684768823)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:59.999938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.001947 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2492/4954] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 10:10:59 2022] GET /identity/v3/regions/tempest-region-1684768823 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.005934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.017396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bc5b2-3f13-4e61-98cd-f40411a87567 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.022319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.022902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.023186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.023448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.024091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.025210 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:00.025210 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:11:00.025210 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:00.026099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.035195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2463/4955] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints => generated 4394 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:00.039432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.051412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01ee5-10e6-42fb-a1e8-30cb7ddca8c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.056988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.057604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.058022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.058301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/8efac78a782e447c853968d4437b04bc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.065173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=8efac78a782e447c853968d4437b04bc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.066193 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:00.066193 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:11:00.066193 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:00.067389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.069103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2493/4956] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints/8efac78a782e447c853968d4437b04bc => generated 361 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.073247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.083715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd649-57e9-4134-b27d-3753afc34001 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.088733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.089457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.089836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.090193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/8efac78a782e447c853968d4437b04bc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.091485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8efac78a782e447c853968d4437b04bc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.092705 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:00.092705 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:11:00.092705 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:00.093843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.104512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8efac78a782e447c853968d4437b04bc', 'request_id': 'req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:00.115489 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2464/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:00 2022] DELETE /identity/v3/endpoints/8efac78a782e447c853968d4437b04bc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:00.120366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.130704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c6a6-3fc0-4934-8d1c-c1d90e56df1f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.148622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.150299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.150595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.150908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.151507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.152625 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:00.152625 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:11:00.152625 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:00.153915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.168677 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2494/4958] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints => generated 4046 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:00.169346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.180812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddaaf7-e1f9-48bf-8e3b-7bdbb1b04777 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.187004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.187004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.187257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.187340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/8efac78a782e447c853968d4437b04bc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.192290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Could not find endpoint: 8efac78a782e447c853968d4437b04bc.: keystone.exception.EndpointNotFound: Could not find endpoint: 8efac78a782e447c853968d4437b04bc. Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._iter().one() Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._only_one_row( Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:00.214161 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 8efac78a782e447c853968d4437b04bc. Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:00.215292 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:11:00.216299 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 8efac78a782e447c853968d4437b04bc. Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:00.217297 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2465/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:00 2022] DELETE /identity/v3/endpoints/8efac78a782e447c853968d4437b04bc => generated 114 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:11:00.219785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.234775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009c7a-e19e-43b1-bd0a-04d456936a64 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.243229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.243875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.244289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.244567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1684768823` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.245184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1684768823)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.247877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.266276 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1684768823. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:00.266276 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:00.266276 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:00.268950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:00.285886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2495/4960] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:11:00 2022] DELETE /identity/v3/regions/tempest-region-1684768823 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:00.291872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.306987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc566a5-87eb-4605-8327-e133af66978a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.327212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.327940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.328199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.328344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.329012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.330780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.345551 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2466/4961] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints => generated 4046 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:00.348681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.364845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0e9f-211c-49b7-93bb-70dc5ad6ca7b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.374237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.375249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.375880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.376445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.377457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Adding query filter params (service_id=0004119c931a4e0c8c3873354d70174b) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:00.377976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.380701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.389320 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2496/4962] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints?service_id=0004119c931a4e0c8c3873354d70174b => generated 498 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:11:00.394149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.410504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643777-8e4f-40e7-b7e4-df6a265c579a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.423282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.425134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.425670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.426161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.427212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Adding query filter params (service_id=8dc3693f4a0640339b545e669bfdc4ea) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:00.428259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.431425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.443314 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2467/4963] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints?service_id=8dc3693f4a0640339b545e669bfdc4ea => generated 505 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:11:00.447271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.459546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbf3fe-4386-4d5e-aa8d-57a105ff353f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.465857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.466577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.466929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.467269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.469291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:00.469684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.472796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.492038 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2497/4964] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints?interface=public => generated 3401 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:11:00.496378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.510035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec13a0a-8d1a-4a7c-afd1-2bf3bb39138d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.517895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.518619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.518967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.519300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.520258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:00.520633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.522458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.537807 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2468/4965] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.543447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.560438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b6c5-ba0c-4997-a33c-44993b922c5d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.566135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.566847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.567182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.568150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.568887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.572166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.598221 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2498/4966] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:00 2022] POST /identity/v3/services => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:00.603854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.615375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d932-8a67-4918-a160-1b4dc8fd680f tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.644423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.645629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.647869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.648132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.649958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.651645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.706238 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1360543839. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:00.706238 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:00.706238 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:00.738692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2469/4967] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:11:00 2022] POST /identity/v3/endpoints => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:00.742439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.760817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96ab5-684e-4763-8add-84d7edea647a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.778293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.778978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.779328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.779505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1360543839` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.780140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1360543839)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.781822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.786851 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2499/4968] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/regions/tempest-region-1360543839 => generated 180 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.787818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.799124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431960-b4f5-4da3-9579-f1ec59f82ae2 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.803961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.804602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.804887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.805185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/8bf10208324a4f91bd34e332e7779dda` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.818240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8bf10208324a4f91bd34e332e7779dda)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.819372 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:00.819372 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:11:00.819372 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:00.820157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.826748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:00.845141 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1977051607. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:00.845141 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:00.845141 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:00.894132 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2470/4969] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:11:00 2022] PATCH /identity/v3/endpoints/8bf10208324a4f91bd34e332e7779dda => generated 364 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.898222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.910731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47cf29-7c4a-4fe3-b1dc-e190852e9283 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.935328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.936838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.937374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.937904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1977051607` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.939183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1977051607)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.942346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:00.946178 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2500/4970] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 10:11:00 2022] GET /identity/v3/regions/tempest-region-1977051607 => generated 180 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:00.951151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:00.969579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3d43d-9c7d-456c-b80a-1eb88f5a129d tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:00.978745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:00.979734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:00.980230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:00.980737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/8bf10208324a4f91bd34e332e7779dda` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:00.990150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8bf10208324a4f91bd34e332e7779dda)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:00.992120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.006300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8bf10208324a4f91bd34e332e7779dda', 'request_id': 'req-02d772ff-4387-4077-ba29-3966f6c443d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:01.018997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2471/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:00 2022] DELETE /identity/v3/endpoints/8bf10208324a4f91bd34e332e7779dda => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.022451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.034010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1b7bf-ff68-44ac-9126-516cdfed7ed1 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.056471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.057556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.058055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.059344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1977051607` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.060298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1977051607)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.073754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.096824 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1977051607. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:01.096824 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:01.096824 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:01.111040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2501/4972] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/regions/tempest-region-1977051607 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.114412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.127889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d772ff-4387-4077-ba29-3966f6c443d3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.161892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.162780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.163312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.163780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1360543839` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.164597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1360543839)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.167190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.195038 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2472/4973] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/regions/tempest-region-1360543839 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.199338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.226799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1909d3-a9af-4321-adf1-cb97f6b6cb2b tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.251491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.252283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.252983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.253843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services/9baf05bb050e4c84b7aeaa849a2f4f3c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.254746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9baf05bb050e4c84b7aeaa849a2f4f3c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.260136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.312046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2502/4974] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/services/9baf05bb050e4c84b7aeaa849a2f4f3c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.317184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.328858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db06a-8052-4870-97f7-37bf5b9ab1ec tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.348544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.349235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.349512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.349779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/af329f776ece40b6b6a15e8805626100` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.357456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=af329f776ece40b6b6a15e8805626100)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.359869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.374796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'af329f776ece40b6b6a15e8805626100', 'request_id': 'req-e8a59d57-1157-4b4e-85b2-a2767b846d2a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:01.393324 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2473/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/endpoints/af329f776ece40b6b6a15e8805626100 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.394724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.413233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94549-b3b6-40a2-8621-987c33d55d83 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.441070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.441795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.442077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.442353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-1675265289` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.443644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1675265289)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.445388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.459993 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1675265289. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:01.459993 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:01.459993 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:01.469701 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2503/4976] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/regions/tempest-region-1675265289 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.474660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.486348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59d57-1157-4b4e-85b2-a2767b846d2a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.504537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.505214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.505493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.505758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services/8dc3693f4a0640339b545e669bfdc4ea` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.506343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8dc3693f4a0640339b545e669bfdc4ea)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.508059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.545167 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2474/4977] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/services/8dc3693f4a0640339b545e669bfdc4ea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:01.548374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.576555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d6c44-7e04-4b9a-8dd3-a1c506403af3 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.614543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.615487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.615984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.616450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/endpoints/e3db2f707f91493e8c402a78f5aff1f2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.626564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e3db2f707f91493e8c402a78f5aff1f2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.628108 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:01.628108 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:11:01.628108 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:11:01.629434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.645959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e3db2f707f91493e8c402a78f5aff1f2', 'request_id': 'req-4b125391-ceae-4639-9db9-1533e77afc9a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:01.671100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2504/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/endpoints/e3db2f707f91493e8c402a78f5aff1f2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.675011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.690852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c461d7-a637-4375-bdee-3a907c2bd2e5 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.735565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.736400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.736686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.736988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/regions/tempest-region-44652864` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.737581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-44652864)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.739996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.772328 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-44652864. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:11:01.772328 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:11:01.772328 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:01.787344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2475/4979] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/regions/tempest-region-44652864 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.791987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:01.803998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125391-ceae-4639-9db9-1533e77afc9a tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:01.872351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15a65d5c1b37450cb5f0257aa6ec960f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87f537469667469788436c36559efe98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:01.875244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:01.875554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:01.875839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] PATH_INFO: `/v3/services/0004119c931a4e0c8c3873354d70174b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:01.876461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0004119c931a4e0c8c3873354d70174b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:01.882258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad964860-e954-486c-bf93-58c1e44327c6 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:01.922430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2505/4980] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/services/0004119c931a4e0c8c3873354d70174b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:01.927836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:02.017927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:02.073627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315d449-c56c-4c30-b2a8-a6f885346ed4 tempest-EndPointsTestJSON-1130389980 tempest-EndPointsTestJSON-1130389980-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:02.106959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:02.107615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:02.111159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:02.111597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] PATH_INFO: `/v3/users/fefb64497cab4627ae5588755323005f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:02.114231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefb64497cab4627ae5588755323005f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:02.116658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:02.224108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefb64497cab4627ae5588755323005f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:02.225284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefb64497cab4627ae5588755323005f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:02.226205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefb64497cab4627ae5588755323005f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:02.238698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefb64497cab4627ae5588755323005f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:02.256258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefb64497cab4627ae5588755323005f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:02.289673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2476/4981] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:01 2022] DELETE /identity/v3/users/fefb64497cab4627ae5588755323005f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:02.297769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41cb4d-70f0-4de8-ab4b-53a5b51eda99 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:02.298075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41cb4d-70f0-4de8-ab4b-53a5b51eda99 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:02.298332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41cb4d-70f0-4de8-ab4b-53a5b51eda99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:02.321888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:02.351616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6c41cb4d-70f0-4de8-ab4b-53a5b51eda99 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:02.354021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6c41cb4d-70f0-4de8-ab4b-53a5b51eda99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:02.468393 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2506/4982] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:02.522227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:02.523930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:02.640197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883e50-634e-42f5-8508-4b38c6113bcf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:02.647819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:02.648839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:02.649210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:02.649656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:02.661068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:02.662655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739f66-a7dd-45f9-a75b-599ae37368d5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:02.675671 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2477/4983] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:04.442117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:04.443051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:04.443972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:04.515961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:04.519262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:04.675331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2507/4984] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:04.686185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:04.686703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:04.686703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:04.718424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:04.719662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:04.743601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2478/4985] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:04.866677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:04.868663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:04.981937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:04.983434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:05.019826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a99b9-974c-4fde-a0ec-a1f894ddc0db None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:05.024771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:05.025361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:05.025641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:05.025913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] PATH_INFO: `/v3/projects/d1a43d22d6be44b890bf5169077e58df` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:05.030737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a43d22d6be44b890bf5169077e58df)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:05.032679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:05.042962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53ce4-c116-47cd-8ff1-0f32ed9e01ea None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:05.060806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:05.061475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:05.061756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:05.062018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:05.065445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:05.079448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:05.107270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:05.109329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:05.138205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2508/4986] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:05.146075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a43d22d6be44b890bf5169077e58df', 'request_id': 'req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.155454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:05.157307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:05.168809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a43d22d6be44b890bf5169077e58df', 'request_id': 'req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.178933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a43d22d6be44b890bf5169077e58df', 'request_id': 'req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.185653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba249bc1-1cab-459c-9848-33646c89b47d service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:05.193181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:05.199035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] The token cache is being invalidate because project d1a43d22d6be44b890bf5169077e58df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:05.199318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.199999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.205060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2479/4987] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:04 2022] DELETE /identity/v3/projects/d1a43d22d6be44b890bf5169077e58df => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:05.206148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:05.209977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:05.329689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:05.330884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:05.331183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:05.331440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:05.336245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:05.342636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c60a3-f2d2-4bf4-ad1c-3ec2aca581f9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:05.351253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:05.351908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:05.352722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:05.353026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] PATH_INFO: `/v3/users/15a65d5c1b37450cb5f0257aa6ec960f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:05.361908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a65d5c1b37450cb5f0257aa6ec960f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:05.363797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:05.452304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a65d5c1b37450cb5f0257aa6ec960f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.453095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a65d5c1b37450cb5f0257aa6ec960f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.453726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a65d5c1b37450cb5f0257aa6ec960f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.467831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a65d5c1b37450cb5f0257aa6ec960f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.475246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:05.476626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f50a0a7-9992-42b2-8ccc-4c50009ad0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a65d5c1b37450cb5f0257aa6ec960f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:05.478673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:05.504002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2509/4988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:11:05.536082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2480/4989] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:05 2022] DELETE /identity/v3/users/15a65d5c1b37450cb5f0257aa6ec960f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:06.629065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:06.651456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64be08-73cd-4f76-a440-9211fe81625c service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:06.775897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:06.776833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:06.777603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:06.778062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] PATH_INFO: `/v3/projects/87f537469667469788436c36559efe98` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:06.779777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f537469667469788436c36559efe98)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:06.782385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:06.888413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:06.890257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f537469667469788436c36559efe98', 'request_id': 'req-c502697c-24f2-4e26-806c-0026573c2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:06.922340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f537469667469788436c36559efe98', 'request_id': 'req-c502697c-24f2-4e26-806c-0026573c2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:06.934895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f537469667469788436c36559efe98', 'request_id': 'req-c502697c-24f2-4e26-806c-0026573c2ad3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:06.955103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] The token cache is being invalidate because project 87f537469667469788436c36559efe98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:06.955553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:06.956422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c502697c-24f2-4e26-806c-0026573c2ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:06.962989 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2510/4990] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:06 2022] DELETE /identity/v3/projects/87f537469667469788436c36559efe98 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:06.964116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:06.964602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:06.964602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.018270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:07.019766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:07.049741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:07.135905 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2481/4991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:07.144418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.144723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.145071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.178754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:07.180087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:07.224257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2511/4992] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:07.226616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.248663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8322-e225-4e51-a547-52b2b9fdc92b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.263178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.263691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.263976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.264250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.264927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:07.265477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:07.269131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:07.312757 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2482/4993] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:07.317104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.333321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341ded-3131-41c8-9db8-839b977713c8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.348396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.349059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.349476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.349760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.352252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:07.354270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:07.423605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2512/4994] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:07 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:07.425080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.444156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eb09-34f5-4ca8-a456-59c2714e4769 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.712562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.713171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.713458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.713746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.714377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:07.716385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:07.767230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2483/4995] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:07 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:07.772053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.794207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f196a-7f88-4b50-8483-59bdf9993d78 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.816387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.817318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.817792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.818242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.819509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:07.823961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:07.863606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2513/4996] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:07.865527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.879190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364705e-5e36-4f45-9c79-a238d4fbe523 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.908224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.908860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.909263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.909430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:07.910053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:07.911659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524b489-348f-453c-aee8-0fba1d56efdd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:07.958131 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2484/4997] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:11:07.958751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:07.974570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c327-a921-44db-b7fa-3ddb79fe778a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:07.993127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:07.993836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:07.994098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:07.994452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] PATH_INFO: `/v3/projects/4ef7157e960d4886b82c2e95807ff0fd/users/7b1608ed771549109fed02cdc5d3d43e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:08.055315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef7157e960d4886b82c2e95807ff0fd, user_id=7b1608ed771549109fed02cdc5d3d43e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:08.058052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:08.098277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2514/4998] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:07 2022] PUT /identity/v3/projects/4ef7157e960d4886b82c2e95807ff0fd/users/7b1608ed771549109fed02cdc5d3d43e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:08.101011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:08.101481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:08.101481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:08.183608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] MFA Rules not processed for user `7b1608ed771549109fed02cdc5d3d43e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:08.185997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:08.467118 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2485/4999] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:08.468743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:08.686772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356deb-1292-4305-a61f-6a6ea7a3bd1b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:08.693305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:08.693986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:08.694269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:08.694546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:08.695179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:08.697280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:08.751345 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2515/5000] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:08 2022] POST /identity/v3/projects => generated 367 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:08.755173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:08.772308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf40f9-dfe4-44e0-99fa-f11ecb8a1968 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:08.820305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:08.879456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:08.880322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:08.881230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:08.881682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:08.882523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:08.886252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:08.946697 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2486/5001] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:08 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:08.951632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.004422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f116-5769-4e76-a412-dd60ac453601 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:09.043702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:09.045323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.048508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.048508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.049618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:09.051367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:09.081566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2516/5002] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:09.085664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.106006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f67ca-16d1-404e-b4dc-2c6b1889c398 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:09.121535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:09.122379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.122768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.123140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] PATH_INFO: `/v3/projects/27450439001f48bc8686dea261b6753b/users/04befc7ae957446d91e9102684341fde/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.175088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=27450439001f48bc8686dea261b6753b, user_id=04befc7ae957446d91e9102684341fde, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:09.177968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:09.223250 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2487/5003] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:09 2022] PUT /identity/v3/projects/27450439001f48bc8686dea261b6753b/users/04befc7ae957446d91e9102684341fde/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:09.227323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.263812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bc48-06cb-4a38-bb77-ae8ebd14e541 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:09.380849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:09.409936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:09.410565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.410835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.411107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.411969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:09.413755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd10a2-52f8-4a78-9cfd-e27687c2973e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:09.443474 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2517/5004] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:09.445267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.457987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1e6f-5ecd-4d71-91cf-f9bebd466cee admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:09.495754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:09.496440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.496714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.498305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] PATH_INFO: `/v3/projects/27450439001f48bc8686dea261b6753b/users/04befc7ae957446d91e9102684341fde/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.501842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27450439001f48bc8686dea261b6753b, user_id=04befc7ae957446d91e9102684341fde, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:09.504546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:09.538683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2488/5005] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:09 2022] PUT /identity/v3/projects/27450439001f48bc8686dea261b6753b/users/04befc7ae957446d91e9102684341fde/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:09.549012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.549341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.549573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.615507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] MFA Rules not processed for user `04befc7ae957446d91e9102684341fde`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:09.617482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:09.775985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2518/5006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:09.780932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.796508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b24f7c-902b-43fd-9098-17b19ab6e73f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:09.809347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:09.810255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:09.811428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:09.811883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:09.812715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:09.815094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:09.862328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2489/5007] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:09 2022] POST /identity/v3/projects => generated 328 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:09.866283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:09.880301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e0d5-2539-4aa1-8f1c-d51e521ec404 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.008434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.009747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.010028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.010303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.011018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.015723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.075105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2519/5008] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:09 2022] POST /identity/v3/users => generated 416 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:10.078235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.092535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72406414-d1bb-418c-b76e-0f129a32c377 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.105465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.106090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.106637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.106637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.107279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.108866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.138413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.160368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfeb6-dbc3-4368-82a8-1a1999fe6787 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.161063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2490/5009] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:10 2022] POST /identity/v3/roles => generated 243 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:10.176228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.176856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.177157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.177422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.178547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.181983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.210181 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2520/5010] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:10 2022] POST /identity/v3/roles => generated 245 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:10.214358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.240946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76050862-9513-4fe6-87d7-2a5d5594117d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.266523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.267540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.267958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.268391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/6a485d0f79d948cca60edc0a19aaf25b/users/c21ddffd694d48fab3e46897f7835f07/roles/4dc972c5c5bd4663bf41bc8e3610b1e2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.285873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6a485d0f79d948cca60edc0a19aaf25b, user_id=c21ddffd694d48fab3e46897f7835f07, role_id=4dc972c5c5bd4663bf41bc8e3610b1e2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.289204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.307500 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2491/5011] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:10 2022] PUT /identity/v3/projects/6a485d0f79d948cca60edc0a19aaf25b/users/c21ddffd694d48fab3e46897f7835f07/roles/4dc972c5c5bd4663bf41bc8e3610b1e2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:10.311560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.322686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb582397-27e0-44c3-8b79-f545eb798c83 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.371999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:10.391424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.392249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.392589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.392849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/6a485d0f79d948cca60edc0a19aaf25b/users/c21ddffd694d48fab3e46897f7835f07/roles/cb15604cfc6d4b35aea8b774d6255029` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.396351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6a485d0f79d948cca60edc0a19aaf25b, user_id=c21ddffd694d48fab3e46897f7835f07, role_id=cb15604cfc6d4b35aea8b774d6255029)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.400017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea2c-33f8-4692-a7fb-7a4cf7585fbb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.421589 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2521/5012] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:10 2022] PUT /identity/v3/projects/6a485d0f79d948cca60edc0a19aaf25b/users/c21ddffd694d48fab3e46897f7835f07/roles/cb15604cfc6d4b35aea8b774d6255029 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:10.423167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.436681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bacc0-0760-4771-9035-9a7397b917d3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.512276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.513155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.513641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.514060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.514865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.518536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145f395-8425-4029-8357-07796c512e3d tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:10.580963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.581262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.581541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.587065 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2492/5013] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:10 2022] GET /identity/v3/users => generated 8907 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:11:10.639360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] MFA Rules not processed for user `c21ddffd694d48fab3e46897f7835f07`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:10.641778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:10.803751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2522/5014] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:10.806582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.807123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.807594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.858195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] MFA Rules not processed for user `c21ddffd694d48fab3e46897f7835f07`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:10.867082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:10.879439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2493/5015] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:10.884273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:10.902851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ef52-5c7f-4909-b003-733a0079f882 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:10.911248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21ddffd694d48fab3e46897f7835f07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a485d0f79d948cca60edc0a19aaf25b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-293236509', 'tempest-NotDelegatedRole-92231523'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:10.912084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:10.912458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:10.912841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:10.913700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: Authorizing `identity:create_trust()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:10.915039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.099178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.103182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2523/5016] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:10 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:11.107581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:11.113890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f3784-9ebb-4553-b544-5891f5aedf22 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.123908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.125095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.125707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.126131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.127555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:11.129640 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:11:11.129640 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:11:11.129640 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:11:11.131263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.145856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.158398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2494/5017] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 10:11:11 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:11.158935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fb7d-271f-4d82-a64c-5fbef5be8700 tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.163827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21ddffd694d48fab3e46897f7835f07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a485d0f79d948cca60edc0a19aaf25b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-293236509', 'tempest-NotDelegatedRole-92231523'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.165319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.165763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.166942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] PATH_INFO: `/v3/OS-TRUST/trusts/bfeb6075482a4e7caf4dcbe992e8f9e3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.184026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: Authorizing `identity:delete_trust(trust_id=bfeb6075482a4e7caf4dcbe992e8f9e3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:11.186123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.217280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bfeb6075482a4e7caf4dcbe992e8f9e3', 'request_id': 'req-a4f7aaea-10b3-43a6-8f49-d08832dab97e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.218597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bfeb6075482a4e7caf4dcbe992e8f9e3', 'request_id': 'req-a4f7aaea-10b3-43a6-8f49-d08832dab97e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.219587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bfeb6075482a4e7caf4dcbe992e8f9e3', 'request_id': 'req-a4f7aaea-10b3-43a6-8f49-d08832dab97e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.245842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.246661 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2524/5018] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:11:11 2022] DELETE /identity/v3/OS-TRUST/trusts/bfeb6075482a4e7caf4dcbe992e8f9e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:11.247731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:11.271662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa2013-97a3-4598-acc8-c2d07ac172ad tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.277879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21ddffd694d48fab3e46897f7835f07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a485d0f79d948cca60edc0a19aaf25b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-293236509', 'tempest-NotDelegatedRole-92231523'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.278638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.278976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.279296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] PATH_INFO: `/v3/OS-TRUST/trusts/bfeb6075482a4e7caf4dcbe992e8f9e3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Could not find trust: bfeb6075482a4e7caf4dcbe992e8f9e3.: keystone.exception.TrustNotFound: Could not find trust: bfeb6075482a4e7caf4dcbe992e8f9e3. Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 28 10:11:11.322329 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bfeb6075482a4e7caf4dcbe992e8f9e3. Oct 28 10:11:11.323427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:11.327334 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2495/5019] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:11 2022] GET /identity/v3/OS-TRUST/trusts/bfeb6075482a4e7caf4dcbe992e8f9e3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:11.328554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.330225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:11.356034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7aaea-10b3-43a6-8f49-d08832dab97e tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.364576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.365624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.365911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.366269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/cb15604cfc6d4b35aea8b774d6255029` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.368513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cb15604cfc6d4b35aea8b774d6255029)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:11.370553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.377684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:11.440084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role cb15604cfc6d4b35aea8b774d6255029 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:11.440384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.443678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.446189 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2525/5020] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:11 2022] DELETE /identity/v3/roles/cb15604cfc6d4b35aea8b774d6255029 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:11.450016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.451939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:11.471773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c89d-9273-44da-a1ac-5cb7a9f4e1ab tempest-TrustsV3TestJSON-885218507 tempest-user-1360159615] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.590824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.591849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.593304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.593304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/4dc972c5c5bd4663bf41bc8e3610b1e2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.597459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4dc972c5c5bd4663bf41bc8e3610b1e2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:11.599282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.684554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 4dc972c5c5bd4663bf41bc8e3610b1e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:11.684985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.686416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.688653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2496/5021] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:11 2022] DELETE /identity/v3/roles/4dc972c5c5bd4663bf41bc8e3610b1e2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:11.694154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:11.711128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056bac7-01b4-42f5-ba0d-1c321a2da21b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:11.855458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:11.858979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:11.861356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:11.862055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/c21ddffd694d48fab3e46897f7835f07` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:11.865692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c21ddffd694d48fab3e46897f7835f07)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:11.875958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:11.975116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21ddffd694d48fab3e46897f7835f07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.979050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21ddffd694d48fab3e46897f7835f07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:11.999636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21ddffd694d48fab3e46897f7835f07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.020091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21ddffd694d48fab3e46897f7835f07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.022295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21ddffd694d48fab3e46897f7835f07'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.046722 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2526/5022] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:11 2022] DELETE /identity/v3/users/c21ddffd694d48fab3e46897f7835f07 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:12.051395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.053006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:12.097126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e876-d041-4318-bc92-3f900b3225a2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.174381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.175231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.175579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.175780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/6a485d0f79d948cca60edc0a19aaf25b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.177286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a485d0f79d948cca60edc0a19aaf25b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.180860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.261397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a485d0f79d948cca60edc0a19aaf25b', 'request_id': 'req-040da5ae-a0fd-4a48-851b-bd238ac45152'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.264452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:12.278147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a485d0f79d948cca60edc0a19aaf25b', 'request_id': 'req-040da5ae-a0fd-4a48-851b-bd238ac45152'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.288466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a485d0f79d948cca60edc0a19aaf25b', 'request_id': 'req-040da5ae-a0fd-4a48-851b-bd238ac45152'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.306305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project 6a485d0f79d948cca60edc0a19aaf25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:12.312069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.313067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:12.319686 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2497/5023] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:12 2022] DELETE /identity/v3/projects/6a485d0f79d948cca60edc0a19aaf25b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:12.322435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.324093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:12.339202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702cd7-ddf0-4035-b8a0-847ba8fba9cc tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.410756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:12.434329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.434809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.435094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.435366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.436120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.438308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.475637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2527/5024] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:12 2022] POST /identity/v3/projects => generated 329 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:12.480081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.481706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:12.505991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da5ae-a0fd-4a48-851b-bd238ac45152 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.616761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.618201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.618389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.618812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.619611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.622342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.651948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2498/5025] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:12 2022] POST /identity/v3/users => generated 413 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:12.655791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.669965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813cbb4-a7ad-44ae-8208-bd5e3735ed76 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.689207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.689842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.690127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.690402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.691075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.692691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.731115 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2528/5026] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:12 2022] POST /identity/v3/roles => generated 243 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:12.732252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.747470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d19d9-89a6-4e80-a9a6-1cd14e27fe34 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.753120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.754492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.754941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.755387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.756240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.758052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.781831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2499/5027] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:12 2022] POST /identity/v3/roles => generated 247 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:12.786993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.800773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff84cdf-b08c-49e1-9ce6-94e1128c50f0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.807013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.807948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.808231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.808653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/ca5ded5b56c74729b137f3d454b43d5e/users/01a8adaa9d8f42b0808d258fb21f32d3/roles/7b11861f623745fc8f22e6ce1d9cb075` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.831054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ca5ded5b56c74729b137f3d454b43d5e, user_id=01a8adaa9d8f42b0808d258fb21f32d3, role_id=7b11861f623745fc8f22e6ce1d9cb075)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.834279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:12.857159 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2529/5028] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:12 2022] PUT /identity/v3/projects/ca5ded5b56c74729b137f3d454b43d5e/users/01a8adaa9d8f42b0808d258fb21f32d3/roles/7b11861f623745fc8f22e6ce1d9cb075 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:12.861618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:12.877095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a133-c886-4ff3-ab6f-7953918c9bc9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:12.964707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:12.965428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:12.965709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:12.965985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/ca5ded5b56c74729b137f3d454b43d5e/users/01a8adaa9d8f42b0808d258fb21f32d3/roles/9a88a57c68724850a1c7ed5f6aeddbbe` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:12.968809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ca5ded5b56c74729b137f3d454b43d5e, user_id=01a8adaa9d8f42b0808d258fb21f32d3, role_id=9a88a57c68724850a1c7ed5f6aeddbbe)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:12.986114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a8da-854b-4d51-b32e-9fc06ec0dd61 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.003205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2500/5029] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:12 2022] PUT /identity/v3/projects/ca5ded5b56c74729b137f3d454b43d5e/users/01a8adaa9d8f42b0808d258fb21f32d3/roles/9a88a57c68724850a1c7ed5f6aeddbbe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:13.006892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.019356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b2e-a5d4-4b03-9baa-29f27a6e3f62 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.095997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.096620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.096921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.097249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.097920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:13.100009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0a3b-9d1e-4de1-bd53-3b39450a42ba tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.142298 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2530/5030] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:13 2022] GET /identity/v3/users => generated 8904 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:13.147499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.147499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.147791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.238198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] MFA Rules not processed for user `01a8adaa9d8f42b0808d258fb21f32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:13.240305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:13.288061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:13.342344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2501/5031] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:13.352648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.353159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.353250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.376210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] MFA Rules not processed for user `01a8adaa9d8f42b0808d258fb21f32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:13.377572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:13.392145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2531/5032] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:13.393490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.411405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a013b-90ff-402b-a6bc-5d592a47cd44 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.417243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a8adaa9d8f42b0808d258fb21f32d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca5ded5b56c74729b137f3d454b43d5e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1910664337', 'tempest-DelegatedRole-674554711'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.419880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.420268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.420628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.421413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorizing `identity:create_trust()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:13.422650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.583170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.585341 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2502/5033] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:13.595327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aed2b-56df-4078-83af-3f4bd42d6aa9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.610550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a8adaa9d8f42b0808d258fb21f32d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca5ded5b56c74729b137f3d454b43d5e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1910664337', 'tempest-DelegatedRole-674554711'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.611129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.611407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.611721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.612324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:13.614289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.636173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2532/5034] 10.222.0.16 () {58 vars in 1252 bytes} [Fri Oct 28 10:11:13 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=01a8adaa9d8f42b0808d258fb21f32d3 => generated 611 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:13.640873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.654289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04ae7-d8bb-465b-9a06-3e8934beb2cc tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.660167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a8adaa9d8f42b0808d258fb21f32d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca5ded5b56c74729b137f3d454b43d5e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1910664337', 'tempest-DelegatedRole-674554711'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.660834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.661144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.661421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] PATH_INFO: `/v3/OS-TRUST/trusts/4c0c4886a127479fb4495362711669bf` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.671496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorizing `identity:delete_trust(trust_id=4c0c4886a127479fb4495362711669bf)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:13.673259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.702125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4c0c4886a127479fb4495362711669bf', 'request_id': 'req-7111c19c-7b4e-4673-b94e-f3360cd03f50'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:13.703918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4c0c4886a127479fb4495362711669bf', 'request_id': 'req-7111c19c-7b4e-4673-b94e-f3360cd03f50'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:13.704939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4c0c4886a127479fb4495362711669bf', 'request_id': 'req-7111c19c-7b4e-4673-b94e-f3360cd03f50'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:13.736178 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2503/5035] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:11:13 2022] DELETE /identity/v3/OS-TRUST/trusts/4c0c4886a127479fb4495362711669bf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:13.738330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.740342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:13.763073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f6a7-67d0-4ecf-9cef-5bf4a406f892 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.771757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a8adaa9d8f42b0808d258fb21f32d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca5ded5b56c74729b137f3d454b43d5e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1910664337', 'tempest-DelegatedRole-674554711'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.773446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.774191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.774808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] PATH_INFO: `/v3/OS-TRUST/trusts/4c0c4886a127479fb4495362711669bf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Could not find trust: 4c0c4886a127479fb4495362711669bf.: keystone.exception.TrustNotFound: Could not find trust: 4c0c4886a127479fb4495362711669bf. Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 28 10:11:13.793333 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4c0c4886a127479fb4495362711669bf. Oct 28 10:11:13.795282 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:13.797064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2533/5036] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:13 2022] GET /identity/v3/OS-TRUST/trusts/4c0c4886a127479fb4495362711669bf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:13.797778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.799218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:13.820449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c19c-7b4e-4673-b94e-f3360cd03f50 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:13.827271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:13.827974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:13.828247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:13.828512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/9a88a57c68724850a1c7ed5f6aeddbbe` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:13.830446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9a88a57c68724850a1c7ed5f6aeddbbe)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:13.832196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:13.907212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 9a88a57c68724850a1c7ed5f6aeddbbe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:13.907809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:13.908828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:13.912357 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2504/5037] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:13 2022] DELETE /identity/v3/roles/9a88a57c68724850a1c7ed5f6aeddbbe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:13.916945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:13.918857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:13.947305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793fc9-c1ab-41aa-8139-9b25e6746bf2 tempest-TrustsV3TestJSON-1989204398 tempest-user-592527429] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:14.101910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:14.102687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.103032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.103369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/7b11861f623745fc8f22e6ce1d9cb075` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:14.104932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b11861f623745fc8f22e6ce1d9cb075)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:14.106626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:14.118545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:14.168460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 7b11861f623745fc8f22e6ce1d9cb075 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:14.168845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.170296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.176627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2534/5038] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:13 2022] DELETE /identity/v3/roles/7b11861f623745fc8f22e6ce1d9cb075 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:14.177580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:14.195144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114613e-3da0-4d8e-8000-d11eab8af5b5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:14.245743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:14.267164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:14.268022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.268377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.268724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/01a8adaa9d8f42b0808d258fb21f32d3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:14.270243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01a8adaa9d8f42b0808d258fb21f32d3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:14.272476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:14.328289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a8adaa9d8f42b0808d258fb21f32d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.329440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a8adaa9d8f42b0808d258fb21f32d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.330537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a8adaa9d8f42b0808d258fb21f32d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.340589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a8adaa9d8f42b0808d258fb21f32d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.350190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a8adaa9d8f42b0808d258fb21f32d3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.379701 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2505/5039] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:14 2022] DELETE /identity/v3/users/01a8adaa9d8f42b0808d258fb21f32d3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:14.384259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:14.385959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:14.403025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846cd3-b97f-4c3b-9417-ee5a05574e68 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:14.487006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:14.487823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.488115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.488380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/ca5ded5b56c74729b137f3d454b43d5e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:14.489525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca5ded5b56c74729b137f3d454b43d5e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:14.491504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:14.562033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5ded5b56c74729b137f3d454b43d5e', 'request_id': 'req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.569964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5ded5b56c74729b137f3d454b43d5e', 'request_id': 'req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.579486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5ded5b56c74729b137f3d454b43d5e', 'request_id': 'req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.603219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project ca5ded5b56c74729b137f3d454b43d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:14.603628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.604419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66c5a5a4-f3d4-4982-b96f-9a55451ecb0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:14.606346 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2535/5040] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:14 2022] DELETE /identity/v3/projects/ca5ded5b56c74729b137f3d454b43d5e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:14.612400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:14.615464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:14.639160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71dfdd-d2ee-4563-b33d-7225430c5298 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:14.694961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.695245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.695547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:14.730513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] MFA Rules not processed for user `f4dc1824197d40e58d0dfdc8f55ab72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:14.732055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:14.763160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:14.763425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.763659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.763941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:14.764884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:14.767425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:14.808970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2506/5041] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:14 2022] POST /identity/v3/projects => generated 329 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:14.813245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:14.819911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:14.871280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:14.898102 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2536/5042] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:14.947935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:14.980118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310987d7-7ed2-4914-b073-fceff00ba690 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:14.996593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:14.997273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:14.997609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:14.997973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.001248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.010081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.062947 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2507/5043] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:14 2022] POST /identity/v3/users => generated 416 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:15.063667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.090196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc9b10-04c3-4b8f-9c58-c7638c81c71f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.103947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.104580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.104860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.105181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.105860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.107501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.134833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2537/5044] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:15 2022] POST /identity/v3/roles => generated 243 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:15.138771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.158164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857024-4237-4562-902d-a6a27d807d4e tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.165021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.166162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.166162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.166631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.167429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.170028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.198195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2508/5045] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:15 2022] POST /identity/v3/roles => generated 247 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:15.199109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.212155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef238-2799-4161-a2d9-16883960a515 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.228015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.228876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.229345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.229460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/d068c802f1654006aad48b79b97731b5/users/6b59f144ad544920a0924f6d47b73af1/roles/141778e4c305417aa9f09906179c984e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.259736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d068c802f1654006aad48b79b97731b5, user_id=6b59f144ad544920a0924f6d47b73af1, role_id=141778e4c305417aa9f09906179c984e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.262432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.293784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.297324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2538/5046] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:15 2022] PUT /identity/v3/projects/d068c802f1654006aad48b79b97731b5/users/6b59f144ad544920a0924f6d47b73af1/roles/141778e4c305417aa9f09906179c984e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:15.306309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f260-615b-47b1-8dcc-b8a125efbd7b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.440382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.444635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.444933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.445202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/d068c802f1654006aad48b79b97731b5/users/6b59f144ad544920a0924f6d47b73af1/roles/5eeeea4340174881a7dd9425d57fe103` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.463051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d068c802f1654006aad48b79b97731b5, user_id=6b59f144ad544920a0924f6d47b73af1, role_id=5eeeea4340174881a7dd9425d57fe103)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.466023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2699cf-66fb-4941-bb13-bab306ed4781 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.490005 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2509/5047] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:15 2022] PUT /identity/v3/projects/d068c802f1654006aad48b79b97731b5/users/6b59f144ad544920a0924f6d47b73af1/roles/5eeeea4340174881a7dd9425d57fe103 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:15.491416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.505562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c482f5-4183-467a-a24c-80cb9fecc8cb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.614889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.616174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.616711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.616977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.618464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.621848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1448d7-3b7c-43e2-b364-894c9a602e46 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.678272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2539/5048] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:15 2022] GET /identity/v3/users => generated 8907 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:15.683418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.683952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.684235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.741941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] MFA Rules not processed for user `6b59f144ad544920a0924f6d47b73af1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:15.744200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:15.832933 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2510/5049] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:15.842468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.842775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.843048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.870218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] MFA Rules not processed for user `6b59f144ad544920a0924f6d47b73af1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:15.871920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:15.886215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:15.886417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2540/5050] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:15.902022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed314-fe2e-43a8-965f-e181670fb544 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:15.906393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:15.907019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:15.907428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:15.907705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:15.908369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:create_trust()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:15.909664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:15.956932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:16.003402 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2511/5051] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:16.017478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.018953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650285f-2038-43a1-9b76-9133b00ae5fa None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.028762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.029757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.030051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.030299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.041512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:get_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.045871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.061807 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2541/5052] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a => generated 858 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:16.066052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.093432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a322bc-4540-4e67-9381-0840e5f99ff4 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.097980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.098645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.098929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.099202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.108398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.110709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.122654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2512/5053] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:16.126245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.140836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b253d-4f9f-4fd9-9fd0-28e5faeb79a1 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.146358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.147140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.147521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.147918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/141778e4c305417aa9f09906179c984e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.155978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a, role_id=141778e4c305417aa9f09906179c984e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.157665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.167992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2542/5054] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/141778e4c305417aa9f09906179c984e => generated 243 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:16.173436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.184950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281186e9-bf0d-496b-8298-424ad56742b8 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.191369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.192092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.192485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.193093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/141778e4c305417aa9f09906179c984e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.201483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a, role_id=141778e4c305417aa9f09906179c984e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.203392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.216124 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2513/5055] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:16 2022] HEAD /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/141778e4c305417aa9f09906179c984e => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 28 10:11:16.221130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.237195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f123-0a60-46eb-93e9-a498786a08c2 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.243078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.243825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.244112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.244511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/5eeeea4340174881a7dd9425d57fe103` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.252479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a, role_id=5eeeea4340174881a7dd9425d57fe103)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.254060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Could not find role: 5eeeea4340174881a7dd9425d57fe103.: keystone.exception.RoleNotFound: Could not find role: 5eeeea4340174881a7dd9425d57fe103. Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:16.267564 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5eeeea4340174881a7dd9425d57fe103. Oct 28 10:11:16.268691 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:16.272776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2543/5056] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/5eeeea4340174881a7dd9425d57fe103 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:16.274796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.302580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c659e-58db-42e8-a585-3ed8f5fa884e tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.318051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.322300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.323216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.323619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/5eeeea4340174881a7dd9425d57fe103` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.337874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a, role_id=5eeeea4340174881a7dd9425d57fe103)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.339696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Could not find role: 5eeeea4340174881a7dd9425d57fe103.: keystone.exception.RoleNotFound: Could not find role: 5eeeea4340174881a7dd9425d57fe103. Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:16.352205 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5eeeea4340174881a7dd9425d57fe103. Oct 28 10:11:16.353254 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:16.355220 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2514/5057] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:16 2022] HEAD /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a/roles/5eeeea4340174881a7dd9425d57fe103 => generated 0 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 28 10:11:16.359503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.371915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651f31-5d04-4a96-b027-c4210e5181ab tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.373626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.377708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:16.386841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.387492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.387771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.388043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.408542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorizing `identity:delete_trust(trust_id=b14ebdcd0e6f4498adb6b99109f4002a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.410576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.452337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b14ebdcd0e6f4498adb6b99109f4002a', 'request_id': 'req-fdb18b89-ca24-40db-9bd3-84adfd13b961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:16.453335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b14ebdcd0e6f4498adb6b99109f4002a', 'request_id': 'req-fdb18b89-ca24-40db-9bd3-84adfd13b961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:16.454449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b14ebdcd0e6f4498adb6b99109f4002a', 'request_id': 'req-fdb18b89-ca24-40db-9bd3-84adfd13b961'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:16.503821 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2544/5058] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:11:16 2022] DELETE /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:16.510169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.526877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:16.579951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18b89-ca24-40db-9bd3-84adfd13b961 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.592282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b59f144ad544920a0924f6d47b73af1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd068c802f1654006aad48b79b97731b5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-551904923', 'tempest-NotDelegatedRole-1993480520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.593179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.593607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.594084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] PATH_INFO: `/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Could not find trust: b14ebdcd0e6f4498adb6b99109f4002a.: keystone.exception.TrustNotFound: Could not find trust: b14ebdcd0e6f4498adb6b99109f4002a. Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 28 10:11:16.608891 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b14ebdcd0e6f4498adb6b99109f4002a. Oct 28 10:11:16.610505 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:16.620226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2545/5059] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/OS-TRUST/trusts/b14ebdcd0e6f4498adb6b99109f4002a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:16.626406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.632173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:16.652201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efba40-ac58-4274-9ec7-5686fb37cff7 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.660352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.661100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.661444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.661868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.666278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:16.671612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c152-a4f3-48e8-968a-0d66a5785a84 tempest-TrustsV3TestJSON-2007426002 tempest-user-1933237518] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:16.681330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:16.681978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:16.682260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:16.682535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/5eeeea4340174881a7dd9425d57fe103` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:16.687143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5eeeea4340174881a7dd9425d57fe103)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.689376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.692182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:16.694932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:16.696569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:16.716970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2515/5060] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:16.799425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 5eeeea4340174881a7dd9425d57fe103 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:16.799730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:16.800571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:16.802529 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2546/5061] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:16 2022] DELETE /identity/v3/roles/5eeeea4340174881a7dd9425d57fe103 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:16.806816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:16.820160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b567-9eff-44c8-9e27-75f692617daf service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:17.006756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:17.027587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:17.028231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:17.028511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:17.028782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/141778e4c305417aa9f09906179c984e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:17.030234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=141778e4c305417aa9f09906179c984e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:17.031833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:17.114203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 141778e4c305417aa9f09906179c984e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:17.115195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.119279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.121563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2516/5062] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:16 2022] DELETE /identity/v3/roles/141778e4c305417aa9f09906179c984e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:17.125497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:17.127059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:17.146453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2806a-8ac3-4371-9ee0-41d5d9e0328b tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:17.229413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:17.240245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:17.240245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:17.240245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/6b59f144ad544920a0924f6d47b73af1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:17.240245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6b59f144ad544920a0924f6d47b73af1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:17.240245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:17.288230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b59f144ad544920a0924f6d47b73af1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.289263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b59f144ad544920a0924f6d47b73af1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.299785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b59f144ad544920a0924f6d47b73af1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.310034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b59f144ad544920a0924f6d47b73af1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.310827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b59f144ad544920a0924f6d47b73af1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.335447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2547/5063] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:17 2022] DELETE /identity/v3/users/6b59f144ad544920a0924f6d47b73af1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:17.337506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:17.339147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:17.359228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36d49a-5542-403b-9184-8bec7ec8c4b3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:17.458605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:17.459551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:17.459996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:17.460430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/d068c802f1654006aad48b79b97731b5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:17.462207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d068c802f1654006aad48b79b97731b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:17.467399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:17.545684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd068c802f1654006aad48b79b97731b5', 'request_id': 'req-8235b2cd-d732-46e2-b372-0916269dad7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.554531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd068c802f1654006aad48b79b97731b5', 'request_id': 'req-8235b2cd-d732-46e2-b372-0916269dad7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.568992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd068c802f1654006aad48b79b97731b5', 'request_id': 'req-8235b2cd-d732-46e2-b372-0916269dad7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.600833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project d068c802f1654006aad48b79b97731b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:17.601178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.605298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:17.616562 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2517/5064] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:17 2022] DELETE /identity/v3/projects/d068c802f1654006aad48b79b97731b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:17.617230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:17.618347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:17.641284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08d7ab-c0f7-4219-ab8f-d2c7ccda90a8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:17.701601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:17.732740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:17.734410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:17.735275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:17.735709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:17.741420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:17.744143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:17.800326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2548/5065] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:17 2022] POST /identity/v3/projects => generated 328 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:17.805426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:17.806884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:17.823552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b2cd-d732-46e2-b372-0916269dad7a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:17.909311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:17.931348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:17.931986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:17.932275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:17.932555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:17.933250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:17.952647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:17.987665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:17.996123 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2518/5066] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:17 2022] POST /identity/v3/users => generated 413 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:18.001793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c444ec-4b6c-432a-9b97-89fb1696fe0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.007684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.008551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.009104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.009651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.022099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.026097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:18.058499 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2549/5067] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:17 2022] POST /identity/v3/roles => generated 244 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:18.062635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:18.082343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7a275-bb32-4a8a-a842-b7286561d9c2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.088422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.089239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.089789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.090172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.090959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.092887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:18.112629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2519/5068] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:18 2022] POST /identity/v3/roles => generated 244 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:18.116516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:18.128294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4422-51ff-4347-a7b0-7c60ce5823e0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.133678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.134196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.134560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.134844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0/users/bc96c832ed5443de82bfb5791c8c5810/roles/5e795da65b3147b098feaa9a3ae8b6c5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.160175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29d6ec4d788a41a18f97cdacdcce8bb0, user_id=bc96c832ed5443de82bfb5791c8c5810, role_id=5e795da65b3147b098feaa9a3ae8b6c5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.162907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:18.193417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2550/5069] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:18 2022] PUT /identity/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0/users/bc96c832ed5443de82bfb5791c8c5810/roles/5e795da65b3147b098feaa9a3ae8b6c5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:18.197970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:18.214633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8524186-010f-4797-8d46-da2754c1aaaf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.328446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.329329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.329714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.330212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0/users/bc96c832ed5443de82bfb5791c8c5810/roles/84308b2f23e34b81afeac1e7c23e7120` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.334119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29d6ec4d788a41a18f97cdacdcce8bb0, user_id=bc96c832ed5443de82bfb5791c8c5810, role_id=84308b2f23e34b81afeac1e7c23e7120)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.337202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef54a9-6f76-4fa5-bfdf-6267d8ffa1d1 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:18.359628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2520/5070] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:18 2022] PUT /identity/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0/users/bc96c832ed5443de82bfb5791c8c5810/roles/84308b2f23e34b81afeac1e7c23e7120 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:18.364256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:18.388404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d43ce-bd18-4f52-a9b4-563636598754 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.520447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.522598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.523172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.524724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.525624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.532078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0d41-37c9-4f67-9b36-9261879e45e5 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:18.613983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2551/5071] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:18 2022] GET /identity/v3/users => generated 8904 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:18.619476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.620649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.621191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.714824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] MFA Rules not processed for user `bc96c832ed5443de82bfb5791c8c5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:18.716224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:18.812982 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2521/5072] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:18.897354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.897916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.897916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.919180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] MFA Rules not processed for user `bc96c832ed5443de82bfb5791c8c5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:18.920421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:18.928136 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2552/5073] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:18.932357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:18.942228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff8f2-905c-443e-b172-4b040e55abe0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:18.947079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96c832ed5443de82bfb5791c8c5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d6ec4d788a41a18f97cdacdcce8bb0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-9828408', 'tempest-DelegatedRole-1689375816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:18.947687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:18.947963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:18.948231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:18.948897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] RBAC: Authorizing `identity:create_trust()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:18.950080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.006858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 28 10:11:19.072592 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 28 10:11:19.073705 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:19.077956 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2522/5074] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 142 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:11:19.078394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:19.103351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8044f88-3e99-41ab-a523-12abecfb10d1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:19.110594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:19.111245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:19.111675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:19.111950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/84308b2f23e34b81afeac1e7c23e7120` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:19.114146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=84308b2f23e34b81afeac1e7c23e7120)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:19.116128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.176535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 84308b2f23e34b81afeac1e7c23e7120 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:19.177295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.178222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.180874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2553/5075] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:19 2022] DELETE /identity/v3/roles/84308b2f23e34b81afeac1e7c23e7120 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:19.185001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:19.187091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:19.217729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821c46-fb10-4b3a-8d61-e3f995684615 tempest-TrustsV3TestJSON-575187835 tempest-user-167698082] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:19.296264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:19.297179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:19.297414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:19.297936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/5e795da65b3147b098feaa9a3ae8b6c5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:19.299839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5e795da65b3147b098feaa9a3ae8b6c5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:19.301651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.352009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 5e795da65b3147b098feaa9a3ae8b6c5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:19.352335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.353025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.359076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2523/5076] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:19 2022] DELETE /identity/v3/roles/5e795da65b3147b098feaa9a3ae8b6c5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:19.362101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:19.375204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77576b2-df06-481b-8bb3-c178aa27a835 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:19.429524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:19.452572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:19.453132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:19.453418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:19.453852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/bc96c832ed5443de82bfb5791c8c5810` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:19.455138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bc96c832ed5443de82bfb5791c8c5810)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:19.457367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.511910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc96c832ed5443de82bfb5791c8c5810'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.512589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc96c832ed5443de82bfb5791c8c5810'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.520620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc96c832ed5443de82bfb5791c8c5810'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.528274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc96c832ed5443de82bfb5791c8c5810'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.529058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc96c832ed5443de82bfb5791c8c5810'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.550995 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2554/5077] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:19 2022] DELETE /identity/v3/users/bc96c832ed5443de82bfb5791c8c5810 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:19.555815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:19.557550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:19.573154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9ab9-28fd-4bdf-bc78-37d735edddd0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:19.658074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:19.658737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:19.659016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:19.659287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:19.661357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29d6ec4d788a41a18f97cdacdcce8bb0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:19.663313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.742914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d6ec4d788a41a18f97cdacdcce8bb0', 'request_id': 'req-6610a554-7fba-422c-acb2-523d6216aa0c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.747765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:19.755639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d6ec4d788a41a18f97cdacdcce8bb0', 'request_id': 'req-6610a554-7fba-422c-acb2-523d6216aa0c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.769621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d6ec4d788a41a18f97cdacdcce8bb0', 'request_id': 'req-6610a554-7fba-422c-acb2-523d6216aa0c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.791412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project 29d6ec4d788a41a18f97cdacdcce8bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:19.791868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.793707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:19.797443 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2524/5078] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:19 2022] DELETE /identity/v3/projects/29d6ec4d788a41a18f97cdacdcce8bb0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:19.806045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:19.807696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:19.825303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237bdb-a5ab-4738-a820-c21e773ab229 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:19.933952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:19.942633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:19.948882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:19.949402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:19.951746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:19.954384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:19.994359 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2555/5079] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:19 2022] POST /identity/v3/projects => generated 329 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:19.998618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.000162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:20.014237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a554-7fba-422c-acb2-523d6216aa0c tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.095370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.096432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.096999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.097507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.098431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.100648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.133987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2525/5080] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:19 2022] POST /identity/v3/users => generated 416 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:20.136809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.161859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a080a0c-b249-4746-9475-5cbb3d7272f2 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.170198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.171181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.171687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.172203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.173105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.175499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.199676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2556/5081] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:20 2022] POST /identity/v3/roles => generated 243 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:20.203549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.231703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b018e-56e1-47cf-b571-0c7abcf83eb0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.245790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.246414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.246689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.246963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.247629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.249266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.274627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2526/5082] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:20 2022] POST /identity/v3/roles => generated 246 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:20.278679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.310167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716abc-297d-42e1-b5cc-d014277b2da8 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.318808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.327677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.327677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.328736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/83c94702cbaa4743852bf6d2eab1b399/users/efb5b05bc7c448f292515ce48b97a062/roles/23cba6857e014b53b22c17c071dee1de` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.390753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=83c94702cbaa4743852bf6d2eab1b399, user_id=efb5b05bc7c448f292515ce48b97a062, role_id=23cba6857e014b53b22c17c071dee1de)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.394361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.437054 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2557/5083] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:20 2022] PUT /identity/v3/projects/83c94702cbaa4743852bf6d2eab1b399/users/efb5b05bc7c448f292515ce48b97a062/roles/23cba6857e014b53b22c17c071dee1de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:20.441229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.458667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e02d-74b1-485a-838a-65461c855ab3 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.647645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.648530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.648946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.649323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/83c94702cbaa4743852bf6d2eab1b399/users/efb5b05bc7c448f292515ce48b97a062/roles/8660ef071e28487db078c1fa5c58aa50` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.656436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=83c94702cbaa4743852bf6d2eab1b399, user_id=efb5b05bc7c448f292515ce48b97a062, role_id=8660ef071e28487db078c1fa5c58aa50)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.661154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45314db2-2c75-4bbe-a332-bbf51e4d4074 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.690934 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2527/5084] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:20 2022] PUT /identity/v3/projects/83c94702cbaa4743852bf6d2eab1b399/users/efb5b05bc7c448f292515ce48b97a062/roles/8660ef071e28487db078c1fa5c58aa50 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:20.694834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:20.709189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132681e-bf03-49ca-81b0-ef487478a791 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:20.715750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:20.868215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:20.870505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.872441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.873106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:20.877709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:20.881225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9b342-29e1-4d0e-bfc8-088c3a76beb9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:20.966594 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2558/5085] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:20 2022] GET /identity/v3/users => generated 8907 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:20.967238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:20.967549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:20.967895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.044659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] MFA Rules not processed for user `efb5b05bc7c448f292515ce48b97a062`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:21.046267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:21.101187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:21.149440 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2528/5086] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:21.159738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.160156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.160545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.185803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] MFA Rules not processed for user `efb5b05bc7c448f292515ce48b97a062`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:21.187767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:21.202025 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2559/5087] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:21.202784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.219203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a7ba-0843-4e79-98d1-e86ee46ca159 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.230999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.231677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.232718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.232718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.232982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:create_trust()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.234100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.405915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.411805 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2529/5088] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:21.416519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aa10e-0f64-4386-bd6a-263e4fd1da8c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.422529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.423605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.423935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.424280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.431733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:get_trust(trust_id=619314aa38234ef1b644282e76247743)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.433395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.445701 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2560/5089] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:21 2022] GET /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743 => generated 833 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:21.448051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.462563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36866d-7ffe-456e-949b-f0c5f7ee68bf tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.467938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.471294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.471875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.472239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.482555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=619314aa38234ef1b644282e76247743)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.490648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.504223 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2530/5090] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:11:21 2022] GET /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:11:21.509319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.526582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390464-7584-4b24-a094-cba100a398f0 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.538324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.539054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.539339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.539610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/23cba6857e014b53b22c17c071dee1de` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.556527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:get_role_for_trust(trust_id=619314aa38234ef1b644282e76247743, role_id=23cba6857e014b53b22c17c071dee1de)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.562469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.580127 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2561/5091] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:21 2022] GET /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/23cba6857e014b53b22c17c071dee1de => generated 243 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:21.584963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.611515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ffb-3b38-497d-b273-4bcbd8bfb556 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.616151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.616817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.617237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.617475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/23cba6857e014b53b22c17c071dee1de` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.639270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:get_role_for_trust(trust_id=619314aa38234ef1b644282e76247743, role_id=23cba6857e014b53b22c17c071dee1de)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.641356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.655064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2531/5092] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:21 2022] HEAD /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/23cba6857e014b53b22c17c071dee1de => generated 0 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 28 10:11:21.659246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.671363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a38d03-aaec-4164-bf34-fa40cdf81d54 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.677956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.678778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.679116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.679386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/8660ef071e28487db078c1fa5c58aa50` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.688076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:get_role_for_trust(trust_id=619314aa38234ef1b644282e76247743, role_id=8660ef071e28487db078c1fa5c58aa50)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.689708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Could not find role: 8660ef071e28487db078c1fa5c58aa50.: keystone.exception.RoleNotFound: Could not find role: 8660ef071e28487db078c1fa5c58aa50. Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:21.706082 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 8660ef071e28487db078c1fa5c58aa50. Oct 28 10:11:21.707107 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:21.710601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2562/5093] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:21 2022] GET /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/8660ef071e28487db078c1fa5c58aa50 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:21.712473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.723310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9916eb-2dbc-4eef-b638-846e7810ef06 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.728960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.729636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.729915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.746875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/8660ef071e28487db078c1fa5c58aa50` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.756748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:get_role_for_trust(trust_id=619314aa38234ef1b644282e76247743, role_id=8660ef071e28487db078c1fa5c58aa50)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.758799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Could not find role: 8660ef071e28487db078c1fa5c58aa50.: keystone.exception.RoleNotFound: Could not find role: 8660ef071e28487db078c1fa5c58aa50. Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:21.771886 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 8660ef071e28487db078c1fa5c58aa50. Oct 28 10:11:21.772889 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:21.777096 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2532/5094] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:21 2022] HEAD /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743/roles/8660ef071e28487db078c1fa5c58aa50 => generated 0 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 28 10:11:21.778523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.796723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26517c69-4fa3-411b-86b2-e5869799e17d tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.806359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.807930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.808373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.811408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.827776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorizing `identity:delete_trust(trust_id=619314aa38234ef1b644282e76247743)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:21.830862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:21.896670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '619314aa38234ef1b644282e76247743', 'request_id': 'req-ad90b863-5a41-4c47-9cec-c7632a2c1965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:21.897686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '619314aa38234ef1b644282e76247743', 'request_id': 'req-ad90b863-5a41-4c47-9cec-c7632a2c1965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:21.898558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '619314aa38234ef1b644282e76247743', 'request_id': 'req-ad90b863-5a41-4c47-9cec-c7632a2c1965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:21.924195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2563/5095] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:11:21 2022] DELETE /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:21.928157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.930503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:21.946530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a6fd-32e0-4e6f-8e53-1d7333783457 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:21.951527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb5b05bc7c448f292515ce48b97a062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c94702cbaa4743852bf6d2eab1b399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380362302', 'tempest-DelegatedRole-319258138'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:21.952765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:21.953322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:21.953903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] PATH_INFO: `/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Could not find trust: 619314aa38234ef1b644282e76247743.: keystone.exception.TrustNotFound: Could not find trust: 619314aa38234ef1b644282e76247743. Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 28 10:11:21.973706 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 619314aa38234ef1b644282e76247743. Oct 28 10:11:21.974691 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:21.979187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:21.980479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2533/5096] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:21 2022] GET /identity/v3/OS-TRUST/trusts/619314aa38234ef1b644282e76247743 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:21.981477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:22.001482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b863-5a41-4c47-9cec-c7632a2c1965 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:22.009224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:22.010162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:22.010480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:22.010778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/8660ef071e28487db078c1fa5c58aa50` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:22.012282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8660ef071e28487db078c1fa5c58aa50)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:22.014467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:22.068745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 8660ef071e28487db078c1fa5c58aa50 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:22.069129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.069948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.077915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:22.078777 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2564/5097] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:21 2022] DELETE /identity/v3/roles/8660ef071e28487db078c1fa5c58aa50 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:22.080221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:22.117899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341b2e-2bae-4566-b183-4505a1fc4021 tempest-TrustsV3TestJSON-1461472881 tempest-user-1118689339] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:22.251207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:22.253551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:22.254020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:22.254446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/23cba6857e014b53b22c17c071dee1de` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:22.256405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=23cba6857e014b53b22c17c071dee1de)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:22.258335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:22.261953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:22.323482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role 23cba6857e014b53b22c17c071dee1de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:22.324094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.325337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.330990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2534/5098] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:22 2022] DELETE /identity/v3/roles/23cba6857e014b53b22c17c071dee1de => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:22.338237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:22.357627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7264b9-cd28-468b-82f9-b30a436e8053 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:22.387312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:22.446453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:22.449326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:22.450945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:22.451398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/efb5b05bc7c448f292515ce48b97a062` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:22.453772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efb5b05bc7c448f292515ce48b97a062)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:22.455822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:22.512546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb5b05bc7c448f292515ce48b97a062'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.513307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb5b05bc7c448f292515ce48b97a062'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.523104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb5b05bc7c448f292515ce48b97a062'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.535644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:22.537326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:22.547717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb5b05bc7c448f292515ce48b97a062'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.550734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb5b05bc7c448f292515ce48b97a062'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.581118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2565/5099] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:22 2022] DELETE /identity/v3/users/efb5b05bc7c448f292515ce48b97a062 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:22.584787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:22.586798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:22.677856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443009-9f71-4b44-80fc-08bc3b1b03fb tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:22.731307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909953f-b429-49e0-9616-f304c8998dbf tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:22.748334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:22.749113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:22.749463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:22.749802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/83c94702cbaa4743852bf6d2eab1b399` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:22.752219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83c94702cbaa4743852bf6d2eab1b399)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:22.754281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:22.774604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:22.775327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:22.775501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:22.775772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:22.778476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:22.798647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:22.800811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:22.817711 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2535/5100] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:11:22.852440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:22.867690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c94702cbaa4743852bf6d2eab1b399', 'request_id': 'req-f980ad53-44af-4f73-92ab-99e570d391ff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.876844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c94702cbaa4743852bf6d2eab1b399', 'request_id': 'req-f980ad53-44af-4f73-92ab-99e570d391ff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.887978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c94702cbaa4743852bf6d2eab1b399', 'request_id': 'req-f980ad53-44af-4f73-92ab-99e570d391ff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.923302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project 83c94702cbaa4743852bf6d2eab1b399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:22.923876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.924753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:22.928366 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2566/5101] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:22 2022] DELETE /identity/v3/projects/83c94702cbaa4743852bf6d2eab1b399 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:22.936163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:22.950637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab063-5c02-4f56-a0a4-884ba41e0896 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.040887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:23.056123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.057013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.057485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.057944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.059028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.061497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.114925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2536/5102] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:11:22 2022] POST /identity/v3/projects => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:23.119575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.121098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:23.146803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ad53-44af-4f73-92ab-99e570d391ff tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.349025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.351267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.353578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.354170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.354956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.358733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.405981 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2567/5103] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:23 2022] POST /identity/v3/users => generated 416 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:23.408099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.431139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79ce8-971b-494f-9916-906fcdb8fc39 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.439289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.440216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.440562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.440981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.441963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.443745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.483916 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2537/5104] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:23 2022] POST /identity/v3/roles => generated 244 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:23.487578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.505134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e707-7da4-4daf-ba1d-d8e767adf069 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.511045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.512270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.512659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.513075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.513890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.515954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.540865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2568/5105] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:11:23 2022] POST /identity/v3/roles => generated 247 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:23.544689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.561098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e33f-7186-4ce7-b0cb-07d90cb02341 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.568228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.569093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.569499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.570202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/5939a66af5084ddd8c61671b43b57055/users/9c4b7859d68444b4bc4c28c8837d850e/roles/d217920e8b6f4e86b38e85463625ee62` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.623649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5939a66af5084ddd8c61671b43b57055, user_id=9c4b7859d68444b4bc4c28c8837d850e, role_id=d217920e8b6f4e86b38e85463625ee62)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.628846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.654936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2538/5106] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:23 2022] PUT /identity/v3/projects/5939a66af5084ddd8c61671b43b57055/users/9c4b7859d68444b4bc4c28c8837d850e/roles/d217920e8b6f4e86b38e85463625ee62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:23.659340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.674408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186bd1-e0a5-4437-b4ef-8541af7b16a0 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:23.818843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:23.821078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:23.821488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:23.821866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/5939a66af5084ddd8c61671b43b57055/users/9c4b7859d68444b4bc4c28c8837d850e/roles/aeefadda165d4b9c8650ba1ed110829a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:23.827191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5939a66af5084ddd8c61671b43b57055, user_id=9c4b7859d68444b4bc4c28c8837d850e, role_id=aeefadda165d4b9c8650ba1ed110829a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:23.836968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c165-66af-44ea-953b-ee1669f6d8c9 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:23.890258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2569/5107] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:23 2022] PUT /identity/v3/projects/5939a66af5084ddd8c61671b43b57055/users/9c4b7859d68444b4bc4c28c8837d850e/roles/aeefadda165d4b9c8650ba1ed110829a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:23.894872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:23.920549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c788-0973-4bde-b63e-b611f3aebe73 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.028511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.029159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.029439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.029713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.030369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.032205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e3c6a-12f8-486d-8f85-3c903a57924f tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.090513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2539/5108] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:23 2022] GET /identity/v3/users => generated 8907 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:24.095911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.096200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.096475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.165439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] MFA Rules not processed for user `9c4b7859d68444b4bc4c28c8837d850e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:24.166705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:24.208085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:24.278230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2570/5109] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:24.288536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.288819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.289246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.338867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] MFA Rules not processed for user `9c4b7859d68444b4bc4c28c8837d850e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:24.340198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:24.353479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2540/5110] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:24.355018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.365847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3be74-e929-4871-82bd-87dae8a43e32 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.372545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.373485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.373965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.374383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.375424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:create_trust()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.377050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.561711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2571/5111] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:11:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:24.564983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.579584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2397846-1cc3-4f3a-8e05-c00991b16d6f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.589935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.590665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.592314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.592705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.603295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:get_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.604879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.618222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2541/5112] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:24 2022] GET /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1 => generated 835 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:24.622150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.634101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3246-1748-458d-8973-726899dcf2dc tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.648012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.648958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.649387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.649993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.667335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.669283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.684318 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2572/5113] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:11:24 2022] GET /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:24.688412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.705623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee25e-8aa1-4960-ac08-a25594f6c48c tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.710264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.711491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.711774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.712047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/d217920e8b6f4e86b38e85463625ee62` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.724412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1, role_id=d217920e8b6f4e86b38e85463625ee62)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.726153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.749487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2542/5114] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:24 2022] GET /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/d217920e8b6f4e86b38e85463625ee62 => generated 244 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:24.753487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.766195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389592d-a4ee-4f90-ae2c-5aa552e42ea9 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.774202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.775261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.775544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.775802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/d217920e8b6f4e86b38e85463625ee62` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.784993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1, role_id=d217920e8b6f4e86b38e85463625ee62)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.786046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.796517 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2573/5115] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:24 2022] HEAD /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/d217920e8b6f4e86b38e85463625ee62 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 28 10:11:24.797786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.807514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445b87-5afe-44fb-b64d-0e62c80b0968 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.825119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.825796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.826137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.826416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/aeefadda165d4b9c8650ba1ed110829a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.841056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1, role_id=aeefadda165d4b9c8650ba1ed110829a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.842517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Could not find role: aeefadda165d4b9c8650ba1ed110829a.: keystone.exception.RoleNotFound: Could not find role: aeefadda165d4b9c8650ba1ed110829a. Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:24.853461 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: aeefadda165d4b9c8650ba1ed110829a. Oct 28 10:11:24.854474 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:24.854942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2543/5116] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:11:24 2022] GET /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/aeefadda165d4b9c8650ba1ed110829a => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:11:24.858917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.874306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5a7a5-47c8-4776-816c-820564aaa7e7 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.887618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.888715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.889369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.889995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/aeefadda165d4b9c8650ba1ed110829a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.905036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1, role_id=aeefadda165d4b9c8650ba1ed110829a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.907663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Could not find role: aeefadda165d4b9c8650ba1ed110829a.: keystone.exception.RoleNotFound: Could not find role: aeefadda165d4b9c8650ba1ed110829a. Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:11:24.935882 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: aeefadda165d4b9c8650ba1ed110829a. Oct 28 10:11:24.936884 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:24.938186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2574/5117] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Oct 28 10:11:24 2022] HEAD /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1/roles/aeefadda165d4b9c8650ba1ed110829a => generated 0 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 28 10:11:24.949826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:24.969274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d64d6-ee08-4b40-9ba4-84ec3e7e0250 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:24.981202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:24.982002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:24.982389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:24.983303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:24.994245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorizing `identity:delete_trust(trust_id=dc1ea8bcf7434d00ae10ce3675f02dc1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:24.997737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:25.045773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dc1ea8bcf7434d00ae10ce3675f02dc1', 'request_id': 'req-a46d7dc0-5651-4239-87f1-1b820d330756'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.046678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dc1ea8bcf7434d00ae10ce3675f02dc1', 'request_id': 'req-a46d7dc0-5651-4239-87f1-1b820d330756'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.047429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'dc1ea8bcf7434d00ae10ce3675f02dc1', 'request_id': 'req-a46d7dc0-5651-4239-87f1-1b820d330756'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.053923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:25.077554 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2544/5118] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:11:24 2022] DELETE /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:25.078104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:25.081516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:25.115578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93c8e-bce3-490b-a9ab-6b744be14108 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:25.126614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4b7859d68444b4bc4c28c8837d850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5939a66af5084ddd8c61671b43b57055', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1592630818', 'tempest-NotDelegatedRole-1877596579'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:25.127268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:25.127544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:25.127851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] PATH_INFO: `/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Could not find trust: dc1ea8bcf7434d00ae10ce3675f02dc1.: keystone.exception.TrustNotFound: Could not find trust: dc1ea8bcf7434d00ae10ce3675f02dc1. Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 28 10:11:25.151516 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: dc1ea8bcf7434d00ae10ce3675f02dc1. Oct 28 10:11:25.152736 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:11:25.156456 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2575/5119] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:11:25 2022] GET /identity/v3/OS-TRUST/trusts/dc1ea8bcf7434d00ae10ce3675f02dc1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:11:25.158540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:25.159761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:25.191443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d7dc0-5651-4239-87f1-1b820d330756 tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:25.205255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:25.206119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:25.206407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:25.206683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/aeefadda165d4b9c8650ba1ed110829a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:25.208114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aeefadda165d4b9c8650ba1ed110829a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:25.209913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:25.297551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role aeefadda165d4b9c8650ba1ed110829a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:25.297859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.299184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.304382 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2545/5120] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:25 2022] DELETE /identity/v3/roles/aeefadda165d4b9c8650ba1ed110829a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:25.305981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:25.308574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:25.339185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0b90f-fb4f-4b80-b2cf-c897368d40df tempest-TrustsV3TestJSON-11872446 tempest-user-1721097253] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:25.442302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:25.460472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:25.462282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:25.462642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:25.462984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/roles/d217920e8b6f4e86b38e85463625ee62` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:25.464536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d217920e8b6f4e86b38e85463625ee62)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:25.467088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:25.559414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invalidating the token cache because role d217920e8b6f4e86b38e85463625ee62 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:25.559768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.561267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.565968 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2576/5121] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:25 2022] DELETE /identity/v3/roles/d217920e8b6f4e86b38e85463625ee62 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:25.568660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:25.582972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c27d-a24c-4bbb-972b-3cc81a0acc55 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:25.709445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:25.710487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:25.711434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:25.715150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/users/9c4b7859d68444b4bc4c28c8837d850e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:25.717259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9c4b7859d68444b4bc4c28c8837d850e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:25.721619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:25.850941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4b7859d68444b4bc4c28c8837d850e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.852295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4b7859d68444b4bc4c28c8837d850e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.853202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4b7859d68444b4bc4c28c8837d850e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.864441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4b7859d68444b4bc4c28c8837d850e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.875138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4b7859d68444b4bc4c28c8837d850e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:25.914632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2546/5122] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:25 2022] DELETE /identity/v3/users/9c4b7859d68444b4bc4c28c8837d850e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:25.919135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:25.920719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:25.958488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1048-f26a-42b9-9ddd-46da75a9f432 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:26.029731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04befc7ae957446d91e9102684341fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27450439001f48bc8686dea261b6753b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:26.030390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:26.030673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:26.030951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] PATH_INFO: `/v3/projects/5939a66af5084ddd8c61671b43b57055` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:26.032117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5939a66af5084ddd8c61671b43b57055)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:26.034838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:26.099680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5939a66af5084ddd8c61671b43b57055', 'request_id': 'req-707ed6e8-6bd7-4913-b0a4-14a56ec43330'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.106620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5939a66af5084ddd8c61671b43b57055', 'request_id': 'req-707ed6e8-6bd7-4913-b0a4-14a56ec43330'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.116890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5939a66af5084ddd8c61671b43b57055', 'request_id': 'req-707ed6e8-6bd7-4913-b0a4-14a56ec43330'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.135311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] The token cache is being invalidate because project 5939a66af5084ddd8c61671b43b57055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:26.135744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.136423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-707ed6e8-6bd7-4913-b0a4-14a56ec43330 tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.138584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2577/5123] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:25 2022] DELETE /identity/v3/projects/5939a66af5084ddd8c61671b43b57055 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:26.143763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:26.145762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:26.216941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:26.264690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31392-6a62-4df4-93cf-1f1eb53b7d8a tempest-TrustsV3TestJSON-839259739 tempest-TrustsV3TestJSON-839259739-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:26.421125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:26.421952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:26.422397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:26.422679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] PATH_INFO: `/v3/users/7b1608ed771549109fed02cdc5d3d43e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:26.426743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1608ed771549109fed02cdc5d3d43e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:26.428711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:26.522457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1608ed771549109fed02cdc5d3d43e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.525283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1608ed771549109fed02cdc5d3d43e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.526768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1608ed771549109fed02cdc5d3d43e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.544881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1608ed771549109fed02cdc5d3d43e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.566318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1608ed771549109fed02cdc5d3d43e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:26.615000 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2547/5124] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:26 2022] DELETE /identity/v3/users/7b1608ed771549109fed02cdc5d3d43e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:26.619891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91a9a-635f-409e-9e3a-2c9ea8580923 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:26.620562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91a9a-635f-409e-9e3a-2c9ea8580923 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:26.620673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91a9a-635f-409e-9e3a-2c9ea8580923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:26.659899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-82b91a9a-635f-409e-9e3a-2c9ea8580923 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:26.661721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82b91a9a-635f-409e-9e3a-2c9ea8580923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:26.745045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:26.772850 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2578/5125] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:26.784227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:26.786235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:26.869802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d31fa-0b73-4665-aa05-571aed9cef9d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:26.874954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:26.875694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:26.876133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:26.876495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:26.897428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:26.900290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:26.919488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2548/5126] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:27.080169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:27.080662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:27.080957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:27.113862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:27.115117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:27.241357 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2579/5127] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:27.705985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:27.708092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:27.722976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:27.732876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbee24-6364-4f50-b972-196f3d00606f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:27.763320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:27.765015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:27.765307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:27.765588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] PATH_INFO: `/v3/projects/4ef7157e960d4886b82c2e95807ff0fd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:27.769124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef7157e960d4886b82c2e95807ff0fd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:27.774321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:27.870144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef7157e960d4886b82c2e95807ff0fd', 'request_id': 'req-f6463081-f4ef-48ce-9e15-77b9501be23f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:27.877866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef7157e960d4886b82c2e95807ff0fd', 'request_id': 'req-f6463081-f4ef-48ce-9e15-77b9501be23f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:27.887772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef7157e960d4886b82c2e95807ff0fd', 'request_id': 'req-f6463081-f4ef-48ce-9e15-77b9501be23f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:27.904401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] The token cache is being invalidate because project 4ef7157e960d4886b82c2e95807ff0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:27.904854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:27.905689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:27.910305 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2549/5128] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:27 2022] DELETE /identity/v3/projects/4ef7157e960d4886b82c2e95807ff0fd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:27.912248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:27.934613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001a87d-ed27-42f4-b99a-ddce082530d2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:28.028385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:28.029534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:28.030067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:28.030543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] PATH_INFO: `/v3/users/04befc7ae957446d91e9102684341fde` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:28.032155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04befc7ae957446d91e9102684341fde)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:28.035524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:28.107916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04befc7ae957446d91e9102684341fde'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:28.110395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04befc7ae957446d91e9102684341fde'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:28.120608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04befc7ae957446d91e9102684341fde'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:28.130151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04befc7ae957446d91e9102684341fde'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:28.131502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04befc7ae957446d91e9102684341fde'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:28.165051 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2580/5129] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:27 2022] DELETE /identity/v3/users/04befc7ae957446d91e9102684341fde => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:28.639847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:28.641355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:28.715174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:28.716984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:28.753182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:28.885479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463081-f4ef-48ce-9e15-77b9501be23f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:28.902559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a113f-3899-4f3f-9cb0-bc6bc28df7d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:28.917997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:28.919241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:28.919520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:28.919790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] PATH_INFO: `/v3/projects/27450439001f48bc8686dea261b6753b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:28.921339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27450439001f48bc8686dea261b6753b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:28.923786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.028128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27450439001f48bc8686dea261b6753b', 'request_id': 'req-eecc3118-6fd5-401c-bf8b-b21831c47220'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:29.046185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27450439001f48bc8686dea261b6753b', 'request_id': 'req-eecc3118-6fd5-401c-bf8b-b21831c47220'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:29.056226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27450439001f48bc8686dea261b6753b', 'request_id': 'req-eecc3118-6fd5-401c-bf8b-b21831c47220'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:29.069947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.070763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.071157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.071541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.075934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:29.077516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] The token cache is being invalidate because project 27450439001f48bc8686dea261b6753b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:29.077992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:29.082858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eecc3118-6fd5-401c-bf8b-b21831c47220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:29.085009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2581/5130] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:28 2022] DELETE /identity/v3/projects/27450439001f48bc8686dea261b6753b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:29.086519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c779d1-885f-4e54-9eb6-258b413dad5c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.087131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c779d1-885f-4e54-9eb6-258b413dad5c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.087563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c779d1-885f-4e54-9eb6-258b413dad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.094417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.099931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c5733-694b-45bf-a30b-3d17d18c00f4 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.126363 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2550/5131] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:29.129051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.133821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.134242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.143536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-95c779d1-885f-4e54-9eb6-258b413dad5c None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:29.153162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-95c779d1-885f-4e54-9eb6-258b413dad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:29.184494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:29.188329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:29.211210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:29.334352 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2582/5132] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:29.339741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2551/5133] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:29.350535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.350827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.351073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.383593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:29.385157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:29.401904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.402434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2583/5134] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:29.417928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbe782-c64d-4259-b8cf-33a298bebf69 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.448682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.449985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.450483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.450982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.452133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:29.452891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.454926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.485741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2552/5135] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:29.490387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.513498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39309e-eb1e-4207-b5f8-9964770d1a40 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.526233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.526878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.527163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.527427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.528442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.530026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.611983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2584/5136] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:29 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:29.618296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.636078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382733f0-b2d3-4bac-bdfe-2c91c192f379 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.771466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.772257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.772544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.772817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.773526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.775798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.820735 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2553/5137] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:29 2022] POST /identity/v3/users => generated 281 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:29.824941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.839793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4427-3ca2-4f27-b7f6-244f0f992809 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.852999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.853791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.854075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.854346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.854999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.859291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.899825 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2585/5138] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:29.904551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.918707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c53e-71a7-4677-ac2d-5d38eadf6101 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.925006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.926330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.926841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.927414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.929120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:29.931881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227f6a-f0f2-4873-a870-f4a4fb3a37f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:29.950243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:29.950811 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2554/5139] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:29.969122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795fcfc-597f-4315-8616-fb1e3d863a1c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:29.975320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:29.976881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:29.977331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:29.977783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] PATH_INFO: `/v3/projects/3a0b9061ff134fc5b19655c435c5a636/users/14774abcf0bd47c49e83a26113209baf/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:29.987835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:30.013134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b9061ff134fc5b19655c435c5a636, user_id=14774abcf0bd47c49e83a26113209baf, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.016629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd0dde-967d-47b1-9df5-f7b6065e8d13 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.045133 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2586/5140] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:29 2022] PUT /identity/v3/projects/3a0b9061ff134fc5b19655c435c5a636/users/14774abcf0bd47c49e83a26113209baf/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:30.056224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc412a-042b-49ec-8885-d3ab0e3a48e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.056577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc412a-042b-49ec-8885-d3ab0e3a48e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.056927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc412a-042b-49ec-8885-d3ab0e3a48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.092665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-25cc412a-042b-49ec-8885-d3ab0e3a48e9 None None] MFA Rules not processed for user `14774abcf0bd47c49e83a26113209baf`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:30.095931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-25cc412a-042b-49ec-8885-d3ab0e3a48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.191387 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2555/5141] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:30.196469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.197012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.197562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.218969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] MFA Rules not processed for user `14774abcf0bd47c49e83a26113209baf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:30.220157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.223935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2587/5142] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:11:30.229728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.230332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.230833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.252533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] MFA Rules not processed for user `14774abcf0bd47c49e83a26113209baf`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:30.254027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.257800 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2556/5143] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 10:11:30.261909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.276674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0f5af-aa7f-4101-a94e-22f416b991f8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.281775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.282723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.283337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.283833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.292785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorizing `identity:check_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.294812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.310438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2588/5144] 10.222.0.16 () {56 vars in 1264 bytes} [Fri Oct 28 10:11:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 28 10:11:30.314628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.333103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444777-401e-4dc9-b704-a752db7e4a3c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.342466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.343565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.344187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.344681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.349159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:30.354175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.356318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.368771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2557/5145] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Oct 28 10:11:30 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:30.370394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.383589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a966c9-9303-40e6-90b3-553efe0b4de7 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.392030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.392629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.392944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.393249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.402982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.404512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3f51-d607-4469-9793-2bf9d5b1d6be tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.427926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2589/5146] 10.222.0.16 () {56 vars in 1266 bytes} [Fri Oct 28 10:11:30 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:30.429079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.442084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e1a27-15eb-4a4e-873a-de4a2db31062 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.460243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.461525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.462674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.463298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.467837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 28 10:11:30.496859 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 28 10:11:30.498060 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:11:30.499071 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:30.508170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2558/5147] 10.222.0.16 () {56 vars in 1264 bytes} [Fri Oct 28 10:11:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:11:30.509827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.510100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.510379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.541787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] MFA Rules not processed for user `14774abcf0bd47c49e83a26113209baf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:30.543041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.546469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2590/5148] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 10:11:30.550921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.562308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f30535-c57e-4228-b95c-6083ba50232d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.572761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.573747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.574142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.574487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.582660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.584796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.599498 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2559/5149] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Oct 28 10:11:30 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:30.601340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.618245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02310ba5-1931-430c-9958-d2bc1c267815 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.625769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.626810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.626810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.627577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.645916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.647386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.695546 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2591/5150] 10.222.0.16 () {56 vars in 1266 bytes} [Fri Oct 28 10:11:30 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:30.702320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.719524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4cc8a-345f-430a-9ff6-83823cf8104d tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.732062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14774abcf0bd47c49e83a26113209baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0b9061ff134fc5b19655c435c5a636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.732692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.733014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.733293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.738200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-33d1fd8b-88c1-43ae-a532-f272b6af57d8 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 28 10:11:30.754169 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 28 10:11:30.755336 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 28 10:11:30.756963 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:11:30.758862 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2560/5151] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Oct 28 10:11:30 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:11:30.772962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:30.897721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17922a0d-7cec-4a08-b271-6af179064e53 tempest-TokensV3Test-1951099995 tempest-TokensV3Test-1951099995-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:30.904011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:30.904728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:30.905115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:30.905462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] PATH_INFO: `/v3/users/14774abcf0bd47c49e83a26113209baf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:30.907401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=14774abcf0bd47c49e83a26113209baf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:30.909605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:30.977652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14774abcf0bd47c49e83a26113209baf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:30.978435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14774abcf0bd47c49e83a26113209baf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:30.992283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14774abcf0bd47c49e83a26113209baf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:31.002145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14774abcf0bd47c49e83a26113209baf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:31.003201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14774abcf0bd47c49e83a26113209baf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:31.017504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:31.026577 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2592/5152] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:30 2022] DELETE /identity/v3/users/14774abcf0bd47c49e83a26113209baf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:31.030925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:31.031393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:31.031499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:31.051992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:31.053357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:31.158159 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2561/5153] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:31.168697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:31.170376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:31.269751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48db76-f9e6-4936-bf64-7665977421cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:31.273650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:31.274277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:31.274747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:31.274872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:31.285471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:31.287837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62176229-e68d-4648-832a-a079a184c0d6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:31.299341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2593/5154] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:31.986570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:31.988422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:32.016467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac436c-4b26-4515-8275-0e02ef9c07e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.022157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.023875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.024464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.024986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] PATH_INFO: `/v3/projects/3a0b9061ff134fc5b19655c435c5a636` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.026618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b9061ff134fc5b19655c435c5a636)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.030679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.089808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b9061ff134fc5b19655c435c5a636', 'request_id': 'req-3276270b-ddb2-4e62-b15c-2719ec1f97de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:32.099875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b9061ff134fc5b19655c435c5a636', 'request_id': 'req-3276270b-ddb2-4e62-b15c-2719ec1f97de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:32.119443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b9061ff134fc5b19655c435c5a636', 'request_id': 'req-3276270b-ddb2-4e62-b15c-2719ec1f97de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:32.138328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] The token cache is being invalidate because project 3a0b9061ff134fc5b19655c435c5a636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:32.139527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:32.140429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3276270b-ddb2-4e62-b15c-2719ec1f97de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:32.142515 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2562/5155] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:31 2022] DELETE /identity/v3/projects/3a0b9061ff134fc5b19655c435c5a636 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:32.148939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.149432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.149514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.172795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:32.174952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:32.270960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2594/5156] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:32.272895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.273861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.274503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.369970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:32.373564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:32.396639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2563/5157] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:32.396841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.410815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6789-8161-42e7-bec7-30da9c23df0d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.422840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.423741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.424380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.424884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.425651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:32.426121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.430066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.463926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2595/5158] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:11:32.466257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.490246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5186-2ec1-4f9d-a308-e61a5723862d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.508349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.512555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.512934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.513282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.514571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.525726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.576409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.576520 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2564/5159] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:32 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:32.591735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a74e5-87d9-439a-bc9a-e3770d2dbaf0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.677387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.678007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.678273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.678535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.679899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.683255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.709039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2596/5160] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:32 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:32.712419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.732598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b78a0-8f8b-4d75-92a2-ec176d1f7b09 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.744173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.744806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.745099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.745369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.746399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.747917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.764441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2565/5161] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:32.764676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.776830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95179-c6cc-48af-bee1-dad9b8745052 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.783698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.784507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.784826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.785218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] PATH_INFO: `/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47/users/e609d00e55774b76ad90b18656813523/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.821993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:32.826474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd73f0def8a4bf3b8645b0b6ff17f47, user_id=e609d00e55774b76ad90b18656813523, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.830312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:32.850225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2597/5162] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:32 2022] PUT /identity/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47/users/e609d00e55774b76ad90b18656813523/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:32.855500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:32.867530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b4608-8942-4618-a9d1-03abaac0e10a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:32.873430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:32.982876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:32.983675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:32.984203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:32.984579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:32.985433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:32.988150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268791bc-4a64-4a24-b33b-c34bf509112e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.000992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2566/5163] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:33.005674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.016841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03368-a5ce-4386-b6a3-23ba3560c73e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.022418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.023591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.023591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.024060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] PATH_INFO: `/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47/users/e609d00e55774b76ad90b18656813523/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.026464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd73f0def8a4bf3b8645b0b6ff17f47, user_id=e609d00e55774b76ad90b18656813523, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.029167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.061332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.061726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.062103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.064934 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2598/5164] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:33 2022] PUT /identity/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47/users/e609d00e55774b76ad90b18656813523/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:33.093762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] MFA Rules not processed for user `e609d00e55774b76ad90b18656813523`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:33.095126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:33.179638 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2567/5165] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:33.184244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.322217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41b1c4-3692-4df6-8cbc-77a94ed15708 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.333751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.334559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.335243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.336535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.338692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.341537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.403320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.417864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2599/5166] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:33 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:33.439776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f7f7e-7ba8-4b4a-a04f-8c484418d7f8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.528077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.528547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.528948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.529291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.531180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.535831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.568197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2568/5167] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:33 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:33.572578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.591861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2e03-be3c-4cf0-940e-9611ac883c68 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.620850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.621532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.621901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.622267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.623016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.631477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.682851 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2600/5168] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:33.686833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.702565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b21b9-7adf-4731-8509-c5c13e610e06 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.709152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.709859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.710275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.711188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.712237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.713886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3759a8-ea0b-40ad-adc9-7fa7edc11de5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.733444 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2569/5169] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:11:33.737470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:33.751879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e26a-4036-4270-b444-1eda46048d6c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:33.771024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:33.771711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.771988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.772261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] PATH_INFO: `/v3/projects/caa243d611754bff87dd2e2d694612a3/users/7fe400993e624d2f9a0cf3503a33fe1a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.789327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa243d611754bff87dd2e2d694612a3, user_id=7fe400993e624d2f9a0cf3503a33fe1a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:33.792821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:33.828339 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2601/5170] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:33 2022] PUT /identity/v3/projects/caa243d611754bff87dd2e2d694612a3/users/7fe400993e624d2f9a0cf3503a33fe1a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:33.839200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:33.839526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:33.839762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:33.862090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:33.894750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] MFA Rules not processed for user `7fe400993e624d2f9a0cf3503a33fe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:33.896433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:33.999746 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2570/5171] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:34.012637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:34.014676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:34.229409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e43c0-2bac-4511-8f51-ab76086aecd9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:34.237341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:34.238466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:34.242008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:34.242524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:34.296034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:34.387404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:34.394736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb8d0-8b45-4267-ba33-35d227823371 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:34.425840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2602/5172] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:36.127194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:36.211014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f0d5c-586f-4715-94cb-f44b19c21bf0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:36.219298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:36.219971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:36.220251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:36.220524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] PATH_INFO: `/v3/users/e609d00e55774b76ad90b18656813523` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:36.221935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e609d00e55774b76ad90b18656813523)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:36.224708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:36.289281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e609d00e55774b76ad90b18656813523'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:36.290377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e609d00e55774b76ad90b18656813523'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:36.291248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e609d00e55774b76ad90b18656813523'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:36.306449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e609d00e55774b76ad90b18656813523'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:36.344886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e609d00e55774b76ad90b18656813523'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:36.383706 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2571/5173] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:36 2022] DELETE /identity/v3/users/e609d00e55774b76ad90b18656813523 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:36.388074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:36.388597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:36.388597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:36.454395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:36.459010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:36.588207 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2603/5174] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:36.635382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:36.637068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:36.686765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:36.751990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dfed5-89eb-489b-ad16-9cca98607aed admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:36.760601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:36.761848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:36.762365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:36.762975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:36.775597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:36.777417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:36.789902 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2572/5175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:37.948520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:37.950692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:37.964197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d50a4d-a9cf-4abf-945a-efda691bb223 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:37.971411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:37.972296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:37.972708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:37.973143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] PATH_INFO: `/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:37.974645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd73f0def8a4bf3b8645b0b6ff17f47)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:37.977757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:38.068941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd73f0def8a4bf3b8645b0b6ff17f47', 'request_id': 'req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.081590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd73f0def8a4bf3b8645b0b6ff17f47', 'request_id': 'req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.091487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd73f0def8a4bf3b8645b0b6ff17f47', 'request_id': 'req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.111456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] The token cache is being invalidate because project cfd73f0def8a4bf3b8645b0b6ff17f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:38.111964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.113027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.115096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2604/5176] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:37 2022] DELETE /identity/v3/projects/cfd73f0def8a4bf3b8645b0b6ff17f47 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:38.120598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:38.125959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:38.127953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:38.137275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b7863-632c-4c49-8bf6-742520efa28a service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:38.193929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:38.237947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966bfce-c2c5-4c9c-81ff-ea1ca642c8c3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:38.246029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:38.246767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:38.247096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:38.247369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:38.249297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:38.263659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:38.264312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:38.264602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:38.264833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] PATH_INFO: `/v3/users/7fe400993e624d2f9a0cf3503a33fe1a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:38.267307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:38.269733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe400993e624d2f9a0cf3503a33fe1a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:38.270471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:38.272332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:38.290391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2605/5177] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:38.330395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:38.334209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:38.358681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe400993e624d2f9a0cf3503a33fe1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.359488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe400993e624d2f9a0cf3503a33fe1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.360229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe400993e624d2f9a0cf3503a33fe1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.364698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e15d5-ba23-4151-a90a-fb522137ad07 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:38.376216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:38.376876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:38.377181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:38.377447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] PATH_INFO: `/v3/users/26ff90455642401986673d1abae1bf16` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:38.380368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ff90455642401986673d1abae1bf16)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:38.385023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe400993e624d2f9a0cf3503a33fe1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.385286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:38.395969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe400993e624d2f9a0cf3503a33fe1a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.425270 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2573/5178] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:38 2022] DELETE /identity/v3/users/7fe400993e624d2f9a0cf3503a33fe1a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:38.469381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ff90455642401986673d1abae1bf16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.470369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ff90455642401986673d1abae1bf16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.480267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ff90455642401986673d1abae1bf16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.492775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ff90455642401986673d1abae1bf16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.494602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ff90455642401986673d1abae1bf16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:38.523599 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2606/5179] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:38 2022] DELETE /identity/v3/users/26ff90455642401986673d1abae1bf16 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:38.916657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:38.918244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:38.970557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:38.994410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:38.996680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:39.010196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083334-d13c-46e1-bf67-ed8a9a8cc334 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.090653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.091633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.092071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.092621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] PATH_INFO: `/v3/projects/bd304d4926d34ba085d1a1f1bd0b7fdd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.093977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd304d4926d34ba085d1a1f1bd0b7fdd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.096254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.104645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b311c-451a-4068-8d11-b2e51b7d4699 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.111793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.112465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.113170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.113370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] PATH_INFO: `/v3/projects/caa243d611754bff87dd2e2d694612a3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.115124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa243d611754bff87dd2e2d694612a3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.118032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.176453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'request_id': 'req-47bd3703-9c53-4288-a0c6-425a11a5b4d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.181570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.186269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa243d611754bff87dd2e2d694612a3', 'request_id': 'req-11940df1-d907-4f34-8ce1-34dc8fdf29bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.187100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'request_id': 'req-47bd3703-9c53-4288-a0c6-425a11a5b4d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.196585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'request_id': 'req-47bd3703-9c53-4288-a0c6-425a11a5b4d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.198816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa243d611754bff87dd2e2d694612a3', 'request_id': 'req-11940df1-d907-4f34-8ce1-34dc8fdf29bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.219193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa243d611754bff87dd2e2d694612a3', 'request_id': 'req-11940df1-d907-4f34-8ce1-34dc8fdf29bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.220039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] The token cache is being invalidate because project bd304d4926d34ba085d1a1f1bd0b7fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:39.220448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.221357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.227553 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2574/5180] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:38 2022] DELETE /identity/v3/projects/bd304d4926d34ba085d1a1f1bd0b7fdd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:39.228863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:39.230340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:39.246403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] The token cache is being invalidate because project caa243d611754bff87dd2e2d694612a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:39.247087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.247979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-11940df1-d907-4f34-8ce1-34dc8fdf29bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.253694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2607/5181] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:38 2022] DELETE /identity/v3/projects/caa243d611754bff87dd2e2d694612a3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:39.257103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734904-2a79-4af4-9d9f-05acf13ff015 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.257681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734904-2a79-4af4-9d9f-05acf13ff015 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.258216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734904-2a79-4af4-9d9f-05acf13ff015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.291533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-33734904-2a79-4af4-9d9f-05acf13ff015 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:39.293115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33734904-2a79-4af4-9d9f-05acf13ff015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:39.378388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2608/5182] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:39.386669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.387285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.387582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.417816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:39.419708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:39.433985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2609/5183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:39.435075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:39.462097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc73fc4-f899-4ed4-8afc-6057dbefab60 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.471355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd3703-9c53-4288-a0c6-425a11a5b4d0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.478512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.479400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.479868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.480312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.481166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:39.482951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.484591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.504058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.504732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.505052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.505522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] PATH_INFO: `/v3/users/a97a74b543814f94968142e6c28b8a62` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.510261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97a74b543814f94968142e6c28b8a62)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.517689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.519127 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2610/5184] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:39.520244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:39.533383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113c4d4-689f-48ca-affd-b00e002c958b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.538888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.540036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.540399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.540720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.541551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.543637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.571036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.607957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2611/5185] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:39 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:39.609097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:39.680441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97a74b543814f94968142e6c28b8a62'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.683016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97a74b543814f94968142e6c28b8a62'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.686640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97a74b543814f94968142e6c28b8a62'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.701702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97a74b543814f94968142e6c28b8a62'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.715457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97a74b543814f94968142e6c28b8a62'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:39.743377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2575/5186] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:39 2022] DELETE /identity/v3/users/a97a74b543814f94968142e6c28b8a62 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:39.775149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cccc2-e047-4a3e-8a04-cb23b6c71baf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:39.897822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.932597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:39.934607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:39.934995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:39.935577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:39.937631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:39.942327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:39.978256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2612/5187] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:39 2022] POST /identity/v3/users => generated 281 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:39.982885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:39.988309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:40.004072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19775f6a-0689-4922-9b28-dcc707264afa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:40.014312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:40.014960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.015241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.015511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.016154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:40.017798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:40.032569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2576/5188] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:40.035912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:40.053243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d1dd-2c97-4f37-926c-953b4e408900 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:40.060567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:40.061201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.061478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.061745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.062967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:40.067240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049cbcd-02eb-4f5c-83a9-0f938e4f9ef4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:40.079860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2613/5189] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:40.084978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:40.099821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9e58-285b-476d-b4c4-75b6cabbd99e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:40.112015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:40.112599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.113014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.113386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] PATH_INFO: `/v3/projects/4a36548b3d794cb89999623b516f664e/users/b23d27634a434505b2090d7800df1f73/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.142227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a36548b3d794cb89999623b516f664e, user_id=b23d27634a434505b2090d7800df1f73, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:40.146666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:40.164800 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2577/5190] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:40 2022] PUT /identity/v3/projects/4a36548b3d794cb89999623b516f664e/users/b23d27634a434505b2090d7800df1f73/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:40.184152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.185520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.185910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.221057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] MFA Rules not processed for user `b23d27634a434505b2090d7800df1f73`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:40.222429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:40.303522 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2614/5191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:40.316990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:40.424162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482eee-b581-4498-adcf-4acb079dfb7f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:40.429406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:40.430268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.430649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.431020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] PATH_INFO: `/v3/users/b23d27634a434505b2090d7800df1f73` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.432307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23d27634a434505b2090d7800df1f73)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:40.435157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:40.542620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23d27634a434505b2090d7800df1f73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.543911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23d27634a434505b2090d7800df1f73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.545566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23d27634a434505b2090d7800df1f73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.563871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:40.564444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23d27634a434505b2090d7800df1f73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.565906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:40.576229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:40.581330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bcd2babb-2da5-40b9-8ba6-7706a969db84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23d27634a434505b2090d7800df1f73'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.593376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab61aa-72b6-4a85-81dd-e9153418d44b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:40.624992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2578/5192] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:11:40 2022] DELETE /identity/v3/users/b23d27634a434505b2090d7800df1f73 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:40.628478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:40.628478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.628478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.628478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] PATH_INFO: `/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.630794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:40.631353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:40.631783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:40.644210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26cf6a5e1c84c8bb3d0eea77ad8cae1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:40.652044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:40.672525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:40.675216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:40.741152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26cf6a5e1c84c8bb3d0eea77ad8cae1', 'request_id': 'req-98ef8209-f8e2-4996-b77a-bd264894efa4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.754966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26cf6a5e1c84c8bb3d0eea77ad8cae1', 'request_id': 'req-98ef8209-f8e2-4996-b77a-bd264894efa4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.791031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26cf6a5e1c84c8bb3d0eea77ad8cae1', 'request_id': 'req-98ef8209-f8e2-4996-b77a-bd264894efa4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.817289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] The token cache is being invalidate because project c26cf6a5e1c84c8bb3d0eea77ad8cae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:40.817788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.818650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:40.824753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2579/5193] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:40.824986 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2615/5194] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:40 2022] DELETE /identity/v3/projects/c26cf6a5e1c84c8bb3d0eea77ad8cae1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:40.855220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:40.856743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:41.026066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6ad0f-1397-4bba-8e6b-cc843c7b520c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:41.197306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:41.198387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:41.198891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:41.199376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:41.205272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:41.325277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:41.365163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:41.367626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d4579-175d-42cf-8c50-5522da75ea21 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:41.394691 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2580/5195] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:42.464800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:42.466548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:42.508850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8209-f8e2-4996-b77a-bd264894efa4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:42.516087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:42.516753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:42.517064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:42.517340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] PATH_INFO: `/v3/projects/4a36548b3d794cb89999623b516f664e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:42.521846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a36548b3d794cb89999623b516f664e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:42.526307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:42.563816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:42.604815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a36548b3d794cb89999623b516f664e', 'request_id': 'req-0c6dc9a4-ce3a-44e8-b227-5216d954269c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:42.611819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a36548b3d794cb89999623b516f664e', 'request_id': 'req-0c6dc9a4-ce3a-44e8-b227-5216d954269c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:42.623739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a36548b3d794cb89999623b516f664e', 'request_id': 'req-0c6dc9a4-ce3a-44e8-b227-5216d954269c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:42.651441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] The token cache is being invalidate because project 4a36548b3d794cb89999623b516f664e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:11:42.652398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:42.653881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0c6dc9a4-ce3a-44e8-b227-5216d954269c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:11:42.656264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2616/5196] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:11:42 2022] DELETE /identity/v3/projects/4a36548b3d794cb89999623b516f664e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:42.662092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:42.662951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:42.663228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:42.699621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:42.716315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:42.846811 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2581/5197] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:42.851355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:42.851794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:42.852252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:42.888672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:42.893822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:42.905283 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2617/5198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:42.909755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:42.921788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99636d-9b58-4fea-b8a7-4eaa67b48aea None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:42.927784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:42.928634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:42.930180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:42.930752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:42.932255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:11:42.932733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:42.935006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:42.956233 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2582/5199] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:11:42.961422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:42.976519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12d315-1225-4c67-acfb-f4288d36d05e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:42.981740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:42.983088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:42.983368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:42.983637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:42.984287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:42.986600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.036714 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2618/5200] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:42 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:43.041315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.057695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3ff35-577b-4514-be48-6b8ab86a37a6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.180453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.181602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.182119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.182711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.183873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:43.186050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.240127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2583/5201] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:43 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:43.245142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.281125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255f2c-2cf4-407d-8b48-6944f1454f0f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.294766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.295402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.295682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.296661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.297363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:43.299017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.313723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2619/5202] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:43.317614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.328572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0ff39-19f0-43af-ad06-b4348a9e0d48 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.336838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.337935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.338700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.339092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.341312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:43.342613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416e57-8e24-4421-abae-4014afa8a187 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.381023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2584/5203] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:43.385319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.404104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308307-f18d-4ca9-bac3-2f3b373d0e50 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.411269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.411951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.412225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.412543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] PATH_INFO: `/v3/projects/4ae2422f905548409cdbfd66c43e21ab/users/3146b0718c8644728c9d758fa3519ff0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.441058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae2422f905548409cdbfd66c43e21ab, user_id=3146b0718c8644728c9d758fa3519ff0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:43.443868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.469300 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2620/5204] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:43 2022] PUT /identity/v3/projects/4ae2422f905548409cdbfd66c43e21ab/users/3146b0718c8644728c9d758fa3519ff0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:11:43.480021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.481647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.482679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.547146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] MFA Rules not processed for user `3146b0718c8644728c9d758fa3519ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:43.548827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:43.605824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:43.640959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2585/5205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:43.643003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.761023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cdd10-fe23-46e0-a828-3f802b6dd8e8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.769785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.770635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.770960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.771334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.772075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:43.775246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:43.820378 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2621/5206] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:43 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:43.821867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:43.854644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c0be-c4e7-45fc-9625-473a97d76859 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:43.985519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:43.990289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:43.990289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:43.990289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:43.991192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:44.004945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:44.050347 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2586/5207] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:43 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:44.052669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:44.070133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce6f49-bf1a-41ed-8c61-daa2c85cad85 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:44.082999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:44.083639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:44.083916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:44.084187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:44.084851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:44.087084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:44.116632 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2622/5208] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:44.120889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:44.165890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f830c4-7e42-4fd6-8dc4-ce65b7a04c53 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:44.171540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:44.172666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:44.173755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:44.174268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:44.175414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:44.177404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6a43-e9bc-4a6e-b9f6-1cd61036196f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:44.218147 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2587/5209] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:44.222183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:44.235597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c438cd-a8d0-471b-8a9a-136e9124acc9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:44.254888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:44.255601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:44.255883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:44.256158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] PATH_INFO: `/v3/projects/d84f0a89056a46ce8aebff6a3b892372/users/6421f88444244912b0d946a5f873d47d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:44.285926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84f0a89056a46ce8aebff6a3b892372, user_id=6421f88444244912b0d946a5f873d47d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:44.288740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:44.304266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:44.327437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2623/5210] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:44 2022] PUT /identity/v3/projects/d84f0a89056a46ce8aebff6a3b892372/users/6421f88444244912b0d946a5f873d47d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:44.328965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475c66-ae27-4493-867c-9af410e2945b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:44.329258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475c66-ae27-4493-867c-9af410e2945b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:44.329534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475c66-ae27-4493-867c-9af410e2945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:44.400163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-30475c66-ae27-4493-867c-9af410e2945b None None] MFA Rules not processed for user `6421f88444244912b0d946a5f873d47d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:44.401449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30475c66-ae27-4493-867c-9af410e2945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:44.560366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:44.609200 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2588/5211] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:11:44.766962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ca536-7050-41f8-8cc1-6e6cf1a650ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:44.784313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:44.785013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:44.785306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:44.785560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:44.786726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:44.793633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:44.828942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2624/5212] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:11:44 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:11:44.832841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30475c66-ae27-4493-867c-9af410e2945b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:44.853737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30475c66-ae27-4493-867c-9af410e2945b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:44.966232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:44.997648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.000997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.001390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.001740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.004417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.010131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.107682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2589/5213] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:11:44 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:11:45.110412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:45.131595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7719e-272d-4d4d-8a09-a05fb8639539 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:45.148609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.149265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.149542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.149810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.150460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.152081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.178461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2625/5214] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:11:45.180369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:45.200441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479942c-42aa-45bd-9cf2-a440be83a152 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:45.206238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.207795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.208182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.208546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] PATH_INFO: `/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca/users/1d909e3cfa5849ea994bf0583f87bed1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.246643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ead5cf572d846c69e95ef5e6328b8ca, user_id=1d909e3cfa5849ea994bf0583f87bed1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.249997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.288692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2590/5215] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:45 2022] PUT /identity/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca/users/1d909e3cfa5849ea994bf0583f87bed1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:45.292389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:45.312281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6025-88f8-4c19-9337-b3cc5a07ab31 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:45.395926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.396649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.397158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.397604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.398346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.400303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4058-7e6f-422d-917e-ffe318d019b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.415767 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2626/5216] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:11:45.418514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:45.435711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7f1e9-f369-482f-b5e9-cbe13841546a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:45.441338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.442854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.442854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.443146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] PATH_INFO: `/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca/users/1d909e3cfa5849ea994bf0583f87bed1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.446492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ead5cf572d846c69e95ef5e6328b8ca, user_id=1d909e3cfa5849ea994bf0583f87bed1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.449921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.478257 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2591/5217] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:11:45 2022] PUT /identity/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca/users/1d909e3cfa5849ea994bf0583f87bed1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:11:45.488750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9076-3d00-48b8-bcba-b5911e578387 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.489272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9076-3d00-48b8-bcba-b5911e578387 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.489703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9076-3d00-48b8-bcba-b5911e578387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.552189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-096b9076-3d00-48b8-bcba-b5911e578387 None None] MFA Rules not processed for user `1d909e3cfa5849ea994bf0583f87bed1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:45.553544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-096b9076-3d00-48b8-bcba-b5911e578387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:45.655495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:45.678826 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2627/5218] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:45.688396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:45.690762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:45.769812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126f85-baf3-4e9e-a8a1-6818e179d744 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:45.775053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:45.775866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:45.776317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:45.776740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:45.879950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:45.881458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:45.919941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2592/5219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:51.914868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:51.915367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:51.915481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:51.955935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:11:51.957715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:52.096377 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2628/5220] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:11:55.895718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:57.252155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:57.254530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:57.284160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dafa9-1208-4c86-b794-e20a5903c4b1 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:57.296678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:57.297604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:57.298119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:57.298815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:57.317389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:57.322406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:57.323863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:57.333566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350270ae-ee9b-4820-b6c8-55d144c92c01 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:57.339746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:57.340493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:57.340878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:57.341384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:57.343688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:57.350218 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2593/5221] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:57.524734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:57.526237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:57.540849 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2629/5222] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:04.772675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:04.784792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb72e5-d208-4eda-9d00-bc0e598ad8f1 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:04.789804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:04.790979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:04.791463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:04.791930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:04.873026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:04.875690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8999354-82f3-47b3-898d-f0ec7f885d14 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:04.891518 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2594/5223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:07.533176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=57 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:09.864761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:09.867819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:09.885245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2829-67e3-430f-938e-31a1aac6dccb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:09.892789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:09.893963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:09.894431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:09.894947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] PATH_INFO: `/v3/users/d6a1ef8f9241432dbb7c15d1bddaef00` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:09.896305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a1ef8f9241432dbb7c15d1bddaef00)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:09.898899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:09.963798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a1ef8f9241432dbb7c15d1bddaef00'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:09.967384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a1ef8f9241432dbb7c15d1bddaef00'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:09.979774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a1ef8f9241432dbb7c15d1bddaef00'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:09.994087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a1ef8f9241432dbb7c15d1bddaef00'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:09.995369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a1ef8f9241432dbb7c15d1bddaef00'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:10.017932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2630/5224] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:09 2022] DELETE /identity/v3/users/d6a1ef8f9241432dbb7c15d1bddaef00 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:10.023713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:10.024627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:10.025155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:10.071181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:10.072810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:10.187238 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2595/5225] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:10.202999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:10.206738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:10.314132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c80b8-a31a-4fa2-ae63-5799ea9da3e0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:10.318356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:10.319382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:10.319762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:10.320129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:10.331242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:10.332745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990afbaf-0b5d-40a3-a364-d2d8fe0d28fe service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:10.345984 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2631/5226] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:10.905644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:10.907302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:10.926467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726bfe-08dc-4d12-b211-29970a9b8307 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:10.931924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:10.932809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:10.933535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:10.934006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] PATH_INFO: `/v3/projects/749fccc5af554fae9f093a7ef15f17f1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:10.935587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=749fccc5af554fae9f093a7ef15f17f1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:10.937970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.061259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749fccc5af554fae9f093a7ef15f17f1', 'request_id': 'req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.083914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749fccc5af554fae9f093a7ef15f17f1', 'request_id': 'req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.100287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749fccc5af554fae9f093a7ef15f17f1', 'request_id': 'req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.132342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] The token cache is being invalidate because project 749fccc5af554fae9f093a7ef15f17f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:11.132773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.138320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.140630 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2596/5227] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:10 2022] DELETE /identity/v3/projects/749fccc5af554fae9f093a7ef15f17f1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:11.145680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbd1f-a021-47b2-af79-1c90d737ced1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.146173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbd1f-a021-47b2-af79-1c90d737ced1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.146272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbd1f-a021-47b2-af79-1c90d737ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.181824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.184010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:11.188541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c18fbd1f-a021-47b2-af79-1c90d737ced1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:11.189781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c18fbd1f-a021-47b2-af79-1c90d737ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:11.202207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:11.345650 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2632/5228] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:11.355131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.355691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.356120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.358112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77967a-7ac1-4be5-81fa-a1367c5bd0fa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.374255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.375333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.375788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.376234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.378517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:11.390413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:11.391677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:11.401571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2633/5229] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:11.405545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.408591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.414036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.417804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7f335-c8d9-4559-b136-f8ebab11b65b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.423207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.424419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.425137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.425600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.426614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:11.427260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.429568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.432511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:11.447295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2634/5230] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:11.449174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2597/5231] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:11.464049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.490087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea771d1-d1c9-4a86-8014-8a3845d12b1c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.497850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.513904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.515296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.515878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.517110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.532220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.592029 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2635/5232] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:11 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:11.598177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.611210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779da0-28a4-4003-a78b-6bfb9bf1c320 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.703405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.705261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.705890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.706214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.706526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.707214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.707780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:11.709834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.743695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2598/5233] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:11 2022] POST /identity/v3/users => generated 281 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:11.746407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f25e3-722b-4987-a048-7555423c40fe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.748422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.751821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.752620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.752898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.753197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] PATH_INFO: `/v3/users/45369fea2a654d1d88145db9677a53fb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.754792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45369fea2a654d1d88145db9677a53fb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.757449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.768465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faaef0-0cfb-4e48-b0d0-d405b8538959 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.776867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.794091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.794644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.795029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.795887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.800991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.815643 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2599/5234] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:12:11.820212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.831472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b35f-06a9-497b-b85e-c6ca5a74b779 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.839326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45369fea2a654d1d88145db9677a53fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.848196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45369fea2a654d1d88145db9677a53fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.852291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.852952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.853236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.853817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.854154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.855783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.882026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45369fea2a654d1d88145db9677a53fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.888831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2600/5235] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:11.892774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:11.901023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45369fea2a654d1d88145db9677a53fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.902530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-382679bb-b044-452a-b3b5-dd7be47966e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45369fea2a654d1d88145db9677a53fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:11.903699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a023-86f9-47a8-aa3c-ae9c479c6f1c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:11.909287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:11.910069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:11.910392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:11.910753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] PATH_INFO: `/v3/projects/03d79e7f058f46669adf09c0e7ca266f/users/84359e0d3bfc47aaaf3f179dc5457aea/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:11.946862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d79e7f058f46669adf09c0e7ca266f, user_id=84359e0d3bfc47aaaf3f179dc5457aea, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:11.951945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:11.964271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2636/5236] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:11 2022] DELETE /identity/v3/users/45369fea2a654d1d88145db9677a53fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:11.988584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2601/5237] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:11 2022] PUT /identity/v3/projects/03d79e7f058f46669adf09c0e7ca266f/users/84359e0d3bfc47aaaf3f179dc5457aea/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:12.000363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:12.000695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:12.000962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:12.063462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] MFA Rules not processed for user `84359e0d3bfc47aaaf3f179dc5457aea`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:12.064716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:12.219116 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2637/5238] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:12.237954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:12.240629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:12.320579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:12.364510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87fc5-3db6-4635-aa52-52135caff1ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:12.388604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:12.389367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:12.389649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:12.390328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:12.429584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:12.433796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:12.448717 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2602/5239] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:12.481820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:12.483736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:12.584107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:12.641303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2293ac-a843-49e5-b12b-cb694f0fc946 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:12.648206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:12.649481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:12.649788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:12.650063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] PATH_INFO: `/v3/projects/7db61a6ccbee4a298909d79faabc004d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:12.652039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db61a6ccbee4a298909d79faabc004d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:12.654227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:12.726003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db61a6ccbee4a298909d79faabc004d', 'request_id': 'req-6666e171-9074-4576-a7d3-9cfa4783af81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:12.748981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db61a6ccbee4a298909d79faabc004d', 'request_id': 'req-6666e171-9074-4576-a7d3-9cfa4783af81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:12.763671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db61a6ccbee4a298909d79faabc004d', 'request_id': 'req-6666e171-9074-4576-a7d3-9cfa4783af81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:12.782933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] The token cache is being invalidate because project 7db61a6ccbee4a298909d79faabc004d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:12.783616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:12.784527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6666e171-9074-4576-a7d3-9cfa4783af81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:12.790618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2638/5240] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:12 2022] DELETE /identity/v3/projects/7db61a6ccbee4a298909d79faabc004d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:12.791470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:12.795885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:12.796830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:12.797972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:12.823891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faff2e-bfdf-412f-96b8-d5a22b25045c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:12.826087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:12.827989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:12.915818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2639/5241] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:12.971697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:12.972335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:12.972822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:12.973125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] PATH_INFO: `/v3/users/2510d0928e5a4bd7bc40e8e2433b5072` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:12.974496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2510d0928e5a4bd7bc40e8e2433b5072)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:12.977032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:13.054208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2510d0928e5a4bd7bc40e8e2433b5072'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.055367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2510d0928e5a4bd7bc40e8e2433b5072'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.056246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2510d0928e5a4bd7bc40e8e2433b5072'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.069104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2510d0928e5a4bd7bc40e8e2433b5072'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.087603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b0312d31-dc1f-4aad-b0ec-d1a10e058960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2510d0928e5a4bd7bc40e8e2433b5072'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.121792 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2603/5242] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:12 2022] DELETE /identity/v3/users/2510d0928e5a4bd7bc40e8e2433b5072 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:13.562370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:13.564193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:13.599608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82320434-6195-44b4-9b52-4d5d48feafa5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:13.735924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:13.737604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:13.738195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:13.738733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] PATH_INFO: `/v3/projects/4c42188ca4884c69a81f234374d78de3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:13.740892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c42188ca4884c69a81f234374d78de3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:13.750140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:13.769321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:13.858353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c42188ca4884c69a81f234374d78de3', 'request_id': 'req-1e4886d7-41e3-4c00-b996-803391614069'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.865961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c42188ca4884c69a81f234374d78de3', 'request_id': 'req-1e4886d7-41e3-4c00-b996-803391614069'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.883921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c42188ca4884c69a81f234374d78de3', 'request_id': 'req-1e4886d7-41e3-4c00-b996-803391614069'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.908154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] The token cache is being invalidate because project 4c42188ca4884c69a81f234374d78de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:13.908494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.909190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e4886d7-41e3-4c00-b996-803391614069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:13.910753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2640/5243] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:13 2022] DELETE /identity/v3/projects/4c42188ca4884c69a81f234374d78de3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:13.916309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:13.916755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:13.917034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:13.965613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:13.967564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:14.040867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:14.063131 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2604/5244] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:14.063443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.063797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.064042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.090861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:14.092363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:14.103291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2641/5245] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:14.107532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.119436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae193-ede6-456b-b1bf-dbe622796c5b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.139999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.140760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.141157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.141445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.142178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:14.142418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.144074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.181175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.187919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2605/5246] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:14.198150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a82f6-6ae0-489c-b949-93de7bd8ecdb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.203206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.203826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.204106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.204377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.205040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.207017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.248951 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2642/5247] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:14 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:14.252058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.267454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ba63-d36e-4d71-9d80-6259c9c53021 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.375938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.376756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.377217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.377672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.378481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.381097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.424926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2606/5248] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:14 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:12:14.428335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.442748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e08c8-edd9-4cbe-9f63-52a1a3799756 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.454001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.454718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.454999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.455272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.455944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.457902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.471413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2643/5249] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:14.476324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.490209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f037f-8693-406f-ad19-1a3670915da0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.497149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.498234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.498592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.498961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.499922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.502522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda0c0f-6081-4374-b891-000c0beafdc7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.521071 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2607/5250] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:14.522404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.535869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77dbe-52d6-4b66-b11f-35fcaf21b1a3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.553404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.554159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.554504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.554777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] PATH_INFO: `/v3/projects/e0e72e7f3f304aa7b72036f1ab6ab000/users/bafdc127af914320a17d15b77fb4ce5f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.604598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e72e7f3f304aa7b72036f1ab6ab000, user_id=bafdc127af914320a17d15b77fb4ce5f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.607976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.637698 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2644/5251] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:14 2022] PUT /identity/v3/projects/e0e72e7f3f304aa7b72036f1ab6ab000/users/bafdc127af914320a17d15b77fb4ce5f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:14.639420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.639767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.640251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.666429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:14.668080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:14.810971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2608/5252] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:14.829205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:14.829486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:14.930317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa24ec3-2e41-4f2b-8626-ee73175d9e93 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:14.936540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:14.937773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:14.937773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:14.938466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:14.954909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:14.957022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db5dea-0137-4ae4-be08-bd8a102e896a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:14.973943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2645/5253] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:16.380600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:16.382256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:16.405899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75903f62-c29d-425a-861c-a2cdb589b241 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:16.413747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:16.414650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:16.415002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:16.415546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] PATH_INFO: `/v3/users/3146b0718c8644728c9d758fa3519ff0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:16.417058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3146b0718c8644728c9d758fa3519ff0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:16.421701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:16.508026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3146b0718c8644728c9d758fa3519ff0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:16.509326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3146b0718c8644728c9d758fa3519ff0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:16.510523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3146b0718c8644728c9d758fa3519ff0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:16.526716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3146b0718c8644728c9d758fa3519ff0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:16.534284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:16.538680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3146b0718c8644728c9d758fa3519ff0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:16.577065 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2609/5254] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:16 2022] DELETE /identity/v3/users/3146b0718c8644728c9d758fa3519ff0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:16.577951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:16.578503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:16.578677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:16.612135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:16.613787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:16.675326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:16.732225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2646/5255] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:16.777584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:16.782624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:16.928160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539bdfb-d9db-4f09-a48c-3bf96ae1f23b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:16.940019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:16.940770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:16.941177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:16.941456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:16.965406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:16.967247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:16.997773 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2610/5256] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:17.760029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:17.763728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:17.782718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46fc98-0f76-46a6-bc18-c20fae7ee2e2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:17.800055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:17.801132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:17.801605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:17.803676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] PATH_INFO: `/v3/projects/4ae2422f905548409cdbfd66c43e21ab` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:17.805108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae2422f905548409cdbfd66c43e21ab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:17.815365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:17.924301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae2422f905548409cdbfd66c43e21ab', 'request_id': 'req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:17.941101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae2422f905548409cdbfd66c43e21ab', 'request_id': 'req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:17.979330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae2422f905548409cdbfd66c43e21ab', 'request_id': 'req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.018926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] The token cache is being invalidate because project 4ae2422f905548409cdbfd66c43e21ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:18.019292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.024266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.029480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2647/5257] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:17 2022] DELETE /identity/v3/projects/4ae2422f905548409cdbfd66c43e21ab => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:18.030823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:18.054183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0a13-f494-4080-ac86-5405660c90b9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:18.207360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:18.208014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:18.208291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:18.208548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] PATH_INFO: `/v3/users/6421f88444244912b0d946a5f873d47d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:18.210590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6421f88444244912b0d946a5f873d47d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:18.212538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:18.320053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6421f88444244912b0d946a5f873d47d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.320948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6421f88444244912b0d946a5f873d47d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.322373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6421f88444244912b0d946a5f873d47d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.338109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6421f88444244912b0d946a5f873d47d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.351196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6421f88444244912b0d946a5f873d47d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:18.383341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:18.394117 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2611/5258] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:18 2022] DELETE /identity/v3/users/6421f88444244912b0d946a5f873d47d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:20.572350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:20.573868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:20.596829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b19b86-7481-4ce3-adc4-a3cc6b97e18c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:20.764683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:20.765432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:20.765706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:20.765983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] PATH_INFO: `/v3/projects/d84f0a89056a46ce8aebff6a3b892372` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:20.772354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84f0a89056a46ce8aebff6a3b892372)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:20.781005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:20.909646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84f0a89056a46ce8aebff6a3b892372', 'request_id': 'req-bfdcb224-2979-415d-911d-faeaa69a825e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:20.926562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84f0a89056a46ce8aebff6a3b892372', 'request_id': 'req-bfdcb224-2979-415d-911d-faeaa69a825e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:20.944310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84f0a89056a46ce8aebff6a3b892372', 'request_id': 'req-bfdcb224-2979-415d-911d-faeaa69a825e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:20.949793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:20.971709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] The token cache is being invalidate because project d84f0a89056a46ce8aebff6a3b892372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:20.972259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:20.975512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:20.978039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2648/5259] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:20 2022] DELETE /identity/v3/projects/d84f0a89056a46ce8aebff6a3b892372 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:20.981717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:20.983173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:21.006299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42194ec-35b7-43c8-a4c8-9e401b5558ad admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:21.262561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:21.263231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:21.263512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:21.263785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] PATH_INFO: `/v3/users/1d909e3cfa5849ea994bf0583f87bed1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:21.267197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d909e3cfa5849ea994bf0583f87bed1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:21.272444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:21.419276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d909e3cfa5849ea994bf0583f87bed1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:21.421975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d909e3cfa5849ea994bf0583f87bed1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:21.423929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d909e3cfa5849ea994bf0583f87bed1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:21.439284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d909e3cfa5849ea994bf0583f87bed1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:21.457713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b6d7c2d7-a2db-4258-aac9-39ef1855ae83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d909e3cfa5849ea994bf0583f87bed1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:21.504865 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2612/5260] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:20 2022] DELETE /identity/v3/users/1d909e3cfa5849ea994bf0583f87bed1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:22.458751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:22.461045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:22.485179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb224-2979-415d-911d-faeaa69a825e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:22.609224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:22.623620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:22.624055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:22.624258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] PATH_INFO: `/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:22.626403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ead5cf572d846c69e95ef5e6328b8ca)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:22.628759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:22.758969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ead5cf572d846c69e95ef5e6328b8ca', 'request_id': 'req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:22.766867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ead5cf572d846c69e95ef5e6328b8ca', 'request_id': 'req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:22.782912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ead5cf572d846c69e95ef5e6328b8ca', 'request_id': 'req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:22.809944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] The token cache is being invalidate because project 9ead5cf572d846c69e95ef5e6328b8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:22.810583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:22.814082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2615dc20-07d4-4b3c-88a5-2de1f7f1e50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:22.818230 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2649/5261] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:22 2022] DELETE /identity/v3/projects/9ead5cf572d846c69e95ef5e6328b8ca => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:22.823144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:22.824219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:22.824711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:22.867151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:22.868759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:23.003177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2613/5262] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:23.012995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.013284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.013560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.083071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:23.084356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:23.114595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2650/5263] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:23.117301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.156722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4533a76-b612-49b8-b1a0-804881bfc6c5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.167748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.168380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.168657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.168942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.169604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:23.169904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.176040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.223082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2614/5264] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:23.228345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.245882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82c4d-8e3b-48d6-9bf9-92a18429cfc4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.261177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.261815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.262083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.262350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.263284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.265357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.352082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2651/5265] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:23 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:23.356654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.387850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b11d-ae41-42f3-9317-423aaa6fdd0d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.398252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:23.513605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.514498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.514924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.515341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.516170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.518707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.603308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2615/5266] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:23 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:23.603988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.617771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466714-2739-49f0-b1ba-6cc744acd59f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.643447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.644369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.644870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.645425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.647517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.649395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.698440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2652/5267] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:23.702281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.723482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bca3e-3bcc-4fb6-8e6b-37d20731b366 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.733309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.733940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.734218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.734493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.735849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.738772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89790a2c-3462-44bc-a275-446d0e7d71bc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.760714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2616/5268] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:23.761527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:23.776598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327a1d7-3926-410a-940b-895efaaa876e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:23.782960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:23.784328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.790722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.791265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] PATH_INFO: `/v3/projects/60ca1dfb86a7435cb93a5d4101defdf8/users/0f2794327b224e5886d11b5f36c29f9d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.843419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ca1dfb86a7435cb93a5d4101defdf8, user_id=0f2794327b224e5886d11b5f36c29f9d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:23.846744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:23.875449 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2653/5269] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:23 2022] PUT /identity/v3/projects/60ca1dfb86a7435cb93a5d4101defdf8/users/0f2794327b224e5886d11b5f36c29f9d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:23.886689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:23.887184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:23.887441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:23.937615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] MFA Rules not processed for user `0f2794327b224e5886d11b5f36c29f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:23.939102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:24.103047 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2617/5270] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:24.108669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.164431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:24.261204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3453481-2e38-4157-bb15-410b9a2d9dd6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.267094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.267853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.268236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.268609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.269372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.271944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.339391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.359180 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2654/5271] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:24 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:24.363397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7ab7-6ef6-4b8a-9b0f-4655a81abe99 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.447935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.448785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.449221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.449585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.450345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.452466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.487168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.495663 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2618/5272] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:24 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:24.502918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925feed7-a8e4-44ca-b7bf-58acca53b3ed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.509156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.509940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.510325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.510693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.511453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.513421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.532980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.541120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2655/5273] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:24.544468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:24.553469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c08e-4c48-499b-9997-2f394499a61c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.565431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.566149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.566596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.568085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] PATH_INFO: `/v3/projects/790a80a7ab774ad581668cbf5ad155d4/users/27b2d6c04b1d401d832efa9e5087d65f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.618405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790a80a7ab774ad581668cbf5ad155d4, user_id=27b2d6c04b1d401d832efa9e5087d65f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.626312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.655902 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2619/5274] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:24 2022] PUT /identity/v3/projects/790a80a7ab774ad581668cbf5ad155d4/users/27b2d6c04b1d401d832efa9e5087d65f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:24.656893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.674451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be199-f9fb-4341-877b-dcb7f7ee470e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.847292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.847931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.848210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.848484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.849802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.851509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbc5ff-4940-48a7-b1db-ffc9e4ded4bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.883542 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2656/5275] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:12:24.888926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:24.905475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fd20b-c400-4ad5-8a25-571e8a2ae724 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:24.917010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:24.919048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.922372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.923425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] PATH_INFO: `/v3/projects/790a80a7ab774ad581668cbf5ad155d4/users/27b2d6c04b1d401d832efa9e5087d65f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:24.927570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=790a80a7ab774ad581668cbf5ad155d4, user_id=27b2d6c04b1d401d832efa9e5087d65f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:24.932205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:24.969013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2620/5276] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:24 2022] PUT /identity/v3/projects/790a80a7ab774ad581668cbf5ad155d4/users/27b2d6c04b1d401d832efa9e5087d65f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:24.979497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:24.979497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:24.979816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.039817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] MFA Rules not processed for user `27b2d6c04b1d401d832efa9e5087d65f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:25.041353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:25.244321 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2657/5277] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:25.249274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:25.262436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7868-bf73-43df-9fff-b5a449a4d45b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:25.267966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b2d6c04b1d401d832efa9e5087d65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790a80a7ab774ad581668cbf5ad155d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:25.268752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:25.269234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:25.269675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.270794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:25.271922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:25.275750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:25.302383 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2621/5278] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:25.306572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:25.326731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061209-c238-4c33-ba11-8b37dba53725 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:25.340328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b2d6c04b1d401d832efa9e5087d65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790a80a7ab774ad581668cbf5ad155d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:25.341371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:25.341810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:25.342216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.343686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:25.346716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:25.384182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:25.415149 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2658/5279] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:25 2022] POST /identity/v3/projects => generated 350 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:25.419353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:25.434688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199715e9-221d-4f9f-b41d-25fbb38a7486 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:25.567629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b2d6c04b1d401d832efa9e5087d65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790a80a7ab774ad581668cbf5ad155d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:25.570209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:25.570609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:25.571053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.572465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:25.574200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:25.578207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3806d7-8ea0-4374-9eaa-a65f11db1278 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:25.606281 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2622/5280] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:25.645803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:25.652349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:25.816295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:25.816721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:25.817146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.849029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b938-4898-4d76-9497-5ee43f85fb30 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:25.854018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] MFA Rules not processed for user `bafdc127af914320a17d15b77fb4ce5f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:25.855570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:25.858774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:25.859524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:25.859927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:25.860293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:25.879454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:25.884797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad1804-2a80-497c-b9e9-9d8742ed8219 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:25.909341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2659/5281] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:26.026558 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2623/5282] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:26.038456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:26.038880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:26.039249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:26.061723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] MFA Rules not processed for user `bafdc127af914320a17d15b77fb4ce5f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:26.063246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:26.079592 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2660/5283] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:26.100981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:26.103301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:26.205946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:26.259017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee6a37-d97e-4620-a2ac-ab4365ddd31b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:26.273009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:26.274377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:26.275059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:26.275521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:26.286406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:26.288390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:26.305431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2624/5284] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:27.412877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:27.414419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:27.442945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ba6b-65c6-4c01-94b4-3d2765f92b9f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:27.451554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:27.452571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:27.453084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:27.453544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:27.460238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:27.484860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:27.486363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:27.512095 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2661/5285] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:27.733518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:27.735471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:27.897498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4364b8-f545-496e-837e-7d40b63d93b3 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:27.912797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:27.913471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:27.913877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:27.914311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:27.916640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:27.949520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:27.951652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:27.959232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:27.961686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:27.984790 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2625/5286] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:28.169701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea768a-52b0-4473-bcf2-38c6af895423 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:28.176334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:28.177112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:28.177324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:28.177596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] PATH_INFO: `/v3/users/606397ab27814a67887f1b47f8602adf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:28.179179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606397ab27814a67887f1b47f8602adf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:28.181441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:28.361927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606397ab27814a67887f1b47f8602adf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:28.364200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606397ab27814a67887f1b47f8602adf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:28.386013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606397ab27814a67887f1b47f8602adf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:28.398824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606397ab27814a67887f1b47f8602adf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:28.399760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4d823f8-c21b-4004-a767-a9476d9f2bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606397ab27814a67887f1b47f8602adf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:28.447387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:28.461581 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2662/5287] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:27 2022] DELETE /identity/v3/users/606397ab27814a67887f1b47f8602adf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:29.127579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:29.147829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088370-cee1-4fe6-9337-5d03ff1900e3 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:29.243166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:29.244322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:29.244841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:29.245363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] PATH_INFO: `/v3/projects/332f1ee007fd480f9a7c2e23c309ec31` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:29.254895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332f1ee007fd480f9a7c2e23c309ec31)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:29.269875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:29.347959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332f1ee007fd480f9a7c2e23c309ec31', 'request_id': 'req-199ced46-a212-4c2b-8ce0-ae237d176f85'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:29.354015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:29.357758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332f1ee007fd480f9a7c2e23c309ec31', 'request_id': 'req-199ced46-a212-4c2b-8ce0-ae237d176f85'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:29.387543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332f1ee007fd480f9a7c2e23c309ec31', 'request_id': 'req-199ced46-a212-4c2b-8ce0-ae237d176f85'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:29.426074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] The token cache is being invalidate because project 332f1ee007fd480f9a7c2e23c309ec31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:29.426468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:29.427982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-199ced46-a212-4c2b-8ce0-ae237d176f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:29.432037 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2626/5288] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:29 2022] DELETE /identity/v3/projects/332f1ee007fd480f9a7c2e23c309ec31 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:29.437545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:29.437832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:29.438292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:29.481043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:29.482963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:29.646912 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2663/5289] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:29.656613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:29.657195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:29.657651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:29.690453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:29.691705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:29.705462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:29.716068 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2627/5290] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:29.719286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33cc0a-1eab-4915-9e3c-b84739ae9453 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:29.727213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:29.728219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:29.728999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:29.729580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:29.730538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:29.731032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:29.735067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:29.764699 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2664/5291] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:29.769527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:29.799662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b58c10-10e7-4683-b181-3a9745a40020 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:29.812774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:29.813799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:29.814275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:29.814777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:29.815656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:29.818014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:29.860084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2628/5292] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:29.864572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:29.882451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904dbf4-c0c5-4e75-9a59-7f6e4b119402 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:29.890535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:29.892549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.027082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46526b-296c-4798-9917-a852732969af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.028108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46526b-296c-4798-9917-a852732969af admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.028605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46526b-296c-4798-9917-a852732969af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.029306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46526b-296c-4798-9917-a852732969af admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.030169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46526b-296c-4798-9917-a852732969af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.033553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46526b-296c-4798-9917-a852732969af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.065408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cedd-0a60-4cb7-9ea4-23fb9952aa47 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:30.080193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b2d6c04b1d401d832efa9e5087d65f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '790a80a7ab774ad581668cbf5ad155d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.081563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.082320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.083081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] PATH_INFO: `/v3/projects/aea0e41af9424771a72841bcac7f520a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.085531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aea0e41af9424771a72841bcac7f520a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.088789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.103941 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2665/5293] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:29 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:30.109748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46526b-296c-4798-9917-a852732969af admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:30.145005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46526b-296c-4798-9917-a852732969af admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:30.164399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.167302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.169030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.169030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.170332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.178185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.224737 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2666/5294] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:30.231541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:30.264075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea0e41af9424771a72841bcac7f520a', 'request_id': 'req-68d54501-8591-433e-aa3e-4945b15d25e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.278119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c248c-9765-4bd1-ad9a-1c4bef6a1606 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:30.294522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea0e41af9424771a72841bcac7f520a', 'request_id': 'req-68d54501-8591-433e-aa3e-4945b15d25e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.319979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea0e41af9424771a72841bcac7f520a', 'request_id': 'req-68d54501-8591-433e-aa3e-4945b15d25e4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.345223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] The token cache is being invalidate because project aea0e41af9424771a72841bcac7f520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:30.345594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.349648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.351751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2629/5295] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:29 2022] DELETE /identity/v3/projects/aea0e41af9424771a72841bcac7f520a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:30.359520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:30.365922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.452270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.455012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.456854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.457329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.460375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.462231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.471060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:30.491211 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2667/5296] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:30.493364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:30.495525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.496489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:30.528043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a95a98-178c-4db7-aaab-80c0abef2d44 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:30.543766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.544738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.546309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54501-8591-433e-aa3e-4945b15d25e4 tempest-QuotasNegativeTest-2103190539 tempest-QuotasNegativeTest-2103190539-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:30.546835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.547420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] PATH_INFO: `/v3/projects/93a2ed40295f44e2930a150edcbc798d/users/906ed53d9d734a028b438ab998fdaaad/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.561768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:30.581359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.582600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.584966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] PATH_INFO: `/v3/users/0f2794327b224e5886d11b5f36c29f9d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.587774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2794327b224e5886d11b5f36c29f9d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.594882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a2ed40295f44e2930a150edcbc798d, user_id=906ed53d9d734a028b438ab998fdaaad, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:30.596155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.605912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7ace-54f3-4736-b45c-b7de17642d3b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:30.638959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2668/5297] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:30 2022] PUT /identity/v3/projects/93a2ed40295f44e2930a150edcbc798d/users/906ed53d9d734a028b438ab998fdaaad/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:30.647451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.648043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.651564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.716766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:30.718243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.761960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2794327b224e5886d11b5f36c29f9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.763648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2794327b224e5886d11b5f36c29f9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.766091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2794327b224e5886d11b5f36c29f9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.776344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2794327b224e5886d11b5f36c29f9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.795845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f7ed45b5-34f9-40ac-8aa2-c0e9ab8206bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2794327b224e5886d11b5f36c29f9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:30.835417 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2630/5298] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:30 2022] DELETE /identity/v3/users/0f2794327b224e5886d11b5f36c29f9d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:30.837882 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2669/5299] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:30.856278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:30.856808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:30.857489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:30.857747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:30.860607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.926585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:30.929570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:30.980483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69e4b-9d50-481b-9812-c6b257bc3480 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:31.029030 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2631/5300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:31.044929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:31.062027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:31.062719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:31.065306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:31.065815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:31.090037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:31.091949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:31.110834 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2670/5301] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:31.131618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf8c4-b941-4b86-b62e-f685c78bf2da None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:31.136319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:31.137783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:31.138316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:31.138752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:31.167081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:31.169197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:31.187606 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2632/5302] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:32.147827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:32.150330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:32.176231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa564-eb20-47a2-aba2-8412f58c7526 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:32.190908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:32.191555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:32.192037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:32.192593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] PATH_INFO: `/v3/projects/60ca1dfb86a7435cb93a5d4101defdf8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:32.194018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ca1dfb86a7435cb93a5d4101defdf8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:32.198104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:32.273313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:32.304848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ca1dfb86a7435cb93a5d4101defdf8', 'request_id': 'req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.311908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ca1dfb86a7435cb93a5d4101defdf8', 'request_id': 'req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.327168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ca1dfb86a7435cb93a5d4101defdf8', 'request_id': 'req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.368946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] The token cache is being invalidate because project 60ca1dfb86a7435cb93a5d4101defdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:32.369343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.370933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f92a0bcb-b96d-46a6-aa72-c1a7b9ef716c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.379609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:32.380317 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2671/5303] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:32 2022] DELETE /identity/v3/projects/60ca1dfb86a7435cb93a5d4101defdf8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:32.401914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fbb8f-2c38-46ee-9639-edb386738544 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:32.407654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:32.507539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:32.508329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:32.508679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:32.509060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] PATH_INFO: `/v3/users/27b2d6c04b1d401d832efa9e5087d65f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:32.512174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b2d6c04b1d401d832efa9e5087d65f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:32.514945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:32.598094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b2d6c04b1d401d832efa9e5087d65f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.600477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b2d6c04b1d401d832efa9e5087d65f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.614776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b2d6c04b1d401d832efa9e5087d65f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.640328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b2d6c04b1d401d832efa9e5087d65f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.654395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c71b89d-0005-4f8c-97be-1b2c533174e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b2d6c04b1d401d832efa9e5087d65f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:32.678901 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2633/5304] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:32 2022] DELETE /identity/v3/users/27b2d6c04b1d401d832efa9e5087d65f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:33.139873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:33.141047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:33.142184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:33.144079 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2672/5305] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:12:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:12:33.155027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:33.155704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:33.156199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:33.200624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:33.204406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.353332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2634/5306] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:33.393865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:33.395927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.430101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e516896-b944-4f92-a0c4-ff8b15ae11a9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:33.442166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:33.445308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:33.450495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:33.450939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:33.476141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:33.479927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8e7f-1b80-4239-b804-a222267d7828 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:33.501464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2673/5307] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:34.143074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.145246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:34.210995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:34.249552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4fd48-024a-4da3-9077-ebb68e07d99d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.258154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.258570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.258855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.259130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] PATH_INFO: `/v3/projects/790a80a7ab774ad581668cbf5ad155d4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.260378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] RBAC: Authorizing `identity:delete_project(project_id=790a80a7ab774ad581668cbf5ad155d4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.264509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.346250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790a80a7ab774ad581668cbf5ad155d4', 'request_id': 'req-eb368e27-fc7d-4791-bee3-c4174174889f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:34.358540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790a80a7ab774ad581668cbf5ad155d4', 'request_id': 'req-eb368e27-fc7d-4791-bee3-c4174174889f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:34.376090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790a80a7ab774ad581668cbf5ad155d4', 'request_id': 'req-eb368e27-fc7d-4791-bee3-c4174174889f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:34.391832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] The token cache is being invalidate because project 790a80a7ab774ad581668cbf5ad155d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:34.392129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:34.392968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb368e27-fc7d-4791-bee3-c4174174889f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:34.394871 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2635/5308] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:34 2022] DELETE /identity/v3/projects/790a80a7ab774ad581668cbf5ad155d4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:34.400330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dedc5b-687e-4cb0-8c75-898b4b6a3133 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.401589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dedc5b-687e-4cb0-8c75-898b4b6a3133 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.401936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dedc5b-687e-4cb0-8c75-898b4b6a3133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.441098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2dedc5b-687e-4cb0-8c75-898b4b6a3133 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:34.442776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2dedc5b-687e-4cb0-8c75-898b4b6a3133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:34.563319 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2674/5309] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:34.571744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.572035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.572488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.616657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.621216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.621587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.664478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:34.665722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:34.665878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:34.670197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:34.691504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2636/5310] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:34.693243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.712768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6aed5-acfd-432e-8679-f35013db95cf None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.718945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.719917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.720214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.720484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.721324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:34.722173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.723426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.740958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2637/5311] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:34.744056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.763004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9ffbe-7334-4de8-9170-ede2736fc3cf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.770217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.771383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.771739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.772084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.773556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.777725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.801571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2675/5312] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:34.823374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2638/5313] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:34 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:12:34.827515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.842688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e2826-f31d-4597-bcfd-db9deef04720 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.906383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:34.924343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.925233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.925623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.926000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.927641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.929782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.955740 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2676/5314] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:34 2022] POST /identity/v3/users => generated 279 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:34.959555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.971937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe92cc-d511-4b9c-a113-4a2248671d1e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.979500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.980135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.980418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.980692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.981380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.982986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.996629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2639/5315] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:35.000576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.014634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a77b7-df48-4240-b57b-125ffde2c4a6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.020696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.021648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.021648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.021901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.022754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.024640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a442e-b826-40ad-b464-c304c10c1d28 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.044940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2677/5316] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:35.046336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.064475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b35b4-54a4-4fca-8eb1-e70b40ff431d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.074585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.075587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.075587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.075827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] PATH_INFO: `/v3/projects/dc71a81eb46c42438ecf5fc2bb15f1d5/users/61b3a63a75aa463b9ddce142e6c36741/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.096888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc71a81eb46c42438ecf5fc2bb15f1d5, user_id=61b3a63a75aa463b9ddce142e6c36741, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.101104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.119394 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2640/5317] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:35 2022] PUT /identity/v3/projects/dc71a81eb46c42438ecf5fc2bb15f1d5/users/61b3a63a75aa463b9ddce142e6c36741/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:35.130665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.131006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.131280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.175967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] MFA Rules not processed for user `61b3a63a75aa463b9ddce142e6c36741`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:35.177912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:35.336348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.350769 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2678/5318] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:35.417316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:35.445587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f30f23-ca6b-4c75-b324-c160823f5461 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.449042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.451584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.452035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.452474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.452764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.453118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:35.453633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.455660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.548205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2641/5319] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:35 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:12:35.549242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.615698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89720db2-7d2e-4110-abf1-acc3e94ee697 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.690493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15942-3057-45f3-8827-bfdcd5faaf21 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.698684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.699564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.699876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.700247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.701021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.704589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.713532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.714158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.714433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.714704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.720377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:35.740827 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2642/5320] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:35 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:35.746489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.746858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.747961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.763160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44685-a8fa-40f4-b68e-045451595b57 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.763889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2679/5321] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:35.771809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.772571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.773774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.774299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.775997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.778355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.795195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2643/5322] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:35.798966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:35.818612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bef9-02a8-431a-8e20-860e25e80c56 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:35.826199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:35.827365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:35.827861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:35.828358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] PATH_INFO: `/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938/users/927198e47f2e439389e333ca1d604b4c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:35.895322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:35.904137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8c45fd79b2406e9359c79f1b5bd938, user_id=927198e47f2e439389e333ca1d604b4c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:35.908551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:35.962482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2680/5323] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:35 2022] PUT /identity/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938/users/927198e47f2e439389e333ca1d604b4c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:35.966584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.008756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444a385-e5f9-4e7d-9d68-1253a8dc670b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.140852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.141833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.142335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.142826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.143713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.146214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2882a0-d83f-41e9-8d50-35f74f530704 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.179072 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2644/5324] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:36.183481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.199190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf6288-aca4-45b2-adb0-354eb22e3f36 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.209141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.209836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.210117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.210392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] PATH_INFO: `/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938/users/927198e47f2e439389e333ca1d604b4c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.212672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8c45fd79b2406e9359c79f1b5bd938, user_id=927198e47f2e439389e333ca1d604b4c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.216847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.242658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2681/5325] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:36 2022] PUT /identity/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938/users/927198e47f2e439389e333ca1d604b4c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:36.242949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.243242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.243511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.307439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] MFA Rules not processed for user `927198e47f2e439389e333ca1d604b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:36.308894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:36.374756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:36.433480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2645/5326] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:36.439018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.453358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfbf1-5dee-4a07-bb23-433439c0e109 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.461554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.463677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:36.471953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927198e47f2e439389e333ca1d604b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8c45fd79b2406e9359c79f1b5bd938', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.472573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.472848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.473181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.474447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:36.474676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.476279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.513418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2682/5327] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:36.517835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.530763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975316-95d7-4a82-99d3-776c5e441380 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.538593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927198e47f2e439389e333ca1d604b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8c45fd79b2406e9359c79f1b5bd938', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.539553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.539995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.540441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.541265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.543620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.584277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2683/5328] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:36 2022] POST /identity/v3/projects => generated 350 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:36.588313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.652013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27ef0d-03c2-40f1-a199-f1d67235a14e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.754840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.756264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.756782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.757538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] PATH_INFO: `/v3/users/84359e0d3bfc47aaaf3f179dc5457aea` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.759144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84359e0d3bfc47aaaf3f179dc5457aea)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.761421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc5b8-4bad-4249-90bf-ea68082cf224 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.762060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.772629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927198e47f2e439389e333ca1d604b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8c45fd79b2406e9359c79f1b5bd938', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:36.773542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.773780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.774052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.774707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:36.775008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:36.776616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:36.801705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2684/5329] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:36.835513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:36.838563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:36.844730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84359e0d3bfc47aaaf3f179dc5457aea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:36.845820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84359e0d3bfc47aaaf3f179dc5457aea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:36.854583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84359e0d3bfc47aaaf3f179dc5457aea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:36.876537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84359e0d3bfc47aaaf3f179dc5457aea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:36.889464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cc73ab09-ca53-49cc-a09d-d751169e5523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84359e0d3bfc47aaaf3f179dc5457aea'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:36.913515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:36.922738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2646/5330] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:36 2022] DELETE /identity/v3/users/84359e0d3bfc47aaaf3f179dc5457aea => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:36.927721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:36.928582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:36.930294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:36.959135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99603a9-95d3-4a20-bcad-41dbcdcfd4f0 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:36.971832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:36.973712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:37.047238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:37.048504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:37.050048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:37.050561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:37.054888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:37.085871 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2647/5331] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:37.094824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:37.098929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:37.100875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:37.126039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcb694-18fb-42f4-9482-2506432930a2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:37.139680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:37.140072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:37.140548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:37.141041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:37.162658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:37.164110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:37.178373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2648/5332] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:37.215188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:37.217045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:37.232953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2685/5333] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:37.522251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:37.525553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:37.529889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:37.547127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b78-9c02-4604-a0c3-4e04c7d143ab service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:37.553607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc78-e08a-4b71-aa7d-cf67d7b1167a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:37.559608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927198e47f2e439389e333ca1d604b4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a8c45fd79b2406e9359c79f1b5bd938', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:37.559779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:37.560346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:37.560640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:37.560934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] PATH_INFO: `/v3/projects/03d79e7f058f46669adf09c0e7ca266f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:37.561413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:37.562056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:37.562188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d79e7f058f46669adf09c0e7ca266f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:37.562853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] PATH_INFO: `/v3/projects/b3a6ed8d6d40481e9cce275311c112e4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:37.564508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3a6ed8d6d40481e9cce275311c112e4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:37.565043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:37.566993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:37.659109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a6ed8d6d40481e9cce275311c112e4', 'request_id': 'req-309a076f-00dd-4a25-b7c8-3fda118e36c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.668706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a6ed8d6d40481e9cce275311c112e4', 'request_id': 'req-309a076f-00dd-4a25-b7c8-3fda118e36c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.705383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a6ed8d6d40481e9cce275311c112e4', 'request_id': 'req-309a076f-00dd-4a25-b7c8-3fda118e36c1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.735198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] The token cache is being invalidate because project b3a6ed8d6d40481e9cce275311c112e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:37.736599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.737430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.744037 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2649/5334] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:37 2022] DELETE /identity/v3/projects/b3a6ed8d6d40481e9cce275311c112e4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:37.906231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d79e7f058f46669adf09c0e7ca266f', 'request_id': 'req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.921681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d79e7f058f46669adf09c0e7ca266f', 'request_id': 'req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.940824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d79e7f058f46669adf09c0e7ca266f', 'request_id': 'req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.956515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:37.959041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:37.990388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] The token cache is being invalidate because project 03d79e7f058f46669adf09c0e7ca266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:37.990688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:37.991993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dbdaeeb3-7e37-4ea7-979c-278a19bc6dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.005580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2686/5335] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:37 2022] DELETE /identity/v3/projects/03d79e7f058f46669adf09c0e7ca266f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:38.011070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6e4b-76f4-40f3-92a9-fe9cdea747d9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.011798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6e4b-76f4-40f3-92a9-fe9cdea747d9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.012293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6e4b-76f4-40f3-92a9-fe9cdea747d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.066689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a076f-00dd-4a25-b7c8-3fda118e36c1 tempest-QuotasTest-178405226 tempest-QuotasTest-178405226-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.069655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8f3e6e4b-76f4-40f3-92a9-fe9cdea747d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:38.071473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8f3e6e4b-76f4-40f3-92a9-fe9cdea747d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:38.101192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:38.164853 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2687/5336] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:38.173369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.173929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.174585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.185078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.186027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.186176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.186573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] PATH_INFO: `/v3/users/61b3a63a75aa463b9ddce142e6c36741` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.188056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b3a63a75aa463b9ddce142e6c36741)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.190108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.213743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:38.215032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:38.224082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2688/5337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:38.229232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.241493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c21a-23e3-49ee-998c-30159b905160 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.248800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.249806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.250698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.251109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.252699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:38.253128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.255932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.264030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b3a63a75aa463b9ddce142e6c36741'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.264845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b3a63a75aa463b9ddce142e6c36741'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.266192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b3a63a75aa463b9ddce142e6c36741'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.274002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2689/5338] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:12:38.278273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.281941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:38.284255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b3a63a75aa463b9ddce142e6c36741'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.299230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-439047f6-2f93-4caf-92d0-71a89643c312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b3a63a75aa463b9ddce142e6c36741'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:38.303022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6bcd-f1a2-45d9-a253-cd6a685e4c9b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.314398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.315238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.315581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.315917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.316625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.319595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.327086 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2650/5339] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:37 2022] DELETE /identity/v3/users/61b3a63a75aa463b9ddce142e6c36741 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:38.329343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:38.333049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.333882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.334441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.361752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:38.363668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:38.391173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2690/5340] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:38.392305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.475939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2651/5341] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:38.482396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.484646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:38.500615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6177-59de-46db-b88a-16fc796cc943 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.533638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.538188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.538995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.538995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.540784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.546962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.634252 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2691/5342] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:38.638652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:38.639263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.667525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64546f07-e9f0-4667-b1bc-f6f49a4239fe None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.675259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af858e-a459-4cd7-9449-88420750e412 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.704505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.705827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.706110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.706532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.707094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.715913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.752702 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2692/5343] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:38.753876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.765845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.766791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.767141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.767776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.776855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554d337-e39d-4ad7-991e-9d6243dddf1d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.781947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.782571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.782848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.783116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.783757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.785547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.796049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.802102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac217d57-60d9-4aee-a901-8640c30af366 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.804510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2693/5344] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:38.806293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:38.824366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7208b-f17c-4efb-a258-215f5a683a3c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:38.830536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:38.831212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.831492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.831762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] PATH_INFO: `/v3/projects/9f57b4349faa44bdabf910ef3d5e3ffb/users/b65ad7d441494c4d9a8386b057b32c9d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.832050 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2652/5345] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:38.853537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f57b4349faa44bdabf910ef3d5e3ffb, user_id=b65ad7d441494c4d9a8386b057b32c9d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:38.856631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:38.916989 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2694/5346] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:38 2022] PUT /identity/v3/projects/9f57b4349faa44bdabf910ef3d5e3ffb/users/b65ad7d441494c4d9a8386b057b32c9d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:38.917159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:38.917445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:38.917718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:38.955493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] MFA Rules not processed for user `b65ad7d441494c4d9a8386b057b32c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:38.963330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:39.111967 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2653/5347] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:39.143591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:39.256242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bacca-3856-43cb-8f41-58ec761e301e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:39.262375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:39.262999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.263274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.263534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.275016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:39.277074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:39.290957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2695/5348] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:39.312017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:39.403717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd5492-bee1-4730-a4d9-6ceb43bcd04f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:39.411085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:39.412711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.413070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.413488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] PATH_INFO: `/v3/users/b65ad7d441494c4d9a8386b057b32c9d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.414919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65ad7d441494c4d9a8386b057b32c9d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:39.417730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:39.425779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:39.428008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:39.453081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247deeb-7f41-4c37-99eb-f099d0094bed service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:39.459741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:39.460895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.461410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.462158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] PATH_INFO: `/v3/projects/dc71a81eb46c42438ecf5fc2bb15f1d5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.463677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc71a81eb46c42438ecf5fc2bb15f1d5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:39.466428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:39.478958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:39.504056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65ad7d441494c4d9a8386b057b32c9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.504743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65ad7d441494c4d9a8386b057b32c9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.505944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65ad7d441494c4d9a8386b057b32c9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.516135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65ad7d441494c4d9a8386b057b32c9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.516371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:39.529195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-28f9a961-777b-43be-b24d-7b33a181515d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65ad7d441494c4d9a8386b057b32c9d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.563420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc71a81eb46c42438ecf5fc2bb15f1d5', 'request_id': 'req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.576027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc71a81eb46c42438ecf5fc2bb15f1d5', 'request_id': 'req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.592926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2654/5349] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:39 2022] DELETE /identity/v3/users/b65ad7d441494c4d9a8386b057b32c9d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:39.596017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.596808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.597044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc71a81eb46c42438ecf5fc2bb15f1d5', 'request_id': 'req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.597534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.615993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] The token cache is being invalidate because project dc71a81eb46c42438ecf5fc2bb15f1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:39.616342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.617072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.618631 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2696/5350] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:39 2022] DELETE /identity/v3/projects/dc71a81eb46c42438ecf5fc2bb15f1d5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:39.623840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:39.626293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:39.630778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:39.632481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:39.723068 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2655/5351] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:39.732593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:39.735547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:39.737580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ffaee-9e91-4fa9-85b5-d67e80d8024a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:39.743066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:39.743857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.745179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.745521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] PATH_INFO: `/v3/users/927198e47f2e439389e333ca1d604b4c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.747291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] RBAC: Authorizing `identity:delete_user(user_id=927198e47f2e439389e333ca1d604b4c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:39.749477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:39.828187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8dd50-7a9f-456f-8775-6677fc049482 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:39.828871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927198e47f2e439389e333ca1d604b4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.829742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927198e47f2e439389e333ca1d604b4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.834072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:39.835431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:39.835673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:39.836035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:39.838852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927198e47f2e439389e333ca1d604b4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.847819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927198e47f2e439389e333ca1d604b4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.848018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:39.848746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927198e47f2e439389e333ca1d604b4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:39.850114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5e3bb-4f90-4338-8d1a-771d9d2fd254 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:39.875090 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2697/5352] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:39 2022] DELETE /identity/v3/users/927198e47f2e439389e333ca1d604b4c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:39.875902 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2656/5353] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:40.339840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:40.341386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:40.405307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:40.444745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e21af-c77c-4677-a48f-31d1a893041d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:40.450682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:40.451423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:40.451928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:40.452269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] PATH_INFO: `/v3/projects/9f57b4349faa44bdabf910ef3d5e3ffb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:40.453647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f57b4349faa44bdabf910ef3d5e3ffb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:40.456080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:40.519411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f57b4349faa44bdabf910ef3d5e3ffb', 'request_id': 'req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.545704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f57b4349faa44bdabf910ef3d5e3ffb', 'request_id': 'req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.569819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f57b4349faa44bdabf910ef3d5e3ffb', 'request_id': 'req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.593172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] The token cache is being invalidate because project 9f57b4349faa44bdabf910ef3d5e3ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:40.594032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.600279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.603606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2698/5354] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:40 2022] DELETE /identity/v3/projects/9f57b4349faa44bdabf910ef3d5e3ffb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:40.608334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68fe3-1b83-415b-a909-140aa641232d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:40.608957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68fe3-1b83-415b-a909-140aa641232d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:40.609426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68fe3-1b83-415b-a909-140aa641232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:40.638518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9dd68fe3-1b83-415b-a909-140aa641232d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:40.640609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9dd68fe3-1b83-415b-a909-140aa641232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:40.681587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:40.683611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:40.750892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:40.791872 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2657/5355] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:40.793765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfd693-e858-4865-b613-1931943ca50d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:40.794147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfd693-e858-4865-b613-1931943ca50d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:40.794514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfd693-e858-4865-b613-1931943ca50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:40.809662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8aa38-1c7d-46ee-94ed-f648467bd1c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:40.828848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:40.829542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:40.829823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:40.830093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] PATH_INFO: `/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:40.831872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-53cfd693-e858-4865-b613-1931943ca50d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:40.833663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8c45fd79b2406e9359c79f1b5bd938)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:40.833792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53cfd693-e858-4865-b613-1931943ca50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:40.835194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:40.849856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2658/5356] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:40.851182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfd693-e858-4865-b613-1931943ca50d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:40.866875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfd693-e858-4865-b613-1931943ca50d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:40.885480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:40.886194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:40.886536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:40.887066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:40.890807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:40.891007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:40.893818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:40.919165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2659/5357] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:12:40.923564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:40.956530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a6662-2478-40e3-a3b6-d0fdbe96ff4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:40.964858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8c45fd79b2406e9359c79f1b5bd938', 'request_id': 'req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.976980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8c45fd79b2406e9359c79f1b5bd938', 'request_id': 'req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.992096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8c45fd79b2406e9359c79f1b5bd938', 'request_id': 'req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:40.993934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:41.020667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] The token cache is being invalidate because project 3a8c45fd79b2406e9359c79f1b5bd938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:41.022138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:41.023732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7fa30aaa-2f8d-4982-a7fd-9ede4a5e5ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:41.026452 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2699/5358] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:40 2022] DELETE /identity/v3/projects/3a8c45fd79b2406e9359c79f1b5bd938 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:41.033766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11edd7-e043-4921-b6fa-fa91d281b457 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.034143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11edd7-e043-4921-b6fa-fa91d281b457 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.034535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11edd7-e043-4921-b6fa-fa91d281b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.081809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae11edd7-e043-4921-b6fa-fa91d281b457 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:41.083346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae11edd7-e043-4921-b6fa-fa91d281b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:41.133515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.135882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.136838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.138687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.139584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.145677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.213078 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2660/5359] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:40 2022] POST /identity/v3/projects => generated 405 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:41.214340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.225865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:41.234281 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2700/5360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:41.243052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.243326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.243580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.277996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:41.279222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:41.355311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f600f-20ed-4a12-a467-6a672bf37124 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.375584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.376232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.376516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.376783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.382404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.384416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.405291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2701/5361] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:41.409754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.428180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e31194-e4aa-4538-96b0-1fe419d13afc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.432275 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2661/5362] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/users => generated 303 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:41.433753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.443044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.443591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.443921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.444192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.444840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:41.445173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.446759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.459899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0191b-60d1-422b-a1c9-9cb1fcd00114 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.471411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.472086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.472371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.472884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.474329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.476550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2702/5363] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:12:41.481920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.483720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.505470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8005-4c08-49a2-84db-0202f6520046 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.505898 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2662/5364] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:41.506799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.516635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.517314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.517561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.517827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.518474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.525563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.531239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbd00d-9137-49bb-8cba-9e4b50e6a58f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.544462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.545019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.545302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.545569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.546209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.550118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.569846 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2663/5365] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:41.585162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.595348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2703/5366] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:41.601805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.616950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd772-20af-40bd-a086-75767e3f5aea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.671094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:41.731958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d49b28-68fa-4f48-9704-27997f2c771c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.738396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.738396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.738661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.738961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.739729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.741903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.743069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.743745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.744023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.744675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] PATH_INFO: `/v3/projects/7322e482c5414a3899d26030fbf92897/users/4e969efe2f044271ba0db385b5d755df/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.760423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:41.768073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7322e482c5414a3899d26030fbf92897, user_id=4e969efe2f044271ba0db385b5d755df, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.771628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307e19-9f95-4e0a-91b5-6bb6fb20f72c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.781480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2704/5367] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:41.782800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.794561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f2c1a-3adc-401b-8a1c-a44f2d726b5b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.798374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2664/5368] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:41 2022] PUT /identity/v3/projects/7322e482c5414a3899d26030fbf92897/users/4e969efe2f044271ba0db385b5d755df/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:41.800817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.801126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.801394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.837265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] MFA Rules not processed for user `4e969efe2f044271ba0db385b5d755df`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:41.838885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:41.901914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.902989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.903453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.903903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.904760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.907158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26641e5-80d0-4d14-8c75-ebd23bf3881d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.918516 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2705/5369] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:41.920020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.920297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.920563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.932776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2665/5370] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:41.934113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.947346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85aa9-7959-43b8-b4b4-6dc93b4ab168 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:41.954947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:41.955645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:41.956001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:41.956440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:41.957158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:41.959532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:41.973816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2666/5371] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:41.974666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:41.980283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] MFA Rules not processed for user `906ed53d9d734a028b438ab998fdaaad`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:41.981710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:42.004156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87c71-6bba-476c-bab0-382fef4367ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.016249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.016933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.017225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.017538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.018122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.020031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.065989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2667/5372] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:42.065989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.136612 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2706/5373] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:42.137931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.160423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf64ac0-46d2-4ec2-84c6-0d459f15ac20 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.166347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.167026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.167323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.167590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.167710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31c8d8-0936-4f4f-bec4-244bb7012a0f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.168310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.170359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638bcfb-8a42-45d8-8e35-541cae9300a6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.181816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.182621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.183425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.184146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] PATH_INFO: `/v3/projects/80cf7f45212e4e948458de24f7b594c6/users/ac4b0d8f32c94a1a9260665ad0588950/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.192047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:42.207732 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2707/5374] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/users => generated 308 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:42.209284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091915-c117-44b4-a41c-b5d98c4aeaae None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.210097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091915-c117-44b4-a41c-b5d98c4aeaae None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.210097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091915-c117-44b4-a41c-b5d98c4aeaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.221904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cf7f45212e4e948458de24f7b594c6, user_id=ac4b0d8f32c94a1a9260665ad0588950, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.224799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.237373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f6091915-c117-44b4-a41c-b5d98c4aeaae None None] MFA Rules not processed for user `906ed53d9d734a028b438ab998fdaaad`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:42.240267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6091915-c117-44b4-a41c-b5d98c4aeaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:42.264982 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2668/5375] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:42 2022] PUT /identity/v3/projects/80cf7f45212e4e948458de24f7b594c6/users/ac4b0d8f32c94a1a9260665ad0588950/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:42.264982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.349206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2708/5376] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:42.350595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.350877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.351143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.368049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd511fa-94e6-4680-a47b-eb3035c682e7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.368497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:42.375405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.376429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.377000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.378737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.379710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.386498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.402439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2669/5377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:42.403873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.406183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:42.414060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] MFA Rules not processed for user `ac4b0d8f32c94a1a9260665ad0588950`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:42.415274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:42.546437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2709/5378] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:42.547209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.566855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86db80-c820-4a31-b7bf-aaf0dfc607db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.569357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ac6e-a786-4625-bf36-aee8e8dc225b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.573972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.574865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.575129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.575586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.586151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.588460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.589051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.589179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.589440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.589711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] PATH_INFO: `/v3/projects/f275d287c1254c059b073e0f76e1b7be/users/4e41b8e861a8437cb0432e3e65aec3e8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.618483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2670/5379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:42.619368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.623326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f275d287c1254c059b073e0f76e1b7be, user_id=4e41b8e861a8437cb0432e3e65aec3e8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.627207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.632768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005422-3772-47cf-b873-058abdb90e64 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.639038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.640203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.640564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.640996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.642631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.644769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.665350 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2710/5380] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:42 2022] PUT /identity/v3/projects/f275d287c1254c059b073e0f76e1b7be/users/4e41b8e861a8437cb0432e3e65aec3e8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:42.669753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.694362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2671/5381] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:42.698145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.812199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:42.841538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3fe2-6367-4b9b-8f73-6e529ad031a1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.864663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.865994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ed513-01a0-46ab-85c5-3bcd414467cd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.867233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.867516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.868736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.871579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.877406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.878091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.878483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.879153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.881910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.883499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.885756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.917590 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2672/5382] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:12:42.917800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2711/5383] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:42.920822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.921017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.938047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1bb28-ba4b-4f96-9cc0-ca500af91acc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.941875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c08c-a938-4c7e-8954-d8e33d0a2e9e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.951070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.951754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.952030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.952302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] PATH_INFO: `/v3/projects/f275d287c1254c059b073e0f76e1b7be/users/4e41b8e861a8437cb0432e3e65aec3e8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.953722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.954496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.954616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.954846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.955484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.957107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.960182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f275d287c1254c059b073e0f76e1b7be, user_id=4e41b8e861a8437cb0432e3e65aec3e8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:42.962891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb4fe0-023f-46b6-8b10-03bcab39d959 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:42.996669 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2712/5384] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:42 2022] PUT /identity/v3/projects/f275d287c1254c059b073e0f76e1b7be/users/4e41b8e861a8437cb0432e3e65aec3e8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:43.001067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2673/5385] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:43.001383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.001674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.001952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.008692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.022703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff153-5229-40e5-bc2d-da4fb457d756 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.046858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] MFA Rules not processed for user `4e41b8e861a8437cb0432e3e65aec3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:43.048520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:43.117622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:43.141048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.142108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.142600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.143094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] PATH_INFO: `/v3/projects/586ac960a0684a7cadbec20fed2b84fb/users/aba86222acc64a03bf8dd7b3782ceed7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.168156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=586ac960a0684a7cadbec20fed2b84fb, user_id=aba86222acc64a03bf8dd7b3782ceed7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.171410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.181336 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2713/5386] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:43.194135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.196458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:43.212809 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2674/5387] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:43 2022] PUT /identity/v3/projects/586ac960a0684a7cadbec20fed2b84fb/users/aba86222acc64a03bf8dd7b3782ceed7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:43.214295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.323004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe6e69-83bc-4754-9d28-47d95ba380c6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.325920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d0c8b-ed23-4682-a329-069943c2b31f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.331520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.332014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.332274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.332888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.333241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.335080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.346648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2675/5388] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:43.350989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.361103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae379-ccbe-485b-9c00-a6cef43ed4a3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.367000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.368174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.368484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.368751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] PATH_INFO: `/v3/projects/586ac960a0684a7cadbec20fed2b84fb/users/aba86222acc64a03bf8dd7b3782ceed7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.371367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586ac960a0684a7cadbec20fed2b84fb, user_id=aba86222acc64a03bf8dd7b3782ceed7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.374249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe2e88-15f2-4bc8-bb38-e54feef0a707 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.385432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2676/5389] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:43 2022] PUT /identity/v3/projects/586ac960a0684a7cadbec20fed2b84fb/users/aba86222acc64a03bf8dd7b3782ceed7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:43.396547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.396831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.397154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.435008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] MFA Rules not processed for user `aba86222acc64a03bf8dd7b3782ceed7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:43.437605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:43.442032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.443338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.443701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.443999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.479088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:43.538655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.540785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.550285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2677/5390] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:43.558390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.561516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:43.573430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2714/5391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:43.675131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee5f24-db4f-4360-8e01-1982d2626db6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.679789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.680414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.680685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.681004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.692382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.693853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107aa8-e6d7-4bdd-a4b0-602be8bf2d7e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.742929 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2678/5392] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:43.788868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:43.804935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0475f9e-3c9c-4d8b-a2eb-3734209877e0 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:43.846611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:43.881980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:43.882699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:43.883048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:43.883386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] PATH_INFO: `/v3/users/4e969efe2f044271ba0db385b5d755df` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:43.884584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e969efe2f044271ba0db385b5d755df)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.886679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.951193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e969efe2f044271ba0db385b5d755df'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:43.951971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e969efe2f044271ba0db385b5d755df'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:43.963669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e969efe2f044271ba0db385b5d755df'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:43.976687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e969efe2f044271ba0db385b5d755df'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:43.977550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e969efe2f044271ba0db385b5d755df'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:44.017611 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2715/5393] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:43 2022] DELETE /identity/v3/users/4e969efe2f044271ba0db385b5d755df => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:44.024221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:44.025119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:44.025480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:44.093296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:44.096235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:44.322183 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2679/5394] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:44.350713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:44.352297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:44.506358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0218c-d5ae-48d5-8e89-9cda5587972c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:44.510753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:44.511385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:44.511707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:44.511977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:44.538416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:44.541936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:44.565745 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2716/5395] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:45.186904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:45.188429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:45.206024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5cab-a070-4e12-8cd1-46f39a938e25 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:45.222586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:45.223198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:45.224041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:45.224321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] PATH_INFO: `/v3/projects/7322e482c5414a3899d26030fbf92897` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:45.226404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7322e482c5414a3899d26030fbf92897)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:45.228435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:45.289628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7322e482c5414a3899d26030fbf92897', 'request_id': 'req-c8936acf-638a-460d-b89a-d571c6d30689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.292151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:45.298173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7322e482c5414a3899d26030fbf92897', 'request_id': 'req-c8936acf-638a-460d-b89a-d571c6d30689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.308337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7322e482c5414a3899d26030fbf92897', 'request_id': 'req-c8936acf-638a-460d-b89a-d571c6d30689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.321961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] The token cache is being invalidate because project 7322e482c5414a3899d26030fbf92897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:45.322264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.323163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.327987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2680/5396] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:45 2022] DELETE /identity/v3/projects/7322e482c5414a3899d26030fbf92897 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:45.329408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:45.342108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a740-f9a6-4034-b35d-a797b38a3dce service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:45.425875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:45.432816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:45.433769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:45.434037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:45.434310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] PATH_INFO: `/v3/users/4e41b8e861a8437cb0432e3e65aec3e8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:45.436366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e41b8e861a8437cb0432e3e65aec3e8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:45.438669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:45.531947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e41b8e861a8437cb0432e3e65aec3e8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.533156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e41b8e861a8437cb0432e3e65aec3e8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.546026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e41b8e861a8437cb0432e3e65aec3e8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.555769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e41b8e861a8437cb0432e3e65aec3e8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.556739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94deccb0-3512-49d2-b14e-3dc3f58a1e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e41b8e861a8437cb0432e3e65aec3e8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:45.594962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2717/5397] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:45 2022] DELETE /identity/v3/users/4e41b8e861a8437cb0432e3e65aec3e8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:46.904147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:46.905744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:46.919802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936acf-638a-460d-b89a-d571c6d30689 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.000879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.001552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.001812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.002081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] PATH_INFO: `/v3/projects/f275d287c1254c059b073e0f76e1b7be` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.004174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f275d287c1254c059b073e0f76e1b7be)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.005398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.078717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f275d287c1254c059b073e0f76e1b7be', 'request_id': 'req-dec037bf-ec36-4005-a07b-6823ecf17ec1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:47.087684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f275d287c1254c059b073e0f76e1b7be', 'request_id': 'req-dec037bf-ec36-4005-a07b-6823ecf17ec1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:47.099291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f275d287c1254c059b073e0f76e1b7be', 'request_id': 'req-dec037bf-ec36-4005-a07b-6823ecf17ec1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:47.111863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] The token cache is being invalidate because project f275d287c1254c059b073e0f76e1b7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:47.112283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:47.113453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dec037bf-ec36-4005-a07b-6823ecf17ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:47.116947 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2681/5398] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:46 2022] DELETE /identity/v3/projects/f275d287c1254c059b073e0f76e1b7be => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:47.120540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.121449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.121726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.145391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:47.147224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:47.259714 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2718/5399] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:47.268581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.268991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.269410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.293234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:47.294476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:47.309117 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2682/5400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:47.310351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.324876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9189fa-9cb0-45b3-9b29-2b7aa2177ec4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.338078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.339015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.339672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.340230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.341385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:47.342322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.344298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.361892 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2719/5401] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:47.367704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.396180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf05e8-a52c-405e-8fdf-001a817e5740 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.408807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.413129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.414031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.414648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.415742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.419451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.506476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2683/5402] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:47 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:47.510538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.529315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb2b8-aa12-4aaf-8d3d-097e87c292a3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.656105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.656946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.657439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.657869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.658958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.664626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.677134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:47.715553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2720/5403] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:47 2022] POST /identity/v3/users => generated 278 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:47.719742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.733364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c229a8-f0c7-4b7c-b934-611bfe125430 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.739319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.739954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.740341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.740769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.741450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.743182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.760628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2684/5404] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:47.762148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.777069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb357-5bf0-49a5-809f-2dad5eecc98e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.786579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.786579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.786579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.786579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.787369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.789874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8e2b0-2270-40d8-90b7-6ac165dfe63b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.804596 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2721/5405] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:12:47.808884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:47.827887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e06706-1bb3-4f5c-bf5d-323af6bb95a5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:47.840980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:47.840980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.840980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.840980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] PATH_INFO: `/v3/projects/f7dbeba02f41486eb0217442c9739843/users/4eee225c941a4bbe95cafd71d02889e1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.858264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dbeba02f41486eb0217442c9739843, user_id=4eee225c941a4bbe95cafd71d02889e1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:47.861281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:47.878573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2685/5406] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:47 2022] PUT /identity/v3/projects/f7dbeba02f41486eb0217442c9739843/users/4eee225c941a4bbe95cafd71d02889e1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:47.889739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:47.890213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:47.890478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:47.932634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] MFA Rules not processed for user `4eee225c941a4bbe95cafd71d02889e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:47.935567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:48.048940 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2722/5407] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:48.051478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.063260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:48.132216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527b4f-f151-448f-b77a-e70560743de4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.148450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.149015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.149299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.149572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.150323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.152124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.191997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2686/5408] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:48 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:12:48.195824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.210393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4b78-86fc-4175-999b-ee232b1ccebf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.291249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.291881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.292160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.292428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.293144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.295093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.319039 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2723/5409] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:48 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:48.323132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.336101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308ae9-3d22-4527-97e7-a8aa287576af admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.341148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.341885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.342234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.342604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.343330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.345060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.358923 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2687/5410] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:12:48.362775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.380166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290a34-ab38-4aea-be97-3d41a63d517e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.386854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.387904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.388328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.388781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] PATH_INFO: `/v3/projects/a7eeb573929945b9b291974e1d74bf38/users/ba2fcb6c5f0f4db08c68d8c143a19bdc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.412207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eeb573929945b9b291974e1d74bf38, user_id=ba2fcb6c5f0f4db08c68d8c143a19bdc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.415230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.441961 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2724/5411] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:48 2022] PUT /identity/v3/projects/a7eeb573929945b9b291974e1d74bf38/users/ba2fcb6c5f0f4db08c68d8c143a19bdc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:48.446597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.457129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524d8f-f55a-4ae2-8bdc-9232f9a20a61 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.518440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.519036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.519312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.519585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.520286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.521925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3e50e-85d2-4d82-84f9-a12910957be1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.532704 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2688/5412] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:48.537307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.547706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252892d0-e15e-4dd7-8724-a4a42fdec518 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.552986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.553646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.553923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.554197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] PATH_INFO: `/v3/projects/a7eeb573929945b9b291974e1d74bf38/users/ba2fcb6c5f0f4db08c68d8c143a19bdc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.556383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eeb573929945b9b291974e1d74bf38, user_id=ba2fcb6c5f0f4db08c68d8c143a19bdc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.559319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.590856 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2725/5413] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:48 2022] PUT /identity/v3/projects/a7eeb573929945b9b291974e1d74bf38/users/ba2fcb6c5f0f4db08c68d8c143a19bdc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:48.602411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.602411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.602411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.637316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] MFA Rules not processed for user `ba2fcb6c5f0f4db08c68d8c143a19bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:48.639259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:48.743439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2689/5414] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:48.756503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.758166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:48.792209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:48.852594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512db61-8562-4bc5-9c1b-0006170bd421 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:48.857860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:48.859324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:48.859781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:48.860204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:48.874929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:48.876594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:48.889386 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2726/5415] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:48.991060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:48.995653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:49.003498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb062f1-1fb2-4046-b546-223828f87341 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:49.009148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:49.009787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:49.010062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:49.010329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:49.105721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:49.107179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:49.130579 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2690/5416] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:53.116561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:53.120472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:53.241086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f7255-f743-4d11-a967-d4623470429f service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:53.248232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba86222acc64a03bf8dd7b3782ceed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ac960a0684a7cadbec20fed2b84fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:53.249073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:53.249395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:53.249675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:53.250342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:53.250646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:53.252423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:53.269238 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2727/5417] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:53.275006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:53.291022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021a86-8420-4cd2-80c6-e0834cc5437a service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:53.298559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba86222acc64a03bf8dd7b3782ceed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ac960a0684a7cadbec20fed2b84fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:53.299188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:53.299482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:53.299756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:53.300480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:53.302649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:53.346140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:53.352791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2691/5418] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:53 2022] POST /identity/v3/projects => generated 348 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:53.373921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf1630-94fc-4420-a845-5cb2afe6e031 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:53.483677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba86222acc64a03bf8dd7b3782ceed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ac960a0684a7cadbec20fed2b84fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:53.484613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:53.485223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:53.485674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:53.486522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:53.487204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:53.489811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:53.508768 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2728/5419] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:54.396824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:54.407761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e44a6-5b9e-4505-8755-085b521dbe65 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:54.413165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba86222acc64a03bf8dd7b3782ceed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586ac960a0684a7cadbec20fed2b84fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:54.413786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:54.414060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:54.414324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] PATH_INFO: `/v3/projects/30c8efc60c7a4ff7bb67c484f1c639da` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:54.415441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30c8efc60c7a4ff7bb67c484f1c639da)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:54.417343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:54.471358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c8efc60c7a4ff7bb67c484f1c639da', 'request_id': 'req-89df2afa-feb8-47c0-90a6-04e73aa61035'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.492943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c8efc60c7a4ff7bb67c484f1c639da', 'request_id': 'req-89df2afa-feb8-47c0-90a6-04e73aa61035'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.503825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c8efc60c7a4ff7bb67c484f1c639da', 'request_id': 'req-89df2afa-feb8-47c0-90a6-04e73aa61035'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.519448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] The token cache is being invalidate because project 30c8efc60c7a4ff7bb67c484f1c639da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:54.519735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.521147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.523226 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2692/5420] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:54 2022] DELETE /identity/v3/projects/30c8efc60c7a4ff7bb67c484f1c639da => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:54.534420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:54.537410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:54.616582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f11f3-862a-4aae-b4d7-6c14dff3ae34 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:54.625350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:54.647142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:54.649009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:54.742234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:54.742857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:54.743134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:54.743403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:54.745564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:54.782051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2afa-feb8-47c0-90a6-04e73aa61035 tempest-RoutersIpV6AdminTest-1058230646 tempest-RoutersIpV6AdminTest-1058230646-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:54.788897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:54.789435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:54.789713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:54.789989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] PATH_INFO: `/v3/users/bafdc127af914320a17d15b77fb4ce5f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:54.791168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafdc127af914320a17d15b77fb4ce5f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:54.793150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:54.796689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:54.876493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafdc127af914320a17d15b77fb4ce5f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.877790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafdc127af914320a17d15b77fb4ce5f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.878082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafdc127af914320a17d15b77fb4ce5f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.893633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafdc127af914320a17d15b77fb4ce5f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.912429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f169e21-2e5a-4a09-9576-a0bcf08ce81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafdc127af914320a17d15b77fb4ce5f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:54.921039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:54.922744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:54.945353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2729/5421] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:54.955354 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2693/5422] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:54 2022] DELETE /identity/v3/users/bafdc127af914320a17d15b77fb4ce5f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:12:55.186556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:55.207165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c87931-e3c2-4e4c-9f37-76f7c4829720 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:55.299341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:55.300000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.300274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.300602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] PATH_INFO: `/v3/projects/e0e72e7f3f304aa7b72036f1ab6ab000` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.302375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e72e7f3f304aa7b72036f1ab6ab000)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:55.306107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:55.386649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'request_id': 'req-4c85889f-a8d0-4396-b148-57b023059ce1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:55.394178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'request_id': 'req-4c85889f-a8d0-4396-b148-57b023059ce1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:55.405415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'request_id': 'req-4c85889f-a8d0-4396-b148-57b023059ce1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:55.407295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:55.438777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] The token cache is being invalidate because project e0e72e7f3f304aa7b72036f1ab6ab000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:55.439355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:55.440184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4c85889f-a8d0-4396-b148-57b023059ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:55.443899 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2730/5423] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:55 2022] DELETE /identity/v3/projects/e0e72e7f3f304aa7b72036f1ab6ab000 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:55.448781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.449319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.449405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.485821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:55.487352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:55.600968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2694/5424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:55.607064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.607949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.608587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.649649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:55.652026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:55.662627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2731/5425] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:55.668737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:55.680505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b60145-5cf4-4689-b281-e5a5deff4ad1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:55.687852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:55.688295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.689175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.689523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.690296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:12:55.690668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:55.693628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:55.725822 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2695/5426] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:12:55.732989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:55.749011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7fa5-7c91-4f04-9086-0b957fe51173 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:55.760790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:55.761647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.761995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.762323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.763015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:55.765008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:55.835439 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2732/5427] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:55.839526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:55.853448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c73c-958d-4834-96a5-29a3053716db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:55.982262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:55.983447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:55.989325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:55.989630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:55.990315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:55.992271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:56.030733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:56.042172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:56.062120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2696/5428] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:12:55 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:12:56.077056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8992-c23e-4e7c-b36d-7502ab810176 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:56.096421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:56.097115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:56.097355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:56.097626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:56.098816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:56.100430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:56.124547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2733/5429] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:12:56.128806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:56.142015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316515d7-26a8-48af-a578-371dc555a831 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:56.157757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:56.158391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:56.158669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:56.161562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:56.162245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:56.163856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b14a3-8ec1-4d2c-ba3a-9fb63c22c2d6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:56.186412 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2697/5430] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:12:56.187521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:56.198351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44617-02d8-4eee-82ce-5721cb4d5dba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:56.204279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:56.205045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:56.205401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:56.205678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] PATH_INFO: `/v3/projects/b2439519edcf4920aa6acb8b6c5291a4/users/ad10f60766a04846b3baca32ca859773/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:56.224443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2439519edcf4920aa6acb8b6c5291a4, user_id=ad10f60766a04846b3baca32ca859773, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:56.227999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:56.255851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999391d-ee8d-41ab-9090-7cb374f33711 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:56.256162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999391d-ee8d-41ab-9090-7cb374f33711 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:56.256430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999391d-ee8d-41ab-9090-7cb374f33711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:56.256990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2734/5431] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:12:56 2022] PUT /identity/v3/projects/b2439519edcf4920aa6acb8b6c5291a4/users/ad10f60766a04846b3baca32ca859773/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:56.294940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e999391d-ee8d-41ab-9090-7cb374f33711 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:56.297000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e999391d-ee8d-41ab-9090-7cb374f33711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:56.419434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2698/5432] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:12:56.427326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:56.429215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:56.502561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a885-5808-4584-8f96-7f0be78421cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:56.507647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:56.508571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:56.508912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:56.509191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:56.523095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:56.524851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ab3a-4c9c-40b5-acc9-49e212af3f58 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:56.537407 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2735/5433] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:57.339574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:57.340897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:57.341439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:57.396085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] MFA Rules not processed for user `ad10f60766a04846b3baca32ca859773`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:57.396544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:57.501113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2699/5434] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:57.502237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:57.502712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:57.502830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:57.525247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] MFA Rules not processed for user `ad10f60766a04846b3baca32ca859773`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:57.526564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:57.536956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2736/5435] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:57.547520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:57.549140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:57.671255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd337-fc1b-4b5d-9bd1-e96c43a2e2d3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:57.677432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:57.678807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:57.679171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:57.679653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:57.690994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:57.694002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:57.708081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2700/5436] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:12:58.919039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:58.938910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0e364-2060-40e2-b4ce-6712144e4cc4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:58.947828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:58.949837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:58.950949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:58.951456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] PATH_INFO: `/v3/users/ad10f60766a04846b3baca32ca859773` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:58.954202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad10f60766a04846b3baca32ca859773)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:58.958968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:59.065066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad10f60766a04846b3baca32ca859773'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.066001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad10f60766a04846b3baca32ca859773'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.089737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad10f60766a04846b3baca32ca859773'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.104710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad10f60766a04846b3baca32ca859773'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.105941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-db1d5b74-61e6-495d-b0e0-162e4d294abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad10f60766a04846b3baca32ca859773'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.124477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:59.136071 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2737/5437] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:12:58 2022] DELETE /identity/v3/users/ad10f60766a04846b3baca32ca859773 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:59.659823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:59.665840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:59.674056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583888c-5292-498b-9ece-9efe1a42fb3b service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:59.775825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:59.776481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:59.776761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:59.777073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] PATH_INFO: `/v3/projects/b2439519edcf4920aa6acb8b6c5291a4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:59.778389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2439519edcf4920aa6acb8b6c5291a4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:59.780750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:59.861391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2439519edcf4920aa6acb8b6c5291a4', 'request_id': 'req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.869248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2439519edcf4920aa6acb8b6c5291a4', 'request_id': 'req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.880391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2439519edcf4920aa6acb8b6c5291a4', 'request_id': 'req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.938123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] The token cache is being invalidate because project b2439519edcf4920aa6acb8b6c5291a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:12:59.938516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.941784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c4bf8b0c-5bf2-4056-aafa-8a819f61d6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:12:59.945344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2701/5438] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:12:59 2022] DELETE /identity/v3/projects/b2439519edcf4920aa6acb8b6c5291a4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:12:59.951110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:59.952076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:59.953771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.007146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:00.011548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:00.135367 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2738/5439] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:00.144677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.144677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.144677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.165907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:00.167009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:00.175589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2702/5440] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:00.180565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.208833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba8ac1-c228-4238-816f-7d787fe8dbc4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.217025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.218189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.218868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.219383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.220927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:00.221437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.223724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.238283 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2739/5441] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:00.242813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.271061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d14b31-f85f-41a6-a579-627b43ba8391 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.278010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.278716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.278995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.279259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.279902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.281838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.314958 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2703/5442] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:00 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:00.317638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.328584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ecdc-71b9-4c77-9c74-88c296346463 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.428230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.428981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.429360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.429727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.431023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.433996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.480149 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2740/5443] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:00 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:00.484558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.501915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a14-054e-48b6-ba51-4f26ec5269fc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.512472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.513899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.514185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.514458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.516319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.521719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.568931 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2704/5444] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:00.570217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.590334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb379a4-6403-4683-9144-5cdca6016446 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.612345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.612345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.612345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.612345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.612789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.612789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323471f-e3d5-4d7d-8ff4-d2e9dd3300c4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.635751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2741/5445] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:00.637214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.662048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf34f5-cdcb-411e-9eba-3aa17a3e9da0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:00.669837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:00.670516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.670794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.671070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] PATH_INFO: `/v3/projects/c12546edb0a348c7921f838e9353c2cc/users/50da5c6abdb34a278074992a8153ac98/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.705134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12546edb0a348c7921f838e9353c2cc, user_id=50da5c6abdb34a278074992a8153ac98, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:00.710283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:00.736467 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2705/5446] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:00 2022] PUT /identity/v3/projects/c12546edb0a348c7921f838e9353c2cc/users/50da5c6abdb34a278074992a8153ac98/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:00.748251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfad1-a3a5-4977-b955-e5643169c48b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:00.748525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfad1-a3a5-4977-b955-e5643169c48b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:00.748796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfad1-a3a5-4977-b955-e5643169c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:00.783324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2b0dfad1-a3a5-4977-b955-e5643169c48b None None] MFA Rules not processed for user `50da5c6abdb34a278074992a8153ac98`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:00.784754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2b0dfad1-a3a5-4977-b955-e5643169c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:00.861218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:00.884154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2742/5447] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:00.897552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:00.899378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:00.975619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:01.062968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2192dc-edd9-4d6a-a957-1595618fddc4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:01.075130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:01.076099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:01.076650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:01.077162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:01.100115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:01.102782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d8fa-f92a-4992-aca3-9cdc515de502 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:01.115534 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2706/5448] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:04.987161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:04.987694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:04.987694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:05.008968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:05.010159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:05.085057 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2743/5449] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:09.205162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b485c-f890-4c5d-91cf-0a1a758cf827 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:09.205686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b485c-f890-4c5d-91cf-0a1a758cf827 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:09.205686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b485c-f890-4c5d-91cf-0a1a758cf827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:09.239016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d91b485c-f890-4c5d-91cf-0a1a758cf827 None None] MFA Rules not processed for user `f4dc1824197d40e58d0dfdc8f55ab72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:09.241867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d91b485c-f890-4c5d-91cf-0a1a758cf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:09.326442 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2707/5450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:13.597120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:13.698766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dae21-bb87-417e-aa51-7b1717933f69 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:13.705792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:13.707256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:13.707546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:13.708478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] PATH_INFO: `/v3/users/50da5c6abdb34a278074992a8153ac98` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:13.710277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50da5c6abdb34a278074992a8153ac98)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:13.713841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:13.819806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50da5c6abdb34a278074992a8153ac98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:13.820670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50da5c6abdb34a278074992a8153ac98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:13.834569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50da5c6abdb34a278074992a8153ac98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:13.854198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50da5c6abdb34a278074992a8153ac98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:13.856962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50da5c6abdb34a278074992a8153ac98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:13.909670 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2744/5451] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:13 2022] DELETE /identity/v3/users/50da5c6abdb34a278074992a8153ac98 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:13.911707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:13.912194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:13.912295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:13.933450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:13.935065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:14.017922 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2708/5452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:14.054289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:14.056080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:14.086130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:14.181373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47688aa0-d59a-4ec7-abb0-904f8d5ca69c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:14.186047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:14.187529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:14.187833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:14.188103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:14.205008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:14.207238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88a88-c527-47be-94f4-8cc7c437aae5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:14.225918 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2745/5453] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:15.502599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:15.504097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:15.535769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523650a-23b7-4fd9-8631-96cf168c08da None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:15.548792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:15.552560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:15.553118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:15.553637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] PATH_INFO: `/v3/projects/c12546edb0a348c7921f838e9353c2cc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:15.557040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12546edb0a348c7921f838e9353c2cc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:15.562710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:15.676504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12546edb0a348c7921f838e9353c2cc', 'request_id': 'req-9c30dbd6-7661-4e8e-8c21-8158636e3142'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:15.682761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12546edb0a348c7921f838e9353c2cc', 'request_id': 'req-9c30dbd6-7661-4e8e-8c21-8158636e3142'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:15.686007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:15.693831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12546edb0a348c7921f838e9353c2cc', 'request_id': 'req-9c30dbd6-7661-4e8e-8c21-8158636e3142'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:15.709484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] The token cache is being invalidate because project c12546edb0a348c7921f838e9353c2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:15.710161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:15.711000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c30dbd6-7661-4e8e-8c21-8158636e3142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:15.713763 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2709/5454] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:15 2022] DELETE /identity/v3/projects/c12546edb0a348c7921f838e9353c2cc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:15.718768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:15.719280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:15.719513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:15.749651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:15.752041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:15.849524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2746/5455] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:15.857243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:15.857733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:15.858154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:15.887985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:15.889639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:15.906092 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2710/5456] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:15.911047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:15.926629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c998-ea9d-4e9f-a5cd-e7894f662cad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:15.933547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:15.935202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:15.935998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:15.936372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:15.937949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:15.938360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:15.940860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:15.969814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2747/5457] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:15.973067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:15.987217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487426-aa46-4da2-8f72-43a0c58dcfcb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:15.992842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:15.994152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:15.994533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:15.994902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:15.995660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:15.997929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.066774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.067555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2711/5458] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:15 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:16.088234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9315b-2270-4a3c-a64f-a84cd30f3aa6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.218232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.218852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.219132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.219402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.220033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.222212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.249905 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2748/5459] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:16 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:16.254599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.270979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4337cd-4835-44a2-a32f-b2e8b77a2761 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.307353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.308252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.308532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.308803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.310368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.311173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.338448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2712/5460] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:16.342252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.352871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d764db6-2aaf-477d-a841-0020af7bec25 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.372613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.373265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.373545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.373823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.374473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.376081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf639f-3dad-45af-b366-f0df8fd1c923 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.398819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2749/5461] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:16.403076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.417236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8b47-fdcc-4b67-b678-18173b8ebb35 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.422889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.423616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.423896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.424176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] PATH_INFO: `/v3/projects/a740c261af4e4a87806b01ac6256f43f/users/4371ca3499d646afae9458b32de3b0ae/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.452748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a740c261af4e4a87806b01ac6256f43f, user_id=4371ca3499d646afae9458b32de3b0ae, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.455798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.486132 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2713/5462] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:16 2022] PUT /identity/v3/projects/a740c261af4e4a87806b01ac6256f43f/users/4371ca3499d646afae9458b32de3b0ae/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:16.500112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.500432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.500702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.540700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] MFA Rules not processed for user `4371ca3499d646afae9458b32de3b0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:16.545668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:16.564722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:16.647983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2750/5463] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:16.653670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.732352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca17f2-d1c2-4d6b-bc8f-bc555bfa2d64 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.741825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.743076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.743529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.743976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.744775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.747496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.789505 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2714/5464] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:16 2022] POST /identity/v3/projects => generated 401 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:16.791083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.804048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a18a9a-ef28-48bb-8866-cabac0eb8b72 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.899497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.900320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.900601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.900992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.901644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.904054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.939532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2751/5465] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:16 2022] POST /identity/v3/users => generated 307 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:16.940806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.956841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e11561-130b-40ff-9b52-2efdc35f7cf0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:16.962195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:16.963139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:16.963491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:16.963831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:16.964710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:16.966726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:16.982841 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2715/5466] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:16.985709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:16.998184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51580b-c21f-4cb0-881f-85d77143d642 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.004237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.004915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.005204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.005523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] PATH_INFO: `/v3/projects/35b13961d08347568b2ca0c1a0a61b45/users/a7ad177b07784bc697eaa1c9fe2f6a66/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.032156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b13961d08347568b2ca0c1a0a61b45, user_id=a7ad177b07784bc697eaa1c9fe2f6a66, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.037085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.058572 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2752/5467] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:16 2022] PUT /identity/v3/projects/35b13961d08347568b2ca0c1a0a61b45/users/a7ad177b07784bc697eaa1c9fe2f6a66/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:17.059709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.086714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce7b7d-a4fd-467d-b05c-c55d4ca5bbb0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.168146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:17.185525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.185525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.185525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.185525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.185955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.187821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52e607-a727-443c-900d-1eb0a81f86b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.199909 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2716/5468] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:17.203772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.219149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138300a-2f5d-4d6d-94fa-9d868c7d823e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.229425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.230421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.231251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.232052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] PATH_INFO: `/v3/projects/35b13961d08347568b2ca0c1a0a61b45/users/a7ad177b07784bc697eaa1c9fe2f6a66/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.234474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b13961d08347568b2ca0c1a0a61b45, user_id=a7ad177b07784bc697eaa1c9fe2f6a66, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.239520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.269971 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2753/5469] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:17 2022] PUT /identity/v3/projects/35b13961d08347568b2ca0c1a0a61b45/users/a7ad177b07784bc697eaa1c9fe2f6a66/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:17.273120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.273583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.273992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.314926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] MFA Rules not processed for user `a7ad177b07784bc697eaa1c9fe2f6a66`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:17.325468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:17.522219 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2717/5470] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:17 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:17.528278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.549758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3b34b-6042-46f2-9950-8104fa988575 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.561206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ad177b07784bc697eaa1c9fe2f6a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b13961d08347568b2ca0c1a0a61b45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.561835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.562119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.562395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.563326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.566816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.624076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2754/5471] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:13:17 2022] POST /identity/v3/roles => generated 240 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:17.624734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.642326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ac8e-25f4-409e-b9e9-ef133b513e52 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.658053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ad177b07784bc697eaa1c9fe2f6a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b13961d08347568b2ca0c1a0a61b45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.660131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.660779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.662018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] PATH_INFO: `/v3/projects/a740c261af4e4a87806b01ac6256f43f/users/4371ca3499d646afae9458b32de3b0ae/roles/eb6e098d35ad4ac3aace0e0086624557` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.669301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a740c261af4e4a87806b01ac6256f43f, user_id=4371ca3499d646afae9458b32de3b0ae, role_id=eb6e098d35ad4ac3aace0e0086624557)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.676375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.723523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.725534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:17.729466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2718/5472] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:17 2022] PUT /identity/v3/projects/a740c261af4e4a87806b01ac6256f43f/users/4371ca3499d646afae9458b32de3b0ae/roles/eb6e098d35ad4ac3aace0e0086624557 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:17.734501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:17.840793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb93220-d59a-4ddd-86ef-7495a1d6bf24 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:17.846709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4371ca3499d646afae9458b32de3b0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a740c261af4e4a87806b01ac6256f43f', 'project_domain_id': 'default', 'roles': ['tempest-test_role-2074122104', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:17.847850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:17.848346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:17.849773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:17.850404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] PATH_INFO: `/v3/users/4371ca3499d646afae9458b32de3b0ae/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:17.852795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: Authorizing `identity:create_application_credential(user_id=4371ca3499d646afae9458b32de3b0ae)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:17.854494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0d448-af37-4923-bfbc-a60614dd81a6 tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:17.866192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569570-8ff2-46e4-be45-710dae263d95 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:18.015860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:18.016523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.023030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.023370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] PATH_INFO: `/v3/users/4eee225c941a4bbe95cafd71d02889e1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.023524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:18.026443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eee225c941a4bbe95cafd71d02889e1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:18.028494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:18.037786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2719/5473] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:13:17 2022] POST /identity/v3/users/4371ca3499d646afae9458b32de3b0ae/application_credentials => generated 660 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:18.039308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.039584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.039943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.108488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] MFA Rules not processed for user `4371ca3499d646afae9458b32de3b0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:18.110511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.135616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eee225c941a4bbe95cafd71d02889e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.140308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eee225c941a4bbe95cafd71d02889e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.151328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eee225c941a4bbe95cafd71d02889e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.163098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eee225c941a4bbe95cafd71d02889e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.165054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-61e4ce9d-03d9-475f-9b80-836e506bdafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eee225c941a4bbe95cafd71d02889e1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.194268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2755/5474] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:17 2022] DELETE /identity/v3/users/4eee225c941a4bbe95cafd71d02889e1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:18.196820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.197489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.197765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.226750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:18.228090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.301710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2720/5475] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 28 10:13:18.305738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:18.307161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.313996 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2756/5476] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:18.326377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:18.327884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.359204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:18.402193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132d36-4d39-4e6d-a370-4d0325c22cd1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:18.407998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4371ca3499d646afae9458b32de3b0ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a740c261af4e4a87806b01ac6256f43f', 'project_domain_id': 'default', 'roles': ['tempest-test_role-2074122104', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:18.408734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.409324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.409607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] PATH_INFO: `/v3/users/4371ca3499d646afae9458b32de3b0ae/application_credentials/68cbe0b27c6940c08bedb98b20d9835e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.409807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec024e1d-af17-4d5a-9068-f6bdadde612a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:18.411407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4371ca3499d646afae9458b32de3b0ae, application_credential_id=68cbe0b27c6940c08bedb98b20d9835e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:18.413739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:18.417435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:18.418754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.419038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.419308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.434622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:18.436355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:18.442693 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2721/5477] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:13:18 2022] DELETE /identity/v3/users/4371ca3499d646afae9458b32de3b0ae/application_credentials/68cbe0b27c6940c08bedb98b20d9835e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:18.444345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:18.448317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.450786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2757/5478] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:18.487425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:18.536865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beda9e-0308-4b63-9ea5-09cab79e5d7a tempest-ApplicationCredentialsV3AdminTest-138393748 tempest-ApplicationCredentialsV3AdminTest-138393748-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:18.541711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ad177b07784bc697eaa1c9fe2f6a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b13961d08347568b2ca0c1a0a61b45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:18.542346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.542756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.543030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] PATH_INFO: `/v3/roles/eb6e098d35ad4ac3aace0e0086624557` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.544430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb6e098d35ad4ac3aace0e0086624557)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:18.546097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:18.587394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Invalidating the token cache because role eb6e098d35ad4ac3aace0e0086624557 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:18.588166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.588682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e89f9633-bd28-43e2-b306-707a6289f1b2 tempest-ApplicationCredentialsV3AdminTest-757995912 tempest-ApplicationCredentialsV3AdminTest-757995912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.590690 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2722/5479] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:18 2022] DELETE /identity/v3/roles/eb6e098d35ad4ac3aace0e0086624557 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:18.596671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:18.598199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.611472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8798798-b1cd-48e4-9a8d-b77a2e24297a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:18.675325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:18.676816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.676816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.676816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] PATH_INFO: `/v3/users/4371ca3499d646afae9458b32de3b0ae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.678096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4371ca3499d646afae9458b32de3b0ae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:18.680689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:18.738402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4371ca3499d646afae9458b32de3b0ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.739138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4371ca3499d646afae9458b32de3b0ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.750426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4371ca3499d646afae9458b32de3b0ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.765288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4371ca3499d646afae9458b32de3b0ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.767483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4371ca3499d646afae9458b32de3b0ae'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:18.792017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2758/5480] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:18 2022] DELETE /identity/v3/users/4371ca3499d646afae9458b32de3b0ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:18.796186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:18.796680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:18.796782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:18.822356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:18.824096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.917400 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2723/5481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:18.927353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:18.928942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:18.983321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:19.003611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896af57b-55f6-481f-8eb6-b8ae085dd553 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:19.007894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:19.008548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:19.008820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:19.009130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:19.022704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:19.024525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:19.037195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2759/5482] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:19.454764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:19.456494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:19.469743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b624-2cf5-4229-bc28-aa00addbc055 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:19.475597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:19.483739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:19.483851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:19.484134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] PATH_INFO: `/v3/projects/a740c261af4e4a87806b01ac6256f43f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:19.485479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a740c261af4e4a87806b01ac6256f43f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:19.487393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:19.527256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:19.528998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:19.544249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dad6e-f807-4eb5-af59-630c3038a4a3 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:19.549269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:19.549907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:19.550187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:19.550506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] PATH_INFO: `/v3/projects/f7dbeba02f41486eb0217442c9739843` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:19.551629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dbeba02f41486eb0217442c9739843)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:19.553732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:19.582222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a740c261af4e4a87806b01ac6256f43f', 'request_id': 'req-00d18567-4edd-463f-8ef4-fdef74caae9b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.589015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a740c261af4e4a87806b01ac6256f43f', 'request_id': 'req-00d18567-4edd-463f-8ef4-fdef74caae9b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.597819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a740c261af4e4a87806b01ac6256f43f', 'request_id': 'req-00d18567-4edd-463f-8ef4-fdef74caae9b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.611102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] The token cache is being invalidate because project a740c261af4e4a87806b01ac6256f43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:19.611509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.612161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.614438 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2724/5483] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:19 2022] DELETE /identity/v3/projects/a740c261af4e4a87806b01ac6256f43f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:19.616095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dbeba02f41486eb0217442c9739843', 'request_id': 'req-28126877-e61f-41ca-a991-c293930cc28d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.618422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:19.619898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:19.623702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dbeba02f41486eb0217442c9739843', 'request_id': 'req-28126877-e61f-41ca-a991-c293930cc28d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.632187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dbeba02f41486eb0217442c9739843', 'request_id': 'req-28126877-e61f-41ca-a991-c293930cc28d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.633769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:19.647757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] The token cache is being invalidate because project f7dbeba02f41486eb0217442c9739843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:19.648135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.649098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.651916 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2760/5484] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:19 2022] DELETE /identity/v3/projects/f7dbeba02f41486eb0217442c9739843 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:19.655815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:19.657458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:19.701517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18567-4edd-463f-8ef4-fdef74caae9b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:19.731417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126877-e61f-41ca-a991-c293930cc28d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:19.736200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:19.736830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:19.737146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:19.737453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] PATH_INFO: `/v3/users/ba2fcb6c5f0f4db08c68d8c143a19bdc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:19.738587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2fcb6c5f0f4db08c68d8c143a19bdc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:19.740491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:19.768800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:19.770223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:19.770502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:19.770758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] PATH_INFO: `/v3/users/a7ad177b07784bc697eaa1c9fe2f6a66` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:19.771924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ad177b07784bc697eaa1c9fe2f6a66)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:19.774412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:19.796498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2fcb6c5f0f4db08c68d8c143a19bdc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.798070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2fcb6c5f0f4db08c68d8c143a19bdc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.807311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2fcb6c5f0f4db08c68d8c143a19bdc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.823483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2fcb6c5f0f4db08c68d8c143a19bdc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.824275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2fcb6c5f0f4db08c68d8c143a19bdc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.826575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ad177b07784bc697eaa1c9fe2f6a66'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.827977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ad177b07784bc697eaa1c9fe2f6a66'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.828959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ad177b07784bc697eaa1c9fe2f6a66'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.836357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:19.838260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ad177b07784bc697eaa1c9fe2f6a66'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.845904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ad177b07784bc697eaa1c9fe2f6a66'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:19.854751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2761/5485] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:19 2022] DELETE /identity/v3/users/ba2fcb6c5f0f4db08c68d8c143a19bdc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:19.875116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2725/5486] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:19 2022] DELETE /identity/v3/users/a7ad177b07784bc697eaa1c9fe2f6a66 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:20.354759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.356331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.427832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240763-533a-42d5-b721-e50bf4515ba8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.487315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.488552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.488782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.489082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] PATH_INFO: `/v3/projects/a7eeb573929945b9b291974e1d74bf38` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.490212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7eeb573929945b9b291974e1d74bf38)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.493820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.495564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.497003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.513255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832578de-68ae-49ca-b3b3-1c56eea869d7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.521833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.523079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.523405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.525014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] PATH_INFO: `/v3/projects/35b13961d08347568b2ca0c1a0a61b45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.526216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b13961d08347568b2ca0c1a0a61b45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.528551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.569141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7eeb573929945b9b291974e1d74bf38', 'request_id': 'req-645efd97-f29c-4321-8fc6-05714a156e9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.576068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7eeb573929945b9b291974e1d74bf38', 'request_id': 'req-645efd97-f29c-4321-8fc6-05714a156e9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.591823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7eeb573929945b9b291974e1d74bf38', 'request_id': 'req-645efd97-f29c-4321-8fc6-05714a156e9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.600425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:20.613980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] The token cache is being invalidate because project a7eeb573929945b9b291974e1d74bf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:20.614430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.615198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-645efd97-f29c-4321-8fc6-05714a156e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.617179 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2762/5487] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:20 2022] DELETE /identity/v3/projects/a7eeb573929945b9b291974e1d74bf38 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:20.622751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75be64-a740-4028-b3ab-9b1006abc30d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.623106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75be64-a740-4028-b3ab-9b1006abc30d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.623450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75be64-a740-4028-b3ab-9b1006abc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.627616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b13961d08347568b2ca0c1a0a61b45', 'request_id': 'req-5143288a-de8d-4229-a568-26fc067f6ef1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.634759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b13961d08347568b2ca0c1a0a61b45', 'request_id': 'req-5143288a-de8d-4229-a568-26fc067f6ef1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.645864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3a75be64-a740-4028-b3ab-9b1006abc30d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:20.647398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a75be64-a740-4028-b3ab-9b1006abc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.648059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b13961d08347568b2ca0c1a0a61b45', 'request_id': 'req-5143288a-de8d-4229-a568-26fc067f6ef1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.662789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] The token cache is being invalidate because project 35b13961d08347568b2ca0c1a0a61b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:20.663095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.663743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5143288a-de8d-4229-a568-26fc067f6ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:20.665497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2726/5488] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:20 2022] DELETE /identity/v3/projects/35b13961d08347568b2ca0c1a0a61b45 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:20.670696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09628-1dea-4cae-9f18-e02b0f3e71c1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.671061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09628-1dea-4cae-9f18-e02b0f3e71c1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.671413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09628-1dea-4cae-9f18-e02b0f3e71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.677801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:20.693831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f9c09628-1dea-4cae-9f18-e02b0f3e71c1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:20.695044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9c09628-1dea-4cae-9f18-e02b0f3e71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.734992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2763/5489] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:20.743187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.743457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.743863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.767823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:20.769757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.772289 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2727/5490] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:20.778967 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2764/5491] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:20.780331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.780641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.780953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.783259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.793115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6212d2-b4da-4538-b4ef-2f397800b58d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.798617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.799587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.800065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.800518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.801416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:20.801895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.803687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.803930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:20.805254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:20.817590 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2728/5492] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:20.819121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.824326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2765/5493] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:20.825903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.830512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94a92-f6b1-4fb1-acc7-85615144f65e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.836558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.838903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.839289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.839568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.840226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:20.840521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e679a2-5966-4678-b6a4-07e29f6aec36 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.840662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.842169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.846235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.847057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.847874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.848149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.848788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.850874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.860080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2729/5494] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:20.861752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.873799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037770-705d-4883-8e90-f0369aa38cf5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:20.880165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:20.881183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:20.881636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:20.881956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:20.882949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:20.885425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:20.890481 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2766/5495] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:20.897649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.926868 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2730/5496] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:20.930920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:20.979585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7e8b-00e9-4c7e-9ca6-8edfefde9ffc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.001797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389865-5bb5-4040-923f-dcf900793f8d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.006605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.007216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.007493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.007761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.008382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.010467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.034321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2731/5497] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:21.039085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.045892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.046580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.046864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.047135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.047766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.049882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.050346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450afd1-1a1e-4aa5-b522-95063dc38cd9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.055655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.056297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.056610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.057103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.057755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.059836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.062138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:21.073990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2732/5498] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:21.079921 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2767/5499] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:20 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:21.080929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.081054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.091914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3b397-aa35-40f9-bef2-9bb31a9fc1b0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.092261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d2638-7af5-4efc-89b8-78767094677e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.097834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.098695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.098971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.099323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.099803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.100001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.100617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.100768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.100985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.101660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.102420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.103360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.117310 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2768/5500] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:21.117471 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2733/5501] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:21.118684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.121747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.130464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42aeb-1288-4fa2-a0d1-e5cb73e9e444 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.133012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2b7b-1325-4067-a9b9-29dd21d23b39 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.135958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.136617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.137019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.137514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] PATH_INFO: `/v3/projects/663b49a8c2d940ca80fcbfd193120c53/users/9b9d5c6d574d4c95881fd008ad8b396d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.138551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.139284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.139889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.140258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.141146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.142822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.147417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:21.156336 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2734/5502] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:21.158000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] RBAC: Authorizing `identity:create_grant(project_id=663b49a8c2d940ca80fcbfd193120c53, user_id=9b9d5c6d574d4c95881fd008ad8b396d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.161068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559ae1-c89a-4b41-8c4e-d90757ba644c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.161444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.196646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2769/5503] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:21 2022] PUT /identity/v3/projects/663b49a8c2d940ca80fcbfd193120c53/users/9b9d5c6d574d4c95881fd008ad8b396d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:21.209256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.209639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.212289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.219108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015929f-916c-4a7f-b118-6a5ed9d5e348 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.256300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] MFA Rules not processed for user `9b9d5c6d574d4c95881fd008ad8b396d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:21.257831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:21.318995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.319869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.320150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.320634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] PATH_INFO: `/v3/projects/0be7d9f8d18a4727b1e7dbafa9d5108d/users/b98d1652c8d94fdbbab352f78ab0ee86/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.339864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7d9f8d18a4727b1e7dbafa9d5108d, user_id=b98d1652c8d94fdbbab352f78ab0ee86, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.343602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8082f8-651c-4cc7-b7dd-6d2fe1b035de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.385789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2735/5504] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:21 2022] PUT /identity/v3/projects/0be7d9f8d18a4727b1e7dbafa9d5108d/users/b98d1652c8d94fdbbab352f78ab0ee86/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:21.391827 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2770/5505] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:21.396150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350903-0088-400f-a312-09d2c8470a22 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.396548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350903-0088-400f-a312-09d2c8470a22 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.396669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.396773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350903-0088-400f-a312-09d2c8470a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.408513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f4d1-140a-4a2b-9428-c923479cfbc6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.435651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-94350903-0088-400f-a312-09d2c8470a22 None None] MFA Rules not processed for user `b98d1652c8d94fdbbab352f78ab0ee86`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:21.438652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94350903-0088-400f-a312-09d2c8470a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:21.513321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.514372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.514658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.515072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.515850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.518022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.572115 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2736/5506] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:21.573151 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2771/5507] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:21.577026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94350903-0088-400f-a312-09d2c8470a22 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.579493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.610800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94350903-0088-400f-a312-09d2c8470a22 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.668919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93fb05-1e2f-4a87-a234-c7d0916dde00 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.672228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:21.678018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.678729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.679016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.679300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.681056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.683262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.692716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.693488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.693926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:21.694577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.695075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.695874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.697852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.713425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2772/5508] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:21.716838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.731481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794460-dbcb-4955-8c81-d4fae8e2cba4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.741437 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2737/5509] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:21.742271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.742965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.743320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.743461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.743659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.744443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.746102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.766206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2773/5510] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:21.767021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.779808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdae28-94e0-4d26-9498-20ba674b5f64 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.834192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c13bf-7e79-4cd9-87ec-d94d2b57c44c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.842753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.843924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.844835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.845598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.846432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.849812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.868713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.869305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.869584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.869964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] PATH_INFO: `/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d/users/cedddbc302b94f4a993c4fb6a56a6ae3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.880179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2738/5511] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:21 2022] POST /identity/v3/users => generated 307 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:21.883881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.894929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2577f-59f3-4a49-a610-3f79cfbec1db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:21.895881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b4a77be2934e5d890a77eed04d3b7d, user_id=cedddbc302b94f4a993c4fb6a56a6ae3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.898594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.900165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:21.900980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:21.901331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:21.901791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:21.902627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:21.904690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:21.921184 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2739/5512] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:21.921404 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2774/5513] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:21 2022] PUT /identity/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d/users/cedddbc302b94f4a993c4fb6a56a6ae3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:21.922370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.926690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:21.939733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c9ae-8403-415f-80a2-d73e466de202 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.019608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a2e74-a700-43d8-beef-be06f564e9da admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.030379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.031249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.031528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.031801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.032628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.034747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.042106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.043537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.043824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.044103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] PATH_INFO: `/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3/users/b6ebadfc74bc493dbfea3b1ce23c91e9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.048382 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2775/5514] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:22.053421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.063168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d11b0aa13489cb3be4d3672054ae3, user_id=b6ebadfc74bc493dbfea3b1ce23c91e9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.064301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c1b94-0787-41b1-b6b1-74ad31446711 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.066686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fe64-bb6d-4240-a67d-85a29edeb39d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.069990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.070680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.070958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.071324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] PATH_INFO: `/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d/users/cedddbc302b94f4a993c4fb6a56a6ae3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.073573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b4a77be2934e5d890a77eed04d3b7d, user_id=cedddbc302b94f4a993c4fb6a56a6ae3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.076276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.088524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2776/5516] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:22 2022] PUT /identity/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d/users/cedddbc302b94f4a993c4fb6a56a6ae3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.088824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2740/5516] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:21 2022] PUT /identity/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3/users/b6ebadfc74bc493dbfea3b1ce23c91e9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.099417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.100716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.101026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.101339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.147922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] MFA Rules not processed for user `cedddbc302b94f4a993c4fb6a56a6ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:22.153258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:22.166739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:22.186620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797eaf-56d5-4b14-8086-4bc13df4aaee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.190323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:22.205802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.206466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.206753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.207019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.207904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.209334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.224708 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2777/5517] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:22.230136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.245624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8d0c6-de0d-4cad-8ed5-39a508a8f4da admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.251997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.252837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.253146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.253951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] PATH_INFO: `/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3/users/b6ebadfc74bc493dbfea3b1ce23c91e9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.255327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2741/5518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:22.256088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d11b0aa13489cb3be4d3672054ae3, user_id=b6ebadfc74bc493dbfea3b1ce23c91e9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.258973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404b00-09a6-4f0f-a436-3d3b08b5e5fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.260589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.274990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a2e4b-b7e8-45f0-947b-c4a892166971 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.280988 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2778/5519] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:22 2022] PUT /identity/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3/users/b6ebadfc74bc493dbfea3b1ce23c91e9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.288093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.288716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.289381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.348933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] MFA Rules not processed for user `b6ebadfc74bc493dbfea3b1ce23c91e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:22.350376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:22.368445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.369095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.369369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.369830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.370483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.372700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.391084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2742/5520] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/services => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:22.396392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.421500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad12bc-5c0f-40d0-b80b-70ec3d3f35e0 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.426797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.427586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.427861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.429862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.430597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.434953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: 'False' Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'False' Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.442372 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:13:22.444047 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'False' Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.445797 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2743/5521] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/endpoints => generated 283 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:13:22.448448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.453085 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2779/5522] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3477 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:22.461017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2795b-123f-4449-9bbc-1b910983b977 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.464898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.466624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:22.466900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.467510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.467871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.468151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.468800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.470548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: 'True' Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'True' Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.477553 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:13:22.479121 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'True' Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.480170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2744/5523] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/endpoints => generated 281 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:13:22.483605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.496499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db962e-89ae-4566-8d16-fafb51a1c2ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.501410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.502088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.502439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.502786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.504049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.505698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.524508 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-89334025. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:13:22.524508 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:13:22.524508 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:13:22.553973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05e111-276e-47cd-9052-b4ebd65f7bbe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.555750 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2745/5524] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/endpoints => generated 356 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:22.560321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.569909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.570511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.570963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.571280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.582294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.583142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329e92-cd80-48e7-9b7f-c2333c6ac0a5 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.583852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.588223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.588848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.589158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.589430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/regions/tempest-region-89334025` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.590289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-89334025)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.591242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.596554 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2746/5525] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 10:13:22 2022] GET /identity/v3/regions/tempest-region-89334025 => generated 176 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:22.597486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.608479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476050a-3b75-477c-826e-1bb2eec2a856 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.610899 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2780/5526] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3655 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:22.616276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.616681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.616771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.617440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints/14da7061f7af49419e37abb01f89966a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.623376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=14da7061f7af49419e37abb01f89966a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.625051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: 'False' Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'False' Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.633985 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:13:22.639282 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'False' Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.640370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2747/5527] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 10:13:22 2022] PATCH /identity/v3/endpoints/14da7061f7af49419e37abb01f89966a => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:13:22.641072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.657994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d22-6616-40bb-a024-9a7d1702f8ac service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.664080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.664805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.665688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.665688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints/14da7061f7af49419e37abb01f89966a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.666660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=14da7061f7af49419e37abb01f89966a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.668490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.678281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '14da7061f7af49419e37abb01f89966a', 'request_id': 'req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:22.692041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2781/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:22 2022] DELETE /identity/v3/endpoints/14da7061f7af49419e37abb01f89966a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.697681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.705506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.714961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462a12-f32e-4ae2-890a-c9e70a8707be tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.724152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:22.729138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28829c-febe-4c45-ade8-dff6bbc1bb4c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.731537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.732504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.732891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.733272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/regions/tempest-region-89334025` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.733934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-89334025)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.735274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.735619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.736140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.737031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.737448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.764039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2748/5529] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 10:13:22 2022] DELETE /identity/v3/regions/tempest-region-89334025 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.769603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.775768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:22.794610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cef9f-4a2c-4946-b8ee-d2a3d1baa478 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.800702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.801381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.801665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.801942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.802611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.804221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.806841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.808550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.823910 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-654551975. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:13:22.823910 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:13:22.823910 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:13:22.829953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2782/5530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3410 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:22.855673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2749/5531] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:13:22 2022] POST /identity/v3/endpoints => generated 358 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:22.856866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.868580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5c22-d64f-492c-b04a-6585ab1fcb34 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.887294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.888018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.888293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.888591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/regions/tempest-region-654551975` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.889206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-654551975)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.890294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.892369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2783/5532] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 10:13:22 2022] GET /identity/v3/regions/tempest-region-654551975 => generated 178 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:22.897324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.909502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb742-a268-44bd-b302-d02045c8d26b tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.915275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.916080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.916506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.916785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints/317bef71aff2465dbbe752f2f1a82c44` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.922852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=317bef71aff2465dbbe752f2f1a82c44)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.924513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: On instance['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: 'True' Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise error Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'True' Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.933301 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 28 10:13:22.935190 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application On instance['enabled']: Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application 'True' Oct 28 10:13:22.936688 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:22.945643 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2750/5533] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 10:13:22 2022] PATCH /identity/v3/endpoints/317bef71aff2465dbbe752f2f1a82c44 => generated 281 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 28 10:13:22.947113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:22.959755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0873c2-c90a-4bee-b566-752df214e5ad tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:22.965434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:22.966183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:22.966483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:22.966865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/endpoints/317bef71aff2465dbbe752f2f1a82c44` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:22.968475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=317bef71aff2465dbbe752f2f1a82c44)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:22.970049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:22.980147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '317bef71aff2465dbbe752f2f1a82c44', 'request_id': 'req-07731e02-9fd4-4734-8de3-29daf84a8d8c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:22.992925 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2784/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:22 2022] DELETE /identity/v3/endpoints/317bef71aff2465dbbe752f2f1a82c44 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:22.997434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:23.011671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54f80e-dd26-4ea2-9d32-357bc32f667a tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:23.029170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:23.029931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:23.030308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:23.030651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/regions/tempest-region-654551975` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:23.031324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-654551975)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:23.033118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:23.062509 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2751/5535] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 10:13:22 2022] DELETE /identity/v3/regions/tempest-region-654551975 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:23.067955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:23.080080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731e02-9fd4-4734-8de3-29daf84a8d8c tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:23.096549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedddbc302b94f4a993c4fb6a56a6ae3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b4a77be2934e5d890a77eed04d3b7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:23.097547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:23.098064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:23.098402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] PATH_INFO: `/v3/services/9dee9eff3fe243feb634d207404583e1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:23.099098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9dee9eff3fe243feb634d207404583e1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:23.100947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1286e3-3168-4b49-89dc-fe23407d6088 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:23.134287 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2785/5536] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:23 2022] DELETE /identity/v3/services/9dee9eff3fe243feb634d207404583e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:23.134455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:23.223229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a313259-6848-4334-b286-56120ed4f1d6 tempest-EndpointsNegativeTestJSON-601989362 tempest-EndpointsNegativeTestJSON-601989362-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:23.245520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:23.246574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:23.247010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:23.247373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] PATH_INFO: `/v3/users/9b9d5c6d574d4c95881fd008ad8b396d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:23.248986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9d5c6d574d4c95881fd008ad8b396d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:23.251228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:23.318082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9d5c6d574d4c95881fd008ad8b396d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:23.318990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9d5c6d574d4c95881fd008ad8b396d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:23.319806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9d5c6d574d4c95881fd008ad8b396d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:23.332473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9d5c6d574d4c95881fd008ad8b396d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:23.342733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9d5c6d574d4c95881fd008ad8b396d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:23.345454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:23.375953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2752/5537] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:23 2022] DELETE /identity/v3/users/9b9d5c6d574d4c95881fd008ad8b396d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:23.376851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:23.377158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:23.377422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:23.414982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:23.417538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:23.590308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2786/5538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:23.606508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:23.608488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:23.750239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc131eb-e0aa-47a2-8c41-4d221b553592 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:23.762707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:23.763638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:23.764171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:23.764653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:23.787335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:23.789341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:23.807730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2753/5539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:25.005880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:25.007757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:25.019566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548667a-d0dd-4847-be5c-d31e28d9a5ad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:25.029149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:25.030035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:25.030535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:25.031022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] PATH_INFO: `/v3/projects/663b49a8c2d940ca80fcbfd193120c53` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:25.033718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663b49a8c2d940ca80fcbfd193120c53)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:25.036540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:25.061612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:25.088190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663b49a8c2d940ca80fcbfd193120c53', 'request_id': 'req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.093705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663b49a8c2d940ca80fcbfd193120c53', 'request_id': 'req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.101789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663b49a8c2d940ca80fcbfd193120c53', 'request_id': 'req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.120690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] The token cache is being invalidate because project 663b49a8c2d940ca80fcbfd193120c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:25.121277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.122107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.127043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2787/5540] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:25 2022] DELETE /identity/v3/projects/663b49a8c2d940ca80fcbfd193120c53 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:25.129281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:25.139343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064806-51e7-4370-8fc3-be5bcf226041 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:25.205091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:25.205747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:25.206029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:25.206302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] PATH_INFO: `/v3/users/cedddbc302b94f4a993c4fb6a56a6ae3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:25.207459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedddbc302b94f4a993c4fb6a56a6ae3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:25.209490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:25.277437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedddbc302b94f4a993c4fb6a56a6ae3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.278097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedddbc302b94f4a993c4fb6a56a6ae3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.278758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedddbc302b94f4a993c4fb6a56a6ae3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.287495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedddbc302b94f4a993c4fb6a56a6ae3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.297864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6730ee0f-a98a-4483-93d6-841351250268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedddbc302b94f4a993c4fb6a56a6ae3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.313453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:25.329217 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2754/5541] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:25 2022] DELETE /identity/v3/users/cedddbc302b94f4a993c4fb6a56a6ae3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:25.674416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:25.675532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:25.714180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8bd63-30cf-45d3-86a4-3429e287b7a9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:25.808519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:25.809513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:25.809956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:25.810198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] PATH_INFO: `/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:25.812006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b4a77be2934e5d890a77eed04d3b7d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:25.814340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:25.875321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b4a77be2934e5d890a77eed04d3b7d', 'request_id': 'req-641c1769-ba6a-4703-8878-ed134a8d99bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.882038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b4a77be2934e5d890a77eed04d3b7d', 'request_id': 'req-641c1769-ba6a-4703-8878-ed134a8d99bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.889739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b4a77be2934e5d890a77eed04d3b7d', 'request_id': 'req-641c1769-ba6a-4703-8878-ed134a8d99bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.904559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] The token cache is being invalidate because project d2b4a77be2934e5d890a77eed04d3b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:25.904997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.905581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-641c1769-ba6a-4703-8878-ed134a8d99bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:25.907811 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2788/5542] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:25 2022] DELETE /identity/v3/projects/d2b4a77be2934e5d890a77eed04d3b7d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:25.912624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e4600-ac4a-432b-9c17-1799b1bdae07 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:25.912991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e4600-ac4a-432b-9c17-1799b1bdae07 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:25.913396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e4600-ac4a-432b-9c17-1799b1bdae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:25.935530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b46e4600-ac4a-432b-9c17-1799b1bdae07 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:25.936931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b46e4600-ac4a-432b-9c17-1799b1bdae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:26.013160 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2755/5543] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:26.018453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.019471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.021413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.071623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:26.073065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:26.079922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.081049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.082225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.085532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2789/5544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:26.089692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.099093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3203-cf3c-4282-baf3-7f63b2069c08 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.105574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.106382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.106666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.107000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.107714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:26.108070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.109861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.128957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2790/5545] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:26.129858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.130421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] MFA Rules not processed for user `b28b625c3a9340c888d9fab29f82ffa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:26.132157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:26.163150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4dd2-b439-44b2-b878-54ceea1e25a1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.167849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.168455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.168729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.169075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.169856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.172323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.231018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:26.243792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2791/5547] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:26.244027 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2756/5547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:26.256574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.367369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd65fb8-9733-41e7-a258-48861e69b8fd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.372234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.372838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.373163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.373435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.374275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.376199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.399195 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2792/5548] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:26.403290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.415921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9704e-b912-4613-ba57-c1e2574762c4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.421398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.422110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.422462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.422935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.423653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.426013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.438187 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2757/5549] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:26.442916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.455027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b02a2-9ceb-4547-83b7-89ebb9be0510 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.460307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.461659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.461659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.461659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.463453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.464285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af1e36-3b32-494a-a507-349122dc94ae admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.478715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2793/5550] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:26.480439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.492693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafffec-40e6-4d98-9dd2-72449914d598 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.497940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.498603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.498878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.499150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] PATH_INFO: `/v3/projects/cd0f76ab4e4f4dad9fe96aeed12ab87b/users/e781fa94734848b996f514ee031c2f8b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.518482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f76ab4e4f4dad9fe96aeed12ab87b, user_id=e781fa94734848b996f514ee031c2f8b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.520450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.537581 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2758/5551] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:26 2022] PUT /identity/v3/projects/cd0f76ab4e4f4dad9fe96aeed12ab87b/users/e781fa94734848b996f514ee031c2f8b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:26.547522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.547832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.548082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.579113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] MFA Rules not processed for user `e781fa94734848b996f514ee031c2f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:26.580377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:26.668881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2794/5552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:26.669726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.743732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:26.747936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b32e9-340e-49e4-b15f-52a5de31bbdd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.754195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.754933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.755446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.755971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.756701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.758771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.801926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2759/5553] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:26.805963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.825347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a9ed-472a-4f7e-b36d-171750aca6da None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.913296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.914255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.914637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.915004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.916395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.918542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.931428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:26.946171 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2795/5554] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:26 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:26.949810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:26.965687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410081e3-4576-4001-8f49-88b604714f5b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:26.971371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:26.972122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:26.972498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:26.972932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:26.973702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:26.975582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:26.998678 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2760/5555] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:27.002904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.014951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a259917-256c-4db7-98eb-a547f7069154 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.020302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.021009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.021243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.021518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] PATH_INFO: `/v3/projects/b59ca213c59b49c89674356cdf306c23/users/9e57966cfcf84e7f85316dd4449dadf7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.037735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59ca213c59b49c89674356cdf306c23, user_id=9e57966cfcf84e7f85316dd4449dadf7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.040415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.064088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.064486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2796/5556] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:27 2022] PUT /identity/v3/projects/b59ca213c59b49c89674356cdf306c23/users/9e57966cfcf84e7f85316dd4449dadf7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:27.075751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0577fd1-8296-403c-b2d4-8ea42818b919 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.185503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.186699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.187113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.187386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.188026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.189781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e089f-de99-436b-8d4c-66276059168b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.205085 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2761/5557] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:27.206846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.219277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2dfa-9715-45e2-9c4a-e3f744b51f58 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.227803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.229044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.229491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.229955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] PATH_INFO: `/v3/projects/b59ca213c59b49c89674356cdf306c23/users/9e57966cfcf84e7f85316dd4449dadf7/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.232377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59ca213c59b49c89674356cdf306c23, user_id=9e57966cfcf84e7f85316dd4449dadf7, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.235363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.260211 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2797/5558] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:27 2022] PUT /identity/v3/projects/b59ca213c59b49c89674356cdf306c23/users/9e57966cfcf84e7f85316dd4449dadf7/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:27.262307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.262749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.263214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.314404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] MFA Rules not processed for user `9e57966cfcf84e7f85316dd4449dadf7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:27.316390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:27.430520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.436809 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2762/5559] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:27.443904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168c6cf-0b0d-4f34-8713-0c4ec5d0067d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.452773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.453717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.454156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.454714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.455573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.456789 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.456789 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:13:27.456789 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:13:27.458071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.516878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.533091 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2798/5560] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Oct 28 10:13:27 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:27.542729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909ccd-6bde-4655-9d70-b276ede9d940 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.552720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.554619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.555226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.555687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/880f5683e004415a91b5bb51125823a7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.558329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=880f5683e004415a91b5bb51125823a7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.560006 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.560006 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:13:27.560006 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:13:27.562516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.571633 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2763/5561] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:13:27 2022] GET /identity/v3/OS-OAUTH1/consumers/880f5683e004415a91b5bb51125823a7 => generated 220 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:27.575710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.592224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827f64-c86e-4e2a-b33b-d35ce88ee73a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.613869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.620269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.620952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.621678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/880f5683e004415a91b5bb51125823a7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.622904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=880f5683e004415a91b5bb51125823a7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.624123 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.624123 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:13:27.624123 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:13:27.626017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.626524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer 880f5683e004415a91b5bb51125823a7 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:27.627020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.628006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.672693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '880f5683e004415a91b5bb51125823a7', 'request_id': 'req-e8ad6853-cd35-4964-ac17-163db848e0e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.695450 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2799/5562] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:27 2022] DELETE /identity/v3/OS-OAUTH1/consumers/880f5683e004415a91b5bb51125823a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:27.696770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.698939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:27.714130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794406a3-46a3-47ed-b12f-d1bbed687c48 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.719353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.720252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.720626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.721039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.721798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.723418 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.723418 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:13:27.723418 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:13:27.724570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.746017 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2764/5563] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Oct 28 10:13:27 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:27.749993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.763603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad6853-cd35-4964-ac17-163db848e0e4 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.768955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.770073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.770073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.770291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.770783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b58400156cea4050a1d4ec929541c8c9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.771908 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.771908 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:13:27.771908 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:13:27.772804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.778840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2800/5564] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:13:27 2022] GET /identity/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9 => generated 220 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:27.782750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.795853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc8917-6c1f-4953-949d-c0187258ad7d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.801472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.802222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.802570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.802863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.803788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b58400156cea4050a1d4ec929541c8c9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.804862 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:27.804862 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:13:27.804862 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:13:27.806103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.806437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer b58400156cea4050a1d4ec929541c8c9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:27.806780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.807550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.829111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b58400156cea4050a1d4ec929541c8c9', 'request_id': 'req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.852936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.854233 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2765/5565] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:27 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:27.856277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:27.871998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb220-ae51-48fe-a86d-68db00e6fe0d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.882487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.883275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.883610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.883885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.884862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b58400156cea4050a1d4ec929541c8c9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.886722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 28 10:13:27.909382 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 28 10:13:27.911038 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:13:27.911861 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2801/5566] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:13:27 2022] GET /identity/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9 => generated 74 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:13:27.917346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.924009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:27.930275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c71b-da2e-4c97-8d0d-cd4d06d4f91b tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:27.938053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:27.939032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:27.939685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:27.940296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:27.941341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b58400156cea4050a1d4ec929541c8c9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:27.943083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:27.943699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer b58400156cea4050a1d4ec929541c8c9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:27.943896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.944748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 28 10:13:27.989458 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 28 10:13:27.990683 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:13:27.996038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:27.997883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:28.007963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2766/5567] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:27 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b58400156cea4050a1d4ec929541c8c9 => generated 74 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:13:28.023628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20b4-3390-4541-aa8d-7a80d07b14f9 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.029468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.031246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.033533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.037318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.038460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.040952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.072307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2802/5568] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Oct 28 10:13:27 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:28.076768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.098243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea01a-f263-4b4a-b62b-c5e25fd5b367 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.116229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.117434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.117936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.119245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.120429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.123149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.164295 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2767/5569] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Oct 28 10:13:28 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:28.168089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.183822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb98a9-1efd-4115-8657-8e8ae0f53412 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.189273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.190241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.191470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.192117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.193073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.194385 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:28.194385 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:13:28.194385 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:13:28.195683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.204236 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2803/5570] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 10:13:28 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:28.208101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.238212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894b252-afea-48ed-8a89-c928a1ec4a1d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.249529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.251913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.252303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.254140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/759b52e0593d44c0b0fd4019b45c9164` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.254859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=759b52e0593d44c0b0fd4019b45c9164)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.262709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.262709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer 759b52e0593d44c0b0fd4019b45c9164 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:28.262709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.263443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.290996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '759b52e0593d44c0b0fd4019b45c9164', 'request_id': 'req-d23748d9-6f50-4c98-8902-8160dd713dfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.315462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2768/5571] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:28 2022] DELETE /identity/v3/OS-OAUTH1/consumers/759b52e0593d44c0b0fd4019b45c9164 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:28.317371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.319486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:28.341128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7a00-6083-4b29-b250-a8f6351aa519 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.351706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.352661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.352969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.353239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b1803b5c58bd47d0845f59e548f08c86` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.356023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b1803b5c58bd47d0845f59e548f08c86)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.370747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.372834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer b1803b5c58bd47d0845f59e548f08c86 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:28.374137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.377461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.400497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b1803b5c58bd47d0845f59e548f08c86', 'request_id': 'req-2c2a0616-1e46-4a93-a73b-49bb37acb022'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.419253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2804/5572] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:28 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b1803b5c58bd47d0845f59e548f08c86 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:28.426430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.442605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23748d9-6f50-4c98-8902-8160dd713dfb tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.450038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.450667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.450951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.451234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.451870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.453527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.483288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2769/5573] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Oct 28 10:13:28 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:28.484722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.486130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:28.503962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0616-1e46-4a93-a73b-49bb37acb022 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.509942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.510654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.510937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.511238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.511889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=a5b0dedfbfdb4210b3d5a6bfb7d3bd59)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.512923 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:13:28.512923 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:13:28.512923 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:13:28.513825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.537052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2805/5574] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Oct 28 10:13:28 2022] PATCH /identity/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59 => generated 220 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:28.538392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.551232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a52ff9-80a2-4c05-9427-0ceca3f1425d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.556864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.557725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.558281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.558557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.559154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a5b0dedfbfdb4210b3d5a6bfb7d3bd59)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.561006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.571313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2770/5575] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:13:28 2022] GET /identity/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59 => generated 220 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:28.573981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.588360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b804e-8fa6-4c02-85bf-c4d6a8fd01c6 tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.596528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e57966cfcf84e7f85316dd4449dadf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59ca213c59b49c89674356cdf306c23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.597528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.598084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.598440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.599289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a5b0dedfbfdb4210b3d5a6bfb7d3bd59)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.601717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.602070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invalidating token cache because consumer a5b0dedfbfdb4210b3d5a6bfb7d3bd59 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:28.603109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.604064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.620679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2914f7f2-e3bf-48ad-8044-ff60506b529a tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a5b0dedfbfdb4210b3d5a6bfb7d3bd59', 'request_id': 'req-2914f7f2-e3bf-48ad-8044-ff60506b529a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.643099 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2806/5576] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:13:28 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a5b0dedfbfdb4210b3d5a6bfb7d3bd59 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:28.651231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:28.653959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:28.758156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c13e-13d0-491a-a960-af0f563a057d tempest-OAUTHConsumersV3Test-73977664 tempest-OAUTHConsumersV3Test-73977664-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:28.769752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:28.770587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.770935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.771276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] PATH_INFO: `/v3/users/e781fa94734848b996f514ee031c2f8b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.772721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e781fa94734848b996f514ee031c2f8b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:28.775300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:28.837181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e781fa94734848b996f514ee031c2f8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.838258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e781fa94734848b996f514ee031c2f8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.839066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e781fa94734848b996f514ee031c2f8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.848671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e781fa94734848b996f514ee031c2f8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.857979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e781fa94734848b996f514ee031c2f8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:28.879776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2771/5577] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:28 2022] DELETE /identity/v3/users/e781fa94734848b996f514ee031c2f8b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:28.884543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:28.885319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:28.886080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:28.926970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:28.928210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:28.962215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:29.028008 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2807/5578] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:29.089041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:29.090900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:29.107095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:29.183123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b59d4-c6e2-454f-858b-8a0f0eb0c074 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:29.194056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:29.194723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:29.194984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:29.195346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:29.239051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:29.240769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:29.263986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2772/5579] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:30.203637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:30.204317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:30.230258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd87b6-98c3-4f1f-a8b7-d4d381e03286 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:30.248661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:30.249436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:30.249717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:30.250657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] PATH_INFO: `/v3/projects/cd0f76ab4e4f4dad9fe96aeed12ab87b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:30.255435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0f76ab4e4f4dad9fe96aeed12ab87b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:30.259138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:30.331914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0f76ab4e4f4dad9fe96aeed12ab87b', 'request_id': 'req-494b1042-2992-4194-9ac2-090abeab1443'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.339846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0f76ab4e4f4dad9fe96aeed12ab87b', 'request_id': 'req-494b1042-2992-4194-9ac2-090abeab1443'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.375047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0f76ab4e4f4dad9fe96aeed12ab87b', 'request_id': 'req-494b1042-2992-4194-9ac2-090abeab1443'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.415191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] The token cache is being invalidate because project cd0f76ab4e4f4dad9fe96aeed12ab87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:30.419759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.422181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.442414 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2808/5580] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:30 2022] DELETE /identity/v3/projects/cd0f76ab4e4f4dad9fe96aeed12ab87b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:30.447870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:30.461330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3513f-17b9-4432-b7b0-a369e34ff418 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:30.615155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:30.617248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:30.617970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:30.618439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] PATH_INFO: `/v3/users/9e57966cfcf84e7f85316dd4449dadf7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:30.620148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e57966cfcf84e7f85316dd4449dadf7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:30.623802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:30.684843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:30.687079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:30.725034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1042-2992-4194-9ac2-090abeab1443 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:30.742947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:30.744540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:30.746013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:30.747002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] PATH_INFO: `/v3/users/b98d1652c8d94fdbbab352f78ab0ee86` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:30.750819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98d1652c8d94fdbbab352f78ab0ee86)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:30.756389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:30.772808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e57966cfcf84e7f85316dd4449dadf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.775340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e57966cfcf84e7f85316dd4449dadf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.776505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e57966cfcf84e7f85316dd4449dadf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.796872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e57966cfcf84e7f85316dd4449dadf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.823087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bdd75310-10ec-4ab2-ba25-a92a12065682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e57966cfcf84e7f85316dd4449dadf7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.877003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2773/5581] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:30 2022] DELETE /identity/v3/users/9e57966cfcf84e7f85316dd4449dadf7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:30.880241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98d1652c8d94fdbbab352f78ab0ee86'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.881034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98d1652c8d94fdbbab352f78ab0ee86'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.895746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98d1652c8d94fdbbab352f78ab0ee86'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.906451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98d1652c8d94fdbbab352f78ab0ee86'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.907354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98d1652c8d94fdbbab352f78ab0ee86'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:30.931798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2809/5582] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:30 2022] DELETE /identity/v3/users/b98d1652c8d94fdbbab352f78ab0ee86 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:30.937369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:30.937810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:30.938166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:30.983628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:30.988503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:31.042793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:31.112616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2774/5583] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:31.175174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:31.176730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:31.272799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:31.319516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4530-e203-4402-8af0-c2f4d749444c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:31.324745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:31.326718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.327526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.327845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.350024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:31.352510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846867d7-2837-4b3c-ad3f-f8189fc5f856 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:31.365952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2810/5584] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:31.592601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:31.594433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:31.610644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c016e2-cad5-4ee6-9920-461eb2508ce5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:31.617049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:31.617684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.617963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.618313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] PATH_INFO: `/v3/projects/b59ca213c59b49c89674356cdf306c23` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.619463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59ca213c59b49c89674356cdf306c23)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:31.621443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:31.677462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59ca213c59b49c89674356cdf306c23', 'request_id': 'req-14e83837-1627-469f-a72f-ae8c9b9d47a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:31.685368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59ca213c59b49c89674356cdf306c23', 'request_id': 'req-14e83837-1627-469f-a72f-ae8c9b9d47a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:31.694863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59ca213c59b49c89674356cdf306c23', 'request_id': 'req-14e83837-1627-469f-a72f-ae8c9b9d47a2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:31.707411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] The token cache is being invalidate because project b59ca213c59b49c89674356cdf306c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:31.708052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:31.709392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-14e83837-1627-469f-a72f-ae8c9b9d47a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:31.711043 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2775/5585] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:31 2022] DELETE /identity/v3/projects/b59ca213c59b49c89674356cdf306c23 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:31.716897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.717316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.717928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.741708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:31.743901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:31.832551 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2811/5586] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:31.842733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.843383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.843726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.866974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:31.868444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:31.876972 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2776/5587] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:31.882230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:31.894157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6fe40-dfdd-43ef-9a39-8525ff789a55 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:31.899677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:31.900356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.900636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.901000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.902178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:31.902495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:31.905916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:31.923916 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2812/5588] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:31.925965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:31.937215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cf1a-a4c6-4706-90ef-95f102410016 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:31.944341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:31.945222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:31.945707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:31.946090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:31.947262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:31.949555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:31.998707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2777/5589] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:31 2022] POST /identity/v3/projects => generated 395 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:31.998953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.011288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c71e-666e-4d67-baac-6d14fdef0de4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.082175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.082976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.083475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.083973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.085226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.087262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.119490 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2813/5590] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:31 2022] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:32.120689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.131946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3b24-d7fd-46d7-a4d9-44fa50621a25 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.137406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.138128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.138511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.138883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.139872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.141639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.156292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2778/5591] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:32.157991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.170066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ef33-977f-46d6-ac3d-7b3f04293970 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.177432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.178950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.179600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.179979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] PATH_INFO: `/v3/projects/65b2386c80bf495c926e341d663d2ffe/users/87c25332d0ea4056b5ca4032467cce10/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.201684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b2386c80bf495c926e341d663d2ffe, user_id=87c25332d0ea4056b5ca4032467cce10, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.204571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.221211 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2814/5592] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:32 2022] PUT /identity/v3/projects/65b2386c80bf495c926e341d663d2ffe/users/87c25332d0ea4056b5ca4032467cce10/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:32.226087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.240202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc788-d916-44e4-9cf8-f18a651e09a7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.337753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.338374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.338861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.339136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.339961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.341861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e198c9-36f4-4f0c-adfe-f42d582d0668 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.362016 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2779/5593] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:32.363856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.381687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae4e34-d292-4292-b03c-c910818f9eb1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.390806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.391875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.392210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.392471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] PATH_INFO: `/v3/projects/65b2386c80bf495c926e341d663d2ffe/users/87c25332d0ea4056b5ca4032467cce10/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.395856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b2386c80bf495c926e341d663d2ffe, user_id=87c25332d0ea4056b5ca4032467cce10, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.398843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.414045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2815/5594] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:32 2022] PUT /identity/v3/projects/65b2386c80bf495c926e341d663d2ffe/users/87c25332d0ea4056b5ca4032467cce10/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:32.425033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c105-b542-41cc-a294-ff8046863708 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.425325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c105-b542-41cc-a294-ff8046863708 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.425599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c105-b542-41cc-a294-ff8046863708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.450075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:32.458787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b272c105-b542-41cc-a294-ff8046863708 None None] MFA Rules not processed for user `87c25332d0ea4056b5ca4032467cce10`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:32.461173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b272c105-b542-41cc-a294-ff8046863708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:32.573267 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2780/5595] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:32.578774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.599857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:32.611136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c105-b542-41cc-a294-ff8046863708 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.613676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b272c105-b542-41cc-a294-ff8046863708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:32.702879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfcb9b-4d3f-4830-86bb-c60bac3a5c71 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.710930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.711866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.712363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.712769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.728878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.731192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.741793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c105-b542-41cc-a294-ff8046863708 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.753770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.754750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.755096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.755503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] PATH_INFO: `/v3/projects/0be7d9f8d18a4727b1e7dbafa9d5108d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.757319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be7d9f8d18a4727b1e7dbafa9d5108d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.760576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.774516 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2816/5596] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:32 2022] POST /identity/v3/projects => generated 397 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:32.778098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.835867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be7d9f8d18a4727b1e7dbafa9d5108d', 'request_id': 'req-fe45a614-81d5-4715-aadb-20e358862a00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:32.844499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be7d9f8d18a4727b1e7dbafa9d5108d', 'request_id': 'req-fe45a614-81d5-4715-aadb-20e358862a00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:32.856428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be7d9f8d18a4727b1e7dbafa9d5108d', 'request_id': 'req-fe45a614-81d5-4715-aadb-20e358862a00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:32.871035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] The token cache is being invalidate because project 0be7d9f8d18a4727b1e7dbafa9d5108d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:32.871920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:32.872599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:32.877333 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2781/5597] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:32 2022] DELETE /identity/v3/projects/0be7d9f8d18a4727b1e7dbafa9d5108d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:32.880073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:32.880818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:32.890925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f682-c32a-4fc4-9bb9-fb574614996a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.923291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:32.979005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.979936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.980066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a614-81d5-4715-aadb-20e358862a00 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:32.981744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.982280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.984104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.986850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:32.987334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:32.987709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:32.988127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] PATH_INFO: `/v3/users/b6ebadfc74bc493dbfea3b1ce23c91e9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:32.988827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:32.989704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ebadfc74bc493dbfea3b1ce23c91e9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:32.992023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:33.031682 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2817/5598] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:32 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:33.033217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:33.036146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:33.052848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6883-da07-43f9-ab78-849ea387b64d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:33.059099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:33.060044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:33.060569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:33.060856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:33.061528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:33.064381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:33.066961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ebadfc74bc493dbfea3b1ce23c91e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:33.068361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ebadfc74bc493dbfea3b1ce23c91e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:33.069633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ebadfc74bc493dbfea3b1ce23c91e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:33.078514 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2818/5599] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:33.083224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ebadfc74bc493dbfea3b1ce23c91e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:33.083545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:33.085508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:33.096075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ebadfc74bc493dbfea3b1ce23c91e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:33.115108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42b02-0c56-43a8-a4cb-31813847a320 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:33.120268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:33.120988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2782/5600] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:32 2022] DELETE /identity/v3/users/b6ebadfc74bc493dbfea3b1ce23c91e9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:33.121146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:33.121294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:33.121568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:33.122290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:33.124416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd6dc0-e23e-422a-aa1a-df2da27766f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:33.142310 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2819/5601] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:33.144182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:33.255316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4715b-8340-4291-93ad-3c17f961e404 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:33.264958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:33.265647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:33.266263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:33.266609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] PATH_INFO: `/v3/projects/616abcf57a944a719e8f75045e9a181e/users/e88de2dab5734551acbd73f39aaada20/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:33.294338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=616abcf57a944a719e8f75045e9a181e, user_id=e88de2dab5734551acbd73f39aaada20, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:33.299367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:33.318985 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2783/5602] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:33 2022] PUT /identity/v3/projects/616abcf57a944a719e8f75045e9a181e/users/e88de2dab5734551acbd73f39aaada20/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:33.329586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:33.330483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:33.330850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:33.355686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:33.366786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] MFA Rules not processed for user `e88de2dab5734551acbd73f39aaada20`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:33.369056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:33.507793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2820/5603] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:33.517972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:33.519906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:33.565752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:33.636521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81fa83-513d-439f-94ec-e468d88a2e4f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:33.641058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:33.641756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:33.642894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:33.643782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:33.646251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:33.741177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:33.741177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:33.746210 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2784/5604] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:34.238481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.295110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.298226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.341649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db419b9-905e-4abc-9c4e-e88a0e576e3d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.348368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.349264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.349707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.350170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] PATH_INFO: `/v3/users/87c25332d0ea4056b5ca4032467cce10` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.351840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c25332d0ea4056b5ca4032467cce10)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.353891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:34.398101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f883-1f0a-4ea1-9fd9-2d06aa4e333d service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.406241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.407024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.407391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.407666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] PATH_INFO: `/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.408879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d11b0aa13489cb3be4d3672054ae3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.411306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:34.427732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c25332d0ea4056b5ca4032467cce10'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.429127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c25332d0ea4056b5ca4032467cce10'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.440354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c25332d0ea4056b5ca4032467cce10'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.453171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c25332d0ea4056b5ca4032467cce10'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.456785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c25332d0ea4056b5ca4032467cce10'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.471157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d11b0aa13489cb3be4d3672054ae3', 'request_id': 'req-55bcd24b-70bc-4b4c-b9a0-0f726774969b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.480743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d11b0aa13489cb3be4d3672054ae3', 'request_id': 'req-55bcd24b-70bc-4b4c-b9a0-0f726774969b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.492871 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2821/5605] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:34 2022] DELETE /identity/v3/users/87c25332d0ea4056b5ca4032467cce10 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:34.496361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d11b0aa13489cb3be4d3672054ae3', 'request_id': 'req-55bcd24b-70bc-4b4c-b9a0-0f726774969b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.496567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.501795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.508296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:34.516711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] The token cache is being invalidate because project dd4d11b0aa13489cb3be4d3672054ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:34.517136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.519208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-55bcd24b-70bc-4b4c-b9a0-0f726774969b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.523653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2785/5606] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:34 2022] DELETE /identity/v3/projects/dd4d11b0aa13489cb3be4d3672054ae3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:34.525605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-f2bf-4ec5-9da7-4a14984513a4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.525605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-f2bf-4ec5-9da7-4a14984513a4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.525605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01cc0-f2bf-4ec5-9da7-4a14984513a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.528460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:34.554167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34f01cc0-f2bf-4ec5-9da7-4a14984513a4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:34.556484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34f01cc0-f2bf-4ec5-9da7-4a14984513a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.604878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130afab-6c74-4969-8ba2-a4b6ab2d14db admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.611503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.612967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.613406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.613822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] PATH_INFO: `/v3/users/ac4b0d8f32c94a1a9260665ad0588950` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.615929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4b0d8f32c94a1a9260665ad0588950)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.618925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:34.637596 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2786/5607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:34.637596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.637596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.637596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.661298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:34.662906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.674386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2787/5608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:34.675549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.677090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.689080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4b0d8f32c94a1a9260665ad0588950'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.690078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4b0d8f32c94a1a9260665ad0588950'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.710865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4b0d8f32c94a1a9260665ad0588950'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.722003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4b0d8f32c94a1a9260665ad0588950'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.722741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb690d0d-7bbc-4697-a82b-5c3728c716ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4b0d8f32c94a1a9260665ad0588950'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:34.741684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2822/5609] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:34 2022] DELETE /identity/v3/users/ac4b0d8f32c94a1a9260665ad0588950 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:34.746628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb6c2-4e40-450e-9bd1-8e1fba1344e6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.746628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb6c2-4e40-450e-9bd1-8e1fba1344e6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.746628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb6c2-4e40-450e-9bd1-8e1fba1344e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.748776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fab05-2f34-4c7a-8f0c-d05128ed6349 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.770573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-348fb6c2-4e40-450e-9bd1-8e1fba1344e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:34.771927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-348fb6c2-4e40-450e-9bd1-8e1fba1344e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.806603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.807588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.808333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.808857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.811080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.870381 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2823/5610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:34.871613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.872001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.873010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.897190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.897723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:34.898553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:34.899246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.903732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:34.910223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2824/5612] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:34.911398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.913017 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2788/5612] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:34.923414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d864b-c0a1-427c-b2f9-d00626166749 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.930682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.931410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.931825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.932198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.933268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:34.933675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.935447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:34.951069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.955000 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2825/5613] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:34.956772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:34.957879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:34.970782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5367d86-d017-4713-9168-4fcb4e3ea5f4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.979140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:34.979858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:34.980237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:34.980646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:34.980785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587d28-682a-4103-87bc-0d25dd93544f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:34.981616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:34.983881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.001913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.003248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.003897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.004052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.022807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.025354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:35.029013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.043232 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2789/5614] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:35.052477 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2826/5615] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:34 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:35.056468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.072720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f548-1ea1-4105-8e7b-339fc6ae74bb service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.154502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.155458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.156099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.156249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.157025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.159634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.194667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.196943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2790/5616] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:35 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:35.206213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01f84-9897-42a7-b668-0cc10e98ce1e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.211954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.213343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.213621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.214163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.214825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.217185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.231671 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2827/5617] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:35.232983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.246257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a0ee-cc7a-4150-823f-d8098e676a0f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.251754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.252496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.252778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.253104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.254090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.255867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5900-dd39-4711-8fde-5bd5f469f945 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.267079 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2791/5618] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:35.271652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.282718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d85140-6c9c-4ab2-b634-ccb7914a5bda admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.288225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.288886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.289194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.289466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] PATH_INFO: `/v3/projects/ff3cd017130e4b1ba4cd04c73df11689/users/7cd2affcdc5448daa78919b83c7b3786/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.305400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3cd017130e4b1ba4cd04c73df11689, user_id=7cd2affcdc5448daa78919b83c7b3786, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.308437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.322731 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2828/5619] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:35 2022] PUT /identity/v3/projects/ff3cd017130e4b1ba4cd04c73df11689/users/7cd2affcdc5448daa78919b83c7b3786/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:35.333528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebad91-da32-415b-8f59-af627774f67d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.333921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebad91-da32-415b-8f59-af627774f67d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.334255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebad91-da32-415b-8f59-af627774f67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.370587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7cebad91-da32-415b-8f59-af627774f67d None None] MFA Rules not processed for user `7cd2affcdc5448daa78919b83c7b3786`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:35.372069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7cebad91-da32-415b-8f59-af627774f67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.398650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.400647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.473324 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2792/5620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:35.477535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebad91-da32-415b-8f59-af627774f67d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.500214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4de43-44a8-40da-922f-7ee19e372e19 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.512645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebad91-da32-415b-8f59-af627774f67d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.514677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.517449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.518302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.519461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] PATH_INFO: `/v3/projects/65b2386c80bf495c926e341d663d2ffe` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.521100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b2386c80bf495c926e341d663d2ffe)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.523303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.524102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.524946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.526710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.527155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.528188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.531829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.577468 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2793/5621] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:35 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:35.578643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.592719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.614775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b2386c80bf495c926e341d663d2ffe', 'request_id': 'req-920ee3d1-b78f-4949-8441-5909b18c0a2e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.625001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b2386c80bf495c926e341d663d2ffe', 'request_id': 'req-920ee3d1-b78f-4949-8441-5909b18c0a2e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.641152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:35.641751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b2386c80bf495c926e341d663d2ffe', 'request_id': 'req-920ee3d1-b78f-4949-8441-5909b18c0a2e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.663445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] The token cache is being invalidate because project 65b2386c80bf495c926e341d663d2ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:35.663974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.664785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.666351 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2829/5622] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:35 2022] DELETE /identity/v3/projects/65b2386c80bf495c926e341d663d2ffe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:35.670137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.672135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.682034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a36ef2-b287-4f94-8280-e5e360b2f9de admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.744276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:35.757539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.757858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.758215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.759318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] PATH_INFO: `/v3/projects/80cf7f45212e4e948458de24f7b594c6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.760455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cf7f45212e4e948458de24f7b594c6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.761220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee3d1-b78f-4949-8441-5909b18c0a2e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.762659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.771125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.771882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.772290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.773316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.774750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.777525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.807742 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2830/5623] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:35 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:35.809559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.814616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.828038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cf7f45212e4e948458de24f7b594c6', 'request_id': 'req-26ccb609-03e8-467a-baa1-cdd289fdf14b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.828964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a229-a6af-41be-8a62-3b8b3e3ff22b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.837815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cf7f45212e4e948458de24f7b594c6', 'request_id': 'req-26ccb609-03e8-467a-baa1-cdd289fdf14b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.849056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cf7f45212e4e948458de24f7b594c6', 'request_id': 'req-26ccb609-03e8-467a-baa1-cdd289fdf14b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.863785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] The token cache is being invalidate because project 80cf7f45212e4e948458de24f7b594c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:35.864619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.864799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.866448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2794/5624] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:35 2022] DELETE /identity/v3/projects/80cf7f45212e4e948458de24f7b594c6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:35.870288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.871909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.904050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.905040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.905426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.905980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] PATH_INFO: `/v3/users/e88de2dab5734551acbd73f39aaada20` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.907061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88de2dab5734551acbd73f39aaada20)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.909378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.951133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccb609-03e8-467a-baa1-cdd289fdf14b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:35.958342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:35.958996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:35.959286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:35.959590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:35.960491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:35.962359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:35.977034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2795/5625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:35.977034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:35.978030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:35.988608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88de2dab5734551acbd73f39aaada20'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:35.990097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88de2dab5734551acbd73f39aaada20'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.006426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88de2dab5734551acbd73f39aaada20'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.031298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88de2dab5734551acbd73f39aaada20'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.032404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3248-453a-4020-a522-a6af3fc2e390 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.033061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88de2dab5734551acbd73f39aaada20'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.045922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.047084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.047468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.048061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] PATH_INFO: `/v3/users/aba86222acc64a03bf8dd7b3782ceed7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.050574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba86222acc64a03bf8dd7b3782ceed7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.055192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.057460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:36.062920 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2831/5626] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:35 2022] DELETE /identity/v3/users/e88de2dab5734551acbd73f39aaada20 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:36.065266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.073646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.148125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba86222acc64a03bf8dd7b3782ceed7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.148990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba86222acc64a03bf8dd7b3782ceed7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.149712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba86222acc64a03bf8dd7b3782ceed7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.162680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba86222acc64a03bf8dd7b3782ceed7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.176953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba86222acc64a03bf8dd7b3782ceed7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.210730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2796/5627] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:35 2022] DELETE /identity/v3/users/aba86222acc64a03bf8dd7b3782ceed7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:36.232382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ede83-5385-4de7-8cd3-3fd2c74ac502 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.238387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:36.325466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.326040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.326580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.326845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] PATH_INFO: `/v3/projects/77755464395144e0834e08b9fb96cc01/users/441b3ce968d54c09b76c2e618ea5cb3d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.356844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77755464395144e0834e08b9fb96cc01, user_id=441b3ce968d54c09b76c2e618ea5cb3d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.359790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.383640 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2832/5628] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:36 2022] PUT /identity/v3/projects/77755464395144e0834e08b9fb96cc01/users/441b3ce968d54c09b76c2e618ea5cb3d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:36.385285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.386833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.403983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260d9a-d5b2-481a-9b57-205ee1be8774 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.498253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.501734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.502248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.502701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.504215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.507533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c68b5f-2f98-429e-a73e-e558ee011b3c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.526789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2797/5629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:36.530647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.544481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5909-8e29-41a9-984b-bf6725e8af16 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.551678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.552529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.553100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.553445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] PATH_INFO: `/v3/projects/77755464395144e0834e08b9fb96cc01/users/441b3ce968d54c09b76c2e618ea5cb3d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.555686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=77755464395144e0834e08b9fb96cc01, user_id=441b3ce968d54c09b76c2e618ea5cb3d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.558822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.571634 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2833/5630] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:36 2022] PUT /identity/v3/projects/77755464395144e0834e08b9fb96cc01/users/441b3ce968d54c09b76c2e618ea5cb3d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:36.581794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.582077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.582348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.615363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] MFA Rules not processed for user `441b3ce968d54c09b76c2e618ea5cb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:36.616606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.700531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.703127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.728828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:36.745102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2798/5631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:36.754700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.756495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.832238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf30c-f340-433c-add4-86cd6904cdcd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.838069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.839576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.839576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.839576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] PATH_INFO: `/v3/projects/586ac960a0684a7cadbec20fed2b84fb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.841125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586ac960a0684a7cadbec20fed2b84fb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.847864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.871309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a0c05-1978-4c1e-81a1-1d5fb3843895 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.875329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:36.875950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.876394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.876669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.887709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:36.890005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:36.903285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2799/5632] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:36.904704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:36.906162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:36.909968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586ac960a0684a7cadbec20fed2b84fb', 'request_id': 'req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.916653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586ac960a0684a7cadbec20fed2b84fb', 'request_id': 'req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.922718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d19-7a92-4df3-9305-d5aaa3dfc0d3 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:36.929465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586ac960a0684a7cadbec20fed2b84fb', 'request_id': 'req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.946578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] The token cache is being invalidate because project 586ac960a0684a7cadbec20fed2b84fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:36.947122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.949290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3e5a8ea8-dea0-4a14-8f0f-9e63e3907ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:36.957962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2834/5633] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:36 2022] DELETE /identity/v3/projects/586ac960a0684a7cadbec20fed2b84fb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:36.959292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:36.959574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:36.959844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:36.980219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:36.987320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:36.990194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.009681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.010429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.011078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.011432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] PATH_INFO: `/v3/projects/616abcf57a944a719e8f75045e9a181e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.012723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=616abcf57a944a719e8f75045e9a181e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.014704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.088359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616abcf57a944a719e8f75045e9a181e', 'request_id': 'req-d403f6e1-9f38-4292-8a1f-e94000825e8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:37.092568 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2835/5634] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:37.099801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.099801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.104769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616abcf57a944a719e8f75045e9a181e', 'request_id': 'req-d403f6e1-9f38-4292-8a1f-e94000825e8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:37.114736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616abcf57a944a719e8f75045e9a181e', 'request_id': 'req-d403f6e1-9f38-4292-8a1f-e94000825e8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:37.137059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] The token cache is being invalidate because project 616abcf57a944a719e8f75045e9a181e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:37.137530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:37.139606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d403f6e1-9f38-4292-8a1f-e94000825e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:37.141358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2800/5635] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:36 2022] DELETE /identity/v3/projects/616abcf57a944a719e8f75045e9a181e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:37.145165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d909-b967-45f2-8591-a03956c0b095 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.145165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d909-b967-45f2-8591-a03956c0b095 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.145485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d909-b967-45f2-8591-a03956c0b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.184405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c5a0d909-b967-45f2-8591-a03956c0b095 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:37.186203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c5a0d909-b967-45f2-8591-a03956c0b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.210231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24167b6-1d38-4217-b0f5-0f0adc03a287 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.218533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.276367 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2801/5636] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:37.276367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.276367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.276367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.301367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.302012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.302289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.302559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.303905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:37.304875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.305258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.321283 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2802/5637] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:37.321283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.327855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769c59-2a29-4180-a216-1fbce524afb0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.333596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.334210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.334494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.334762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.335403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:37.335701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.337397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a6030-7d9a-481e-8d20-193af02c3df3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.352050 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2803/5638] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:37.356765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.357081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.357360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.378396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:37.380428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.383173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.384945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.389606 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2804/5639] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:37.390534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.396256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2836/5640] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:37.397206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.402657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b4d9e-c900-486e-bbfe-0a4c30915cb4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.410131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.410573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aaf2-4602-4afd-82dd-eb28bc843038 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.411219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.411664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.411933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.412625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.414683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.417571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.418449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.418894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.419577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.420809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:37.421236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.422944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.439226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2837/5641] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:37.443942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.448874 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2805/5642] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/projects => generated 357 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:37.452941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.453234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.458855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bf626-67a1-4cac-9225-4836875a53cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.539011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.539736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.540050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.540395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.542290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.544485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.548604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816747d-da3b-4eef-b859-9885657f0152 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.559928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.560637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.561014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.561620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.562231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.564227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.593480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2838/5643] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:37.596173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.607741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2806/5644] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:37.613560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.640547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993057ba-4c3d-4bfb-bdf4-2c4a77353dd6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.716655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d938-218a-4ac2-a275-2de5657ca2e5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.722590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.723460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.723618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.723814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.724496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.726814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.734054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.734830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.735333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.735700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.736537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.739520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.751105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2839/5645] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:37.752694 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2807/5646] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:37.755754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.758617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.762294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.769655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc10e6-0ded-429d-9dcf-0407d55daf8c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.769929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac424b-46be-4976-b0fc-d26b7406091d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.776207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.776469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.777184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.777323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.777460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.777721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.777864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.778312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.778537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.779444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.780122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.781246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.795789 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2840/5647] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:37.795996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2808/5648] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:37.796102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.796745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.807472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd978f4-085d-4ecf-9f61-c10d2ccb7f77 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.808421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d5e7-b437-4ef3-b25e-3b178303d769 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.812380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.813005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.813287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.813998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.814279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.816071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.816658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.817133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.817734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.818224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] PATH_INFO: `/v3/projects/45b08f6adc0945d99c4aae169e8bc68d/users/a9963cbf91cb49e682819ce4cb1d8a0b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.828765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2809/5649] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:37.832610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:37.836813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b08f6adc0945d99c4aae169e8bc68d, user_id=a9963cbf91cb49e682819ce4cb1d8a0b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.839760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05811891-c167-487c-9975-f108d404cdc5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.843021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd637-2130-4e23-82a7-3f9c369e4c6a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:37.848937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:37.849607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.849893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.850433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] PATH_INFO: `/v3/projects/61332b7e148c4762aac01d3b0e0d5acd/users/3c2b5f5abcb64d01b97063c208c205ff/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.867333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61332b7e148c4762aac01d3b0e0d5acd, user_id=3c2b5f5abcb64d01b97063c208c205ff, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:37.868798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2841/5650] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:37 2022] PUT /identity/v3/projects/45b08f6adc0945d99c4aae169e8bc68d/users/a9963cbf91cb49e682819ce4cb1d8a0b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:37.870103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce829-c951-40b4-a487-2e3408ba9c78 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:37.880265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.880265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.880265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.888069 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2810/5651] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:37 2022] PUT /identity/v3/projects/61332b7e148c4762aac01d3b0e0d5acd/users/3c2b5f5abcb64d01b97063c208c205ff/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:37.899612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:37.899901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:37.900312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:37.910693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] MFA Rules not processed for user `a9963cbf91cb49e682819ce4cb1d8a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:37.912009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.933639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] MFA Rules not processed for user `3c2b5f5abcb64d01b97063c208c205ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:37.935006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:37.959552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:38.001532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2842/5652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:38.009818 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2811/5653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:38.012119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.013654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:38.014234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.080179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef49d-ee58-4dcf-b14e-648e5193b519 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.083647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708582c-2e5e-49c0-bb9c-5bf2c5b60f3b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.084170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.084783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.085092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.085366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.088936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.089692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.089991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.090248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.090873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.092831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.097157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.098925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.112985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2843/5654] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:38.124466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2812/5655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:38.128449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.148519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da25cc-61dc-4635-9450-7771db739b4a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.223129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.223951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.224323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.224726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.225977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.227591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.253096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2844/5656] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:38 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:38.257573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.275881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2318d-bdc2-4448-bd21-cd8db4d1dc83 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.283036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.284771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.285075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.285401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.286045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.289046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.302161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2813/5657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:13:38.306547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.326480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758093b-ae40-4725-aa45-28b59605d537 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.342581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.344893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.345644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.346261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.348371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.353044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb6096-78d2-4feb-8b1a-552ffb65ecff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.373647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2845/5658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:38.376871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.387242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2252-6a8f-4297-865e-15c65c47cd69 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.392505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.393205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.394045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.394318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] PATH_INFO: `/v3/projects/a782154cd1204cb8aaf61f5242817bce/users/597b93dc56b84a0bb2630fc9cedce72d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.411104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a782154cd1204cb8aaf61f5242817bce, user_id=597b93dc56b84a0bb2630fc9cedce72d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.413979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.417623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:38.442511 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2814/5659] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:38 2022] PUT /identity/v3/projects/a782154cd1204cb8aaf61f5242817bce/users/597b93dc56b84a0bb2630fc9cedce72d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:38.444163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.444400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.444519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.477621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] MFA Rules not processed for user `597b93dc56b84a0bb2630fc9cedce72d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:38.479918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:38.529246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:38.583848 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2846/5660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:38.598934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.600698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:38.767622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:38.769534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:38.810035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a929c-e662-4706-9b11-519e5032bf5f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.819160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.821824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.822842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.823160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.915789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38416d83-a8d3-4735-8bc8-72a616f86d1f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:38.933699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:38.934943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:38.934943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:38.934943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:38.942221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:38.967598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.967598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:38.985003 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2847/5661] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:38.985959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:38.987889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:39.009228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2815/5662] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:39.200463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:39.223343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae847-5504-4eea-ab55-5eb2e40cda55 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:39.228382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:39.229238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:39.229522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:39.229869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:39.242527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:39.244082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806969b0-414a-417a-9a74-0711c9677ec9 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:39.256156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2848/5663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:39.677556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:39.758365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f083fb-a5e0-4ce0-aabd-f76a135a38c4 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:39.766213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:39.767035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:39.767433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:39.767800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] PATH_INFO: `/v3/users/3c2b5f5abcb64d01b97063c208c205ff` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:39.769409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2b5f5abcb64d01b97063c208c205ff)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:39.771850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:39.851762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2b5f5abcb64d01b97063c208c205ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:39.854411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2b5f5abcb64d01b97063c208c205ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:39.855431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2b5f5abcb64d01b97063c208c205ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:39.860808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:39.872415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2b5f5abcb64d01b97063c208c205ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:39.884572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2b5f5abcb64d01b97063c208c205ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:39.912500 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2816/5664] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:39 2022] DELETE /identity/v3/users/3c2b5f5abcb64d01b97063c208c205ff => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:39.917076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:39.917608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:39.917608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:39.940036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:39.942056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:40.053425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2849/5665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:40.065150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:40.066960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:40.186648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92370ad-303d-40f7-81b5-b5e675d3d8d5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:40.193278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:40.194375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:40.194818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:40.195106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:40.209710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:40.211555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a263f-514e-4f0e-aca7-159bb6f8e2fa service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:40.226062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2817/5666] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:40.892516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:40.894339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:40.934848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d6fe-7545-46c1-98e1-4b923a98fe54 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:40.948197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:40.948684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:40.948770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:40.955378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:40.957320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:40.958772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:40.959282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] PATH_INFO: `/v3/projects/61332b7e148c4762aac01d3b0e0d5acd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:40.961368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61332b7e148c4762aac01d3b0e0d5acd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:40.965464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:40.979616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] MFA Rules not processed for user `906ed53d9d734a028b438ab998fdaaad`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:40.982133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:41.046883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:41.052625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61332b7e148c4762aac01d3b0e0d5acd', 'request_id': 'req-9a8fd022-7a16-490b-afaa-320d74310b98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.089868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61332b7e148c4762aac01d3b0e0d5acd', 'request_id': 'req-9a8fd022-7a16-490b-afaa-320d74310b98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.111629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61332b7e148c4762aac01d3b0e0d5acd', 'request_id': 'req-9a8fd022-7a16-490b-afaa-320d74310b98'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.135481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] The token cache is being invalidate because project 61332b7e148c4762aac01d3b0e0d5acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:41.136404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.139972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.142136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2818/5667] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:41.145946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2850/5668] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:40 2022] DELETE /identity/v3/projects/61332b7e148c4762aac01d3b0e0d5acd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:41.158779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:41.173227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856f95-9668-4f69-83e9-4af981a69b6e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:41.373095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:41.373864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:41.374211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:41.387125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] PATH_INFO: `/v3/users/597b93dc56b84a0bb2630fc9cedce72d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:41.394111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=597b93dc56b84a0bb2630fc9cedce72d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:41.396163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:41.415358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:41.530825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597b93dc56b84a0bb2630fc9cedce72d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.531567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597b93dc56b84a0bb2630fc9cedce72d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.532189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597b93dc56b84a0bb2630fc9cedce72d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.568106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597b93dc56b84a0bb2630fc9cedce72d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.591970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e7cf6115-56c5-494c-97aa-a9308b003caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597b93dc56b84a0bb2630fc9cedce72d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:41.652406 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2819/5669] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:41 2022] DELETE /identity/v3/users/597b93dc56b84a0bb2630fc9cedce72d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:42.802340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:42.803899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:42.840161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd022-7a16-490b-afaa-320d74310b98 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.035565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.036512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.037038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.038229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] PATH_INFO: `/v3/projects/a782154cd1204cb8aaf61f5242817bce` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.040373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a782154cd1204cb8aaf61f5242817bce)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.042972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.166349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a782154cd1204cb8aaf61f5242817bce', 'request_id': 'req-7c9fe083-4936-4c8c-9257-88cd4b26b097'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:43.186165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a782154cd1204cb8aaf61f5242817bce', 'request_id': 'req-7c9fe083-4936-4c8c-9257-88cd4b26b097'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:43.202357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a782154cd1204cb8aaf61f5242817bce', 'request_id': 'req-7c9fe083-4936-4c8c-9257-88cd4b26b097'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:43.223452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] The token cache is being invalidate because project a782154cd1204cb8aaf61f5242817bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:43.223770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:43.224827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c9fe083-4936-4c8c-9257-88cd4b26b097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:43.228258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2851/5670] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:42 2022] DELETE /identity/v3/projects/a782154cd1204cb8aaf61f5242817bce => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:43.234305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.234780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.234867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.261070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:43.262641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:43.428026 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2820/5671] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:43.437126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.437411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.437686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.482579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:43.483828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:43.520258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.525222 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2852/5672] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:43.533129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b944a9-6611-4d0f-bf62-f262c2444a53 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.547007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.547989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.547989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.548159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.548816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:43.549163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.551308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.580675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2821/5673] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:43.585148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.599240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05df1-5075-4b24-a565-ab81f30c8061 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.607746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.608018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.608361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.608788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.609568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.612307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.658976 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2853/5674] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:43 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:43.663943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.683591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23507ee-154d-4481-a762-89766db94ecf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.779888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.781227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.781586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.781927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.782825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.785072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.828875 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2822/5675] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:43 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:43.833054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.856795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dbf3a-c245-4914-8bc3-10ad9522c6f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.866043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.867301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.867958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.868585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.870184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.872179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.886783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2854/5676] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:43.891870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.900375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:43.913752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0b74-8575-42c5-855b-452886dfe62f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.927803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.928677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.929113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.929508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:43.930615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:43.933340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93786fe8-9ecb-4198-a70f-ae9cee210a2e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:43.953910 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2823/5677] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:43.955350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:43.970942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed4c-19e9-4526-a87e-8a0ff9bb14ef admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:43.979318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:43.980313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:43.981135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:43.981609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] PATH_INFO: `/v3/projects/0e8a6f90840e47138fe2bd49d675b419/users/f59ee7cabcec480e9ec1caf55f830da1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.004708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8a6f90840e47138fe2bd49d675b419, user_id=f59ee7cabcec480e9ec1caf55f830da1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:44.007821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:44.036110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2855/5678] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:43 2022] PUT /identity/v3/projects/0e8a6f90840e47138fe2bd49d675b419/users/f59ee7cabcec480e9ec1caf55f830da1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:44.049657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:44.050467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:44.050896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.125657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] MFA Rules not processed for user `f59ee7cabcec480e9ec1caf55f830da1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:44.132182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:44.276501 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2824/5679] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:44.280980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:44.285676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:44.398373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c53d0-971c-4c72-8736-f19b4ca93eb9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:44.404085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:44.404711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:44.405876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:44.406320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.407166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:44.409630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:44.481240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2856/5680] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:44 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:44.485817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:44.499369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8feb1c-8b35-4afa-a1fa-d2b16b38214e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:44.642461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:44.643327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:44.643591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:44.656522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.658289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:44.661077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:44.711498 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2825/5681] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:44 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:44.714793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:44.734088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c0f0-e13b-491b-8b65-60fa64a330bc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:44.748145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:44.750103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:44.750430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:44.752268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.753003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:44.755869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:44.788636 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2857/5682] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:44.789830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:44.805345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a383-e352-4907-9fe6-413de350b4e3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:44.819582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:44.819969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:44.820252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:44.820528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] PATH_INFO: `/v3/projects/d7186c6bdff4411fbe3c4bee64288404/users/67fffe5bc1d44f96b45a89d76345b154/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:44.856598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7186c6bdff4411fbe3c4bee64288404, user_id=67fffe5bc1d44f96b45a89d76345b154, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:44.866086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:44.895581 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2826/5683] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:44 2022] PUT /identity/v3/projects/d7186c6bdff4411fbe3c4bee64288404/users/67fffe5bc1d44f96b45a89d76345b154/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:44.899356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:44.914371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb67ef-899d-481b-a11a-0f86b97c7b0e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:45.047482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:45.048400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:45.051412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:45.051711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:45.053111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:45.055099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafde205-383d-483c-a913-eaf92cc0cac9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:45.075108 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2858/5684] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:45.076589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:45.093807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409d5c-2833-4329-a2f2-bee616108c28 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:45.131411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:45.132759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:45.139719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:45.139719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] PATH_INFO: `/v3/projects/d7186c6bdff4411fbe3c4bee64288404/users/67fffe5bc1d44f96b45a89d76345b154/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:45.149145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7186c6bdff4411fbe3c4bee64288404, user_id=67fffe5bc1d44f96b45a89d76345b154, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:45.154115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:45.170555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2827/5685] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:45 2022] PUT /identity/v3/projects/d7186c6bdff4411fbe3c4bee64288404/users/67fffe5bc1d44f96b45a89d76345b154/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:45.183740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:45.184072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:45.184450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:45.241454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] MFA Rules not processed for user `67fffe5bc1d44f96b45a89d76345b154`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:45.243440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:45.349442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:45.357051 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2859/5686] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:45.374205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:45.377181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:45.442868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:45.492074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d86-f98f-415d-b77d-209bba5a1901 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:45.496060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:45.496687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:45.497000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:45.497276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:45.509177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:45.510656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a0477-2ff7-4b85-ac09-5460ab28a3b3 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:45.524493 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2828/5687] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:47.105614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:47.107076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:47.191315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c735c4-d514-4064-b1f7-7882161ba6ae None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:47.201675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:47.203240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:47.203753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:47.204129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] PATH_INFO: `/v3/users/7cd2affcdc5448daa78919b83c7b3786` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:47.206382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd2affcdc5448daa78919b83c7b3786)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:47.208826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:47.275591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd2affcdc5448daa78919b83c7b3786'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:47.275973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd2affcdc5448daa78919b83c7b3786'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:47.286417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd2affcdc5448daa78919b83c7b3786'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:47.297666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd2affcdc5448daa78919b83c7b3786'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:47.298578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd2affcdc5448daa78919b83c7b3786'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:47.326092 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2860/5688] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:47 2022] DELETE /identity/v3/users/7cd2affcdc5448daa78919b83c7b3786 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:47.327764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:47.328178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:47.328314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:47.382060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:47.383781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:47.485325 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2829/5689] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:47.500015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:47.501521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:47.589343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32100af-4808-45e0-9110-c1c8c880203b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:47.593765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:47.594397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:47.594677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:47.594948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:47.629597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:47.631867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:47.680477 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2861/5690] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:48.431097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:48.433692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:48.455278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7e7c-05d7-43cc-822f-91e3924d2c4a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:48.478861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:48.479978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:48.480445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:48.480890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] PATH_INFO: `/v3/projects/ff3cd017130e4b1ba4cd04c73df11689` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:48.483714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3cd017130e4b1ba4cd04c73df11689)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:48.493082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:48.615983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3cd017130e4b1ba4cd04c73df11689', 'request_id': 'req-2bbf1655-66ea-4029-ac24-47ccf4166941'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.623138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3cd017130e4b1ba4cd04c73df11689', 'request_id': 'req-2bbf1655-66ea-4029-ac24-47ccf4166941'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.636081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3cd017130e4b1ba4cd04c73df11689', 'request_id': 'req-2bbf1655-66ea-4029-ac24-47ccf4166941'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.669848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] The token cache is being invalidate because project ff3cd017130e4b1ba4cd04c73df11689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:48.670453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.671844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.677732 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2830/5691] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:48 2022] DELETE /identity/v3/projects/ff3cd017130e4b1ba4cd04c73df11689 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:48.678022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:48.696797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a694-965a-4fa0-a002-8aab293cd197 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:48.738058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:48.793458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:48.795003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:48.809284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:48.809555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1655-66ea-4029-ac24-47ccf4166941 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:48.810359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:48.810709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:48.811055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] PATH_INFO: `/v3/users/441b3ce968d54c09b76c2e618ea5cb3d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:48.812375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441b3ce968d54c09b76c2e618ea5cb3d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:48.814434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:48.815707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:48.816699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:48.817073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:48.817586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] PATH_INFO: `/v3/users/f59ee7cabcec480e9ec1caf55f830da1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:48.819301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59ee7cabcec480e9ec1caf55f830da1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:48.821761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:48.881591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441b3ce968d54c09b76c2e618ea5cb3d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.882144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441b3ce968d54c09b76c2e618ea5cb3d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.897900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59ee7cabcec480e9ec1caf55f830da1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.899097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59ee7cabcec480e9ec1caf55f830da1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.900033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59ee7cabcec480e9ec1caf55f830da1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.903076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441b3ce968d54c09b76c2e618ea5cb3d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.915817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59ee7cabcec480e9ec1caf55f830da1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.919746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:48.927186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441b3ce968d54c09b76c2e618ea5cb3d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.928379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cf8c1f17-0af9-4638-a3f8-7bdcfdb87ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441b3ce968d54c09b76c2e618ea5cb3d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.945366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59ee7cabcec480e9ec1caf55f830da1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:48.970818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2862/5692] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:48 2022] DELETE /identity/v3/users/441b3ce968d54c09b76c2e618ea5cb3d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:48.978534 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2831/5693] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:48 2022] DELETE /identity/v3/users/f59ee7cabcec480e9ec1caf55f830da1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:48.982890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:48.984232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:48.984378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.009728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:49.010991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:49.134303 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2863/5694] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:49.162306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.164448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:49.258578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90eff-a914-4dcf-94f4-e4913710dc2e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:49.264435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:49.265232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.265606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.266023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.278475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:49.280007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d08c7-46ef-4188-bebd-6ea7ed5da08a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:49.296196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2832/5695] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:49.455567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.458031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:49.475511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dbdbb-14fb-47a4-a19e-593e7caffae4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:49.482612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:49.483367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.483969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.484342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] PATH_INFO: `/v3/projects/77755464395144e0834e08b9fb96cc01` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.486873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77755464395144e0834e08b9fb96cc01)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:49.489316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:49.539089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:49.552028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77755464395144e0834e08b9fb96cc01', 'request_id': 'req-82207034-71c6-48eb-bf89-70d289de95d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:49.558628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77755464395144e0834e08b9fb96cc01', 'request_id': 'req-82207034-71c6-48eb-bf89-70d289de95d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:49.568125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77755464395144e0834e08b9fb96cc01', 'request_id': 'req-82207034-71c6-48eb-bf89-70d289de95d0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:49.582882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] The token cache is being invalidate because project 77755464395144e0834e08b9fb96cc01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:49.582882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:49.582882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82207034-71c6-48eb-bf89-70d289de95d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:49.584934 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2864/5696] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:49 2022] DELETE /identity/v3/projects/77755464395144e0834e08b9fb96cc01 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:49.589471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.590291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.590748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.613126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:49.614501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:49.692538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2833/5697] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:49.701620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.702156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.702301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.722558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:49.723873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:49.732828 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2865/5698] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:49.737664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.750849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a73ea-3227-4c45-b6b8-9374ee6d5504 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:49.756386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:49.757121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.757467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.757808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.758654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:49.758966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:49.760566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:49.774027 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2834/5699] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:13:49.778467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.788292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7224fd-cc03-47fa-8265-bb2b0266c233 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:49.793222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:49.793960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.794100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.794361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.795000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:49.796935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:49.830270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2866/5700] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:49 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:49.834583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.845604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708d40-5a62-45f7-a74b-3ae464e9853c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:49.915131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:49.915912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:49.916293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:49.916659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:49.917614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:49.919972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:49.932630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:49.981373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:49.995707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2835/5701] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:49 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:49.998875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846b69a-8480-47a3-864a-bc3633a3aba4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.008670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.011096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.012227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.012610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.015069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.019460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.044194 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2867/5702] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:50.048027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:50.064480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adb1-8134-4487-b6ac-fa8f3106f1d0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.077718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.078619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.079113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.079493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.080592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.086522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.115160 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2836/5703] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:50.116898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:50.132096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae4e6-8342-40db-a6f4-ccb6142674ea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.145944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.149802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:50.151880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:50.161458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.162484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.162942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] PATH_INFO: `/v3/projects/53ab7227ba704cbdb9ad081f5569b5f9/users/e88c699fb0cc4067970ae55a87d8eac5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.185965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ab7227ba704cbdb9ad081f5569b5f9, user_id=e88c699fb0cc4067970ae55a87d8eac5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.190089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714db23-6950-48ce-adf9-245475a75de2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.190414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b952d-bf09-48e5-894f-90cba6c734be admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.205949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.209004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.209417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.212240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] PATH_INFO: `/v3/projects/0e8a6f90840e47138fe2bd49d675b419` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.217144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8a6f90840e47138fe2bd49d675b419)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.217540 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2868/5704] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:50 2022] PUT /identity/v3/projects/53ab7227ba704cbdb9ad081f5569b5f9/users/e88c699fb0cc4067970ae55a87d8eac5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:50.219300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.221922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.222416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.222896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.261795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:50.266365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:50.370493 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2869/5705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:50.376846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8a6f90840e47138fe2bd49d675b419', 'request_id': 'req-909eaca8-659f-470d-a0c5-8b37cd475f93'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.389874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:50.391541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:50.395897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8a6f90840e47138fe2bd49d675b419', 'request_id': 'req-909eaca8-659f-470d-a0c5-8b37cd475f93'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.411723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8a6f90840e47138fe2bd49d675b419', 'request_id': 'req-909eaca8-659f-470d-a0c5-8b37cd475f93'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.437113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] The token cache is being invalidate because project 0e8a6f90840e47138fe2bd49d675b419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:50.437519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.439079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.444195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2837/5706] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:50 2022] DELETE /identity/v3/projects/0e8a6f90840e47138fe2bd49d675b419 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:13:50.448221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:50.451143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:50.531781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8fdd-7294-4dee-977f-9c938889286b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.563020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:50.608796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eaca8-659f-470d-a0c5-8b37cd475f93 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:50.634055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.634720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.635001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.635277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] PATH_INFO: `/v3/users/67fffe5bc1d44f96b45a89d76345b154` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.637169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fffe5bc1d44f96b45a89d76345b154)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.639191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.666474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:50.667045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:50.667316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:50.667584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:50.671497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:50.703329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:50.705104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:50.726675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2870/5707] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:50.813960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fffe5bc1d44f96b45a89d76345b154'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.814688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fffe5bc1d44f96b45a89d76345b154'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.816050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fffe5bc1d44f96b45a89d76345b154'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.828021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fffe5bc1d44f96b45a89d76345b154'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.840077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d5e27484-2603-4f10-b557-2adc2b475a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fffe5bc1d44f96b45a89d76345b154'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:50.845735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=3,keystone:SELECT=82,keystone:DELETE=15 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:50.868622 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2838/5708] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:13:50 2022] DELETE /identity/v3/users/67fffe5bc1d44f96b45a89d76345b154 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:51.277218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:51.287085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddd9b-651f-42c5-8980-a4e9ac9338e9 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:51.398901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:51.399746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:51.399902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:51.400085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] PATH_INFO: `/v3/projects/d7186c6bdff4411fbe3c4bee64288404` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:51.403658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7186c6bdff4411fbe3c4bee64288404)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:51.405528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:51.500429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7186c6bdff4411fbe3c4bee64288404', 'request_id': 'req-0e209e37-a670-4e34-bf52-5ff06b549b33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:51.509490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7186c6bdff4411fbe3c4bee64288404', 'request_id': 'req-0e209e37-a670-4e34-bf52-5ff06b549b33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:51.519361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7186c6bdff4411fbe3c4bee64288404', 'request_id': 'req-0e209e37-a670-4e34-bf52-5ff06b549b33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:51.534442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] The token cache is being invalidate because project d7186c6bdff4411fbe3c4bee64288404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:13:51.535019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:51.536205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0e209e37-a670-4e34-bf52-5ff06b549b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:13:51.537990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2871/5709] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:13:51 2022] DELETE /identity/v3/projects/d7186c6bdff4411fbe3c4bee64288404 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:51.543080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b572e-8f79-4502-8267-5e1277102997 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:51.543368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b572e-8f79-4502-8267-5e1277102997 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:51.543641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b572e-8f79-4502-8267-5e1277102997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:51.568766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-350b572e-8f79-4502-8267-5e1277102997 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:51.570339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-350b572e-8f79-4502-8267-5e1277102997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:51.703691 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2839/5710] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:51.704343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:51.704730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:51.704730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:51.742047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:51.744351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:51.758630 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2872/5711] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:51.760296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b572e-8f79-4502-8267-5e1277102997 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:51.776735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b572e-8f79-4502-8267-5e1277102997 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:51.782539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:51.784977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:51.785553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:51.786099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:51.786999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:13:51.787528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:51.789737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:51.808846 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2840/5712] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:13:51.813254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:51.825617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b4354-1527-4f13-83b0-bc4f9c3b4a5a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:51.838014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:51.839575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:51.840036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:51.840483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:51.841327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:51.843642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:51.905053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2873/5713] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:51.908961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:51.921747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f5f5-ba62-4d7d-a983-003eacb900d6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.010740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.011376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.011654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.011928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.012572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.015222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.053951 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2841/5714] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:51 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:13:52.058504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.077039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61868-f863-419f-9535-446d0b7c8fe2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.087356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.087999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.088286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.088558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.089242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.090890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.111302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2874/5715] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:52.115652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.128363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235b6b7-0b2c-445d-8569-4dfbd33d519d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.133581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.134747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.135221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.135570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.136310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.138432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44137b5b-1d30-4a49-8ef7-3e79f98311c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.151923 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2842/5716] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:52.155795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.170659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6bd8-e87a-4518-8a8d-10e146be0046 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.177087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.177824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.178152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.178419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] PATH_INFO: `/v3/projects/4c8085a331c845cb8b1e4901f8620fa5/users/014bbbe30bae421c95f500eede3ac04c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.183702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:52.217443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8085a331c845cb8b1e4901f8620fa5, user_id=014bbbe30bae421c95f500eede3ac04c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.220460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0746b6-169e-4638-bb5c-a6e5b245cbd9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.267548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2875/5717] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:52 2022] PUT /identity/v3/projects/4c8085a331c845cb8b1e4901f8620fa5/users/014bbbe30bae421c95f500eede3ac04c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:52.272752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.273950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.274344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.280704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.285415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.287550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.335932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] MFA Rules not processed for user `014bbbe30bae421c95f500eede3ac04c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:52.337370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:52.358212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] MFA Rules not processed for user `e88c699fb0cc4067970ae55a87d8eac5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:52.360407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:52.433127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:52.485081 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2876/5718] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:52.490272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.492042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:52.503461 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2843/5719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:13:52.516693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.518450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:52.632219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104755c-610f-4f83-9e51-a67d0dd4ae89 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.636884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.637532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.638118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c43b-8a66-4090-9cc9-1387523a9421 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.638908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.639201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.643621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.644234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.644616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.644894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.645546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.647544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.651807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.661378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.683105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2877/5720] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:52.686828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.694472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2844/5721] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:13:52.776242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d4a0-20aa-494c-8ca0-14443b8c36b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.781324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.781946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.782226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.782499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.784319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.786364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.795030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:52.813927 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2878/5722] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:13:52 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:13:52.817991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.831633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a638c-7291-4fd4-a807-a7ff66dc10b0 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.837842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.838719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.839057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.839621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.840337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.842231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.856584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2845/5723] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:52.860586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.877427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4a673-2e8e-4290-9297-673a97f978b0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:52.884867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:52.885676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:52.886064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:52.886397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] PATH_INFO: `/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33/users/baf100f20be74d7881e728d5f121a08f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:52.904643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3e29dcec0d47dda02e9d7c19a06d33, user_id=baf100f20be74d7881e728d5f121a08f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:52.907638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:52.931776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2879/5724] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:52 2022] PUT /identity/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33/users/baf100f20be74d7881e728d5f121a08f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:52.935820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:52.949553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5792c-aeb6-413e-8139-65869c228c42 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:53.081533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:53.082163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:53.082442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:53.082719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:53.083360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:53.084991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81733beb-a975-4400-9d09-edec1a6b7f47 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:53.104358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2846/5725] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:13:53.108116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:53.123352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1fd0b-f68b-4fdf-9b5e-643bc327bfd5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:53.130739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:53.132225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:53.132734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:53.133269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] PATH_INFO: `/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33/users/baf100f20be74d7881e728d5f121a08f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:53.139625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3e29dcec0d47dda02e9d7c19a06d33, user_id=baf100f20be74d7881e728d5f121a08f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:53.144832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c211343-c74a-4a17-b538-d8f11ad0ba54 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:53.173750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2880/5726] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:13:53 2022] PUT /identity/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33/users/baf100f20be74d7881e728d5f121a08f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:13:54.766307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:54.766814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:54.766814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:54.812932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] MFA Rules not processed for user `baf100f20be74d7881e728d5f121a08f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:54.814176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:54.942303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:54.965393 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2847/5727] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:54.969951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:54.972660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:54.973154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:54.994601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] MFA Rules not processed for user `e88c699fb0cc4067970ae55a87d8eac5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:54.997311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:55.069847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2881/5728] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:55.085440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:55.087588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:55.203981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3604af-8cd5-4826-b6dd-4d7ae938c6f2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:55.210570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:55.211348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:55.211637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:55.211911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:55.223343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:55.226917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:55.249792 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2848/5729] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:05.062042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=5,keystone:SELECT=42 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:05.232952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=41 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:17.225051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:17.227086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:17.294407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:17.296126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:17.393090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac886f-78df-4fc2-9cd0-8f1846b30647 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:17.411240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:17.411877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:17.412159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:17.417513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:17.420447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:17.460020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:17.462184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:17.507399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2882/5730] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:17.530095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b65be7-88e5-496e-b2e2-84ad192bb166 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:17.542274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:17.545166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:17.545166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:17.545166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:17.577993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:17.579555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:17.631632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2849/5731] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:17.881090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:17.882799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:18.026586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbd894-d3a2-433f-a959-d0d7a3245206 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:18.036677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:18.037347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:18.037633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:18.037890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:18.066412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:18.068037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:18.134213 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2883/5732] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:22.894937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:22.896663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:22.948745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1929-e98d-4c0a-b3e1-9e50c173583d service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:22.958259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:22.958943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:22.959313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:22.959672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:22.961833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:23.068004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:23.069667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:23.099571 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2850/5733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:28.079338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=58 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:30.104754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:30.260633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397761a-03d9-4f83-8100-1f301d246564 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:30.269327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:30.273336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:30.273622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:30.274098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:30.280492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:30.467420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:30.469505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:30.495199 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2884/5734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:33.096710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=64 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:36.126841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:36.205749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597141bb-9607-4225-b638-38d30d379f56 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:36.254735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:36.255369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:36.256412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:36.256854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:36.259373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:36.442785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:36.444426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:36.484832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2851/5735] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:38.696321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:38.701869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:38.732498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef1b2e-a381-4452-804d-0116c210dd82 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:38.748283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:38.749464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:38.749906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:38.750447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] PATH_INFO: `/v3/users/b28b625c3a9340c888d9fab29f82ffa3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:38.753020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28b625c3a9340c888d9fab29f82ffa3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:38.755527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:38.852929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28b625c3a9340c888d9fab29f82ffa3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:38.854303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28b625c3a9340c888d9fab29f82ffa3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:38.871267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28b625c3a9340c888d9fab29f82ffa3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:38.887715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28b625c3a9340c888d9fab29f82ffa3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:38.892527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-31700243-717d-47dc-bf3f-a3e39a206ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28b625c3a9340c888d9fab29f82ffa3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:38.944847 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2885/5736] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:14:38 2022] DELETE /identity/v3/users/b28b625c3a9340c888d9fab29f82ffa3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:14:39.647541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:39.681075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a2477-95b2-4310-916b-4de3aace16be service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:39.829960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:39.830631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:39.830891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:39.831347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] PATH_INFO: `/v3/projects/9b12cfc0bbd64e7ea4a64277b566dfd8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:39.835589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b12cfc0bbd64e7ea4a64277b566dfd8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:39.837577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:39.950565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'request_id': 'req-905afaea-078d-4cb7-a354-2f933abbb6f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:39.978277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'request_id': 'req-905afaea-078d-4cb7-a354-2f933abbb6f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:39.991097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'request_id': 'req-905afaea-078d-4cb7-a354-2f933abbb6f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:40.026885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] The token cache is being invalidate because project 9b12cfc0bbd64e7ea4a64277b566dfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:14:40.027958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:40.029490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-905afaea-078d-4cb7-a354-2f933abbb6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:40.032232 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2852/5737] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:14:39 2022] DELETE /identity/v3/projects/9b12cfc0bbd64e7ea4a64277b566dfd8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:14:40.036957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.037491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.037491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.077287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:40.079139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:40.100929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:40.164867 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2886/5738] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:40.174202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.174462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.174739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.215069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:40.216229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:40.233925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2853/5739] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:40.246111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.277173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df11d2-669b-4a37-a784-e9bd0871adf5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.300217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.301954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.301954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.303923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.304853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:14:40.305375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.310015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.336318 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2887/5740] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:14:40.340535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.359651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc204e-8882-44b7-9f06-9d9980894e8f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.364840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.365726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.366167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.366610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.367421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.382272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.395839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:40.423319 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2854/5741] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:14:40.428175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.444636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad5a0-2640-4861-a78c-dcf6664b667b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.611668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.612765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.613294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.613806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.614687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.622337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.683762 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2888/5742] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:14:40 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:14:40.689476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.707470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48398-2b44-4ed5-b2a7-35be5998ed29 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.741677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.743750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.744234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.744671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.745982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.758235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.792467 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2855/5743] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:14:40.795078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.814332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530597b-24f5-4a8f-a88e-7d7ed2ba01a9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.828817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.829631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.829980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.830317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.831042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.832778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c4c59-adaf-4fe2-9955-9a4cbdb4f011 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.857961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:40.858719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2889/5744] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:14:40.875739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8da81-5dda-42d9-becf-645c7027d960 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:40.893269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:40.893874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.894230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.894633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] PATH_INFO: `/v3/projects/953dcbea116f45439fa6f2162591e611/users/b34b183f2b0b4a4597fb2e3b6495268a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:40.930742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] RBAC: Authorizing `identity:create_grant(project_id=953dcbea116f45439fa6f2162591e611, user_id=b34b183f2b0b4a4597fb2e3b6495268a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:40.937644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:40.966699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2856/5745] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:14:40 2022] PUT /identity/v3/projects/953dcbea116f45439fa6f2162591e611/users/b34b183f2b0b4a4597fb2e3b6495268a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:14:40.972449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:40.972811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:40.973100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:41.012737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:41.014066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:41.117419 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2890/5746] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:41.195697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:41.198548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:41.359548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28e65-d057-4140-ac14-f3c2ef39748f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:41.364781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:41.365431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:41.365713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:41.365985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:41.377114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:41.379205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:41.393165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2857/5747] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:42.227159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:42.229379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:42.257834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d49fa-833d-4767-b822-d9340fcae3e0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:42.273539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:42.276878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:42.277372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:42.277836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] PATH_INFO: `/v3/users/f4dc1824197d40e58d0dfdc8f55ab72d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:42.279570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dc1824197d40e58d0dfdc8f55ab72d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:42.281885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:42.350244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:42.409494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dc1824197d40e58d0dfdc8f55ab72d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:42.410988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dc1824197d40e58d0dfdc8f55ab72d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:42.423496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dc1824197d40e58d0dfdc8f55ab72d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:42.432393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dc1824197d40e58d0dfdc8f55ab72d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:42.433613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c8ea175a-18b0-4b65-9793-9727a42c3571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dc1824197d40e58d0dfdc8f55ab72d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:42.455013 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2891/5748] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:14:42 2022] DELETE /identity/v3/users/f4dc1824197d40e58d0dfdc8f55ab72d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:14:43.868150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:43.909057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99195b8-27b2-452c-a61b-2b55770064e9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:44.054513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:44.056149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.056539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.056936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] PATH_INFO: `/v3/projects/80974eba622d4830886ec598e50cad90` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.058895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80974eba622d4830886ec598e50cad90)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:44.061523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:44.188455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80974eba622d4830886ec598e50cad90', 'request_id': 'req-167d36eb-f378-40a9-8634-f9dc9a5f2188'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:44.197743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80974eba622d4830886ec598e50cad90', 'request_id': 'req-167d36eb-f378-40a9-8634-f9dc9a5f2188'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:44.201774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:44.210123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80974eba622d4830886ec598e50cad90', 'request_id': 'req-167d36eb-f378-40a9-8634-f9dc9a5f2188'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:44.232892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] The token cache is being invalidate because project 80974eba622d4830886ec598e50cad90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:14:44.233208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:44.234534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-167d36eb-f378-40a9-8634-f9dc9a5f2188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:14:44.242034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2858/5749] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:14:43 2022] DELETE /identity/v3/projects/80974eba622d4830886ec598e50cad90 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:14:44.242813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.243301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.243405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.273510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:44.275229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:44.442254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2892/5750] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:14:44.452560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.453168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.453393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.499946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:44.509395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:44.532948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:44.547556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2859/5751] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:44.547926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8dc10-d5ab-4464-9bb5-c301fd528376 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:44.559349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:44.559983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.560261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.560534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.564633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:14:44.566829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:44.571643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:44.604837 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2893/5752] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:14:44.609165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:44.626721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc2a16-eaef-4ff4-a3d3-e439013f5011 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:44.639675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:44.640306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.640582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.640848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.643197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:44.647402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:44.725179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2860/5753] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:14:44 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:14:44.729968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:44.753287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6424e4-14a7-4aa4-9a95-47886960ad10 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:44.907715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:44.908343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:44.908631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:44.908974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:44.909608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:44.911561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:44.968295 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2894/5754] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:14:44 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:14:44.972084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:44.984082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec28318-bed6-4606-8b9a-07ebc293166f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:45.003205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:45.003837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.004116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.004385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.005134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:45.014362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:45.034284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2861/5755] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:14:45.037993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:45.055914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed148a35-09a3-4f31-bfdc-dc3a42fdbc58 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:45.073604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:45.074276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.074552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.074819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.075472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:45.077244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb13f09-9067-4322-ade7-8dd1fbf64fc1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:45.105726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:45.117835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6cfe-5950-44b7-8500-4ac3bd9e1f45 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:45.118426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2895/5756] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:14:45.132979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:45.133685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.134010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.134278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] PATH_INFO: `/v3/projects/513259eefe5a40a3aa16b9c611d655b2/users/2c1df28a9d734105b8c99def44cbebbb/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.177850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513259eefe5a40a3aa16b9c611d655b2, user_id=2c1df28a9d734105b8c99def44cbebbb, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:45.181020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:45.210358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2862/5757] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:14:45 2022] PUT /identity/v3/projects/513259eefe5a40a3aa16b9c611d655b2/users/2c1df28a9d734105b8c99def44cbebbb/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:14:45.223139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7a19-e79b-447c-8111-a42dbc898d6a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.223833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7a19-e79b-447c-8111-a42dbc898d6a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.224473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7a19-e79b-447c-8111-a42dbc898d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.254050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:45.269229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-361d7a19-e79b-447c-8111-a42dbc898d6a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:45.273282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-361d7a19-e79b-447c-8111-a42dbc898d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:45.382535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2896/5758] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:45.477111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:45.479753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:45.645954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ae70-59c0-4a0e-a542-508cf2196be1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:45.650581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:45.651252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.651533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.652487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.665655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:45.681471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122cb90-c0fe-4867-9275-b65061aadd12 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:45.705165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2863/5759] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:45.923613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:45.923613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:45.923613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:45.991980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] MFA Rules not processed for user `906ed53d9d734a028b438ab998fdaaad`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:45.993347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:46.076962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2897/5760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:55.695190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=1,keystone:SELECT=57,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:56.066439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=49 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:01.308053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73ebb-76e5-4f66-a196-d8ba2900e221 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:01.308571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73ebb-76e5-4f66-a196-d8ba2900e221 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:01.308771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73ebb-76e5-4f66-a196-d8ba2900e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:01.397039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-33a73ebb-76e5-4f66-a196-d8ba2900e221 None None] MFA Rules not processed for user `b34b183f2b0b4a4597fb2e3b6495268a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:01.400969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33a73ebb-76e5-4f66-a196-d8ba2900e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:01.546581 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2864/5761] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:01.561568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:01.563733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:01.757420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4796ab-bd9f-4c4a-ad9d-db3395861bd5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:01.772393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:01.773067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:01.780253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:01.780654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:01.796012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:01.797744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059004-a6d4-4c5c-88f7-c2b4dc2e4b07 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:01.824733 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2898/5762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:02.993814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:02.996222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:02.997439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:03.036544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:03.039001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:03.151012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2865/5763] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:03.151912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588462a-ea96-4277-a65b-8b6263f8d3cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:03.152373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588462a-ea96-4277-a65b-8b6263f8d3cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:03.152549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588462a-ea96-4277-a65b-8b6263f8d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:03.238103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d588462a-ea96-4277-a65b-8b6263f8d3cd None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:03.239208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d588462a-ea96-4277-a65b-8b6263f8d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:03.287245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2899/5764] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:03.311151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:03.372125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca646-139c-4af0-b42f-d8df62dcf46d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:03.399840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:03.407780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:03.408570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:03.410013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:03.442129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:03.454470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:03.490641 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2866/5765] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:08.756433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:08.757843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:08.758390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:08.809135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] MFA Rules not processed for user `b34b183f2b0b4a4597fb2e3b6495268a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:08.810896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:08.846973 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2900/5766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:12.476881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:12.493420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef760-4be1-4bd7-9ea9-e553030886c8 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:12.521122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:12.521871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:12.522425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:12.522923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:12.530528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:12.598218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:12.603298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:12.672105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2867/5767] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:15:17.531339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:17.533580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:17.577060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055abd2-17bc-48e0-94d0-2c7557bd5e8a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:17.599476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:17.601657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:17.603773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:17.607364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] PATH_INFO: `/v3/users/e88c699fb0cc4067970ae55a87d8eac5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:17.610270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88c699fb0cc4067970ae55a87d8eac5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:17.620047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:17.802881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88c699fb0cc4067970ae55a87d8eac5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:17.804511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88c699fb0cc4067970ae55a87d8eac5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:17.826514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88c699fb0cc4067970ae55a87d8eac5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:17.837616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88c699fb0cc4067970ae55a87d8eac5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:17.838716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88c699fb0cc4067970ae55a87d8eac5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:17.865904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2901/5768] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:15:17 2022] DELETE /identity/v3/users/e88c699fb0cc4067970ae55a87d8eac5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:18.798866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:18.864484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3b45c-5b4f-48ba-9181-08c2c3d75b8e service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:19.191104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:19.233091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:19.235097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:19.240602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:19.241585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] PATH_INFO: `/v3/projects/53ab7227ba704cbdb9ad081f5569b5f9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:19.244870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ab7227ba704cbdb9ad081f5569b5f9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:19.256554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:19.437078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ab7227ba704cbdb9ad081f5569b5f9', 'request_id': 'req-4081844c-d86d-4b12-b52d-9a847e949613'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.450200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ab7227ba704cbdb9ad081f5569b5f9', 'request_id': 'req-4081844c-d86d-4b12-b52d-9a847e949613'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.464438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ab7227ba704cbdb9ad081f5569b5f9', 'request_id': 'req-4081844c-d86d-4b12-b52d-9a847e949613'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.486952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] The token cache is being invalidate because project 53ab7227ba704cbdb9ad081f5569b5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:15:19.487233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.487924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.494390 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2868/5769] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:15:18 2022] DELETE /identity/v3/projects/53ab7227ba704cbdb9ad081f5569b5f9 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:19.495613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:19.497175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:19.523184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469b76-1457-43bc-9750-8c4db09d9b28 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:19.619719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:19.693579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:19.694239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:19.694520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:19.694794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] PATH_INFO: `/v3/users/baf100f20be74d7881e728d5f121a08f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:19.695962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf100f20be74d7881e728d5f121a08f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:19.697970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:19.814403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf100f20be74d7881e728d5f121a08f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.815211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf100f20be74d7881e728d5f121a08f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.833977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf100f20be74d7881e728d5f121a08f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.843409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf100f20be74d7881e728d5f121a08f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.844269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4d85d1b8-43e6-4465-a5cc-b4075f9c57c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf100f20be74d7881e728d5f121a08f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:19.882229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2902/5770] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:15:19 2022] DELETE /identity/v3/users/baf100f20be74d7881e728d5f121a08f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:21.138312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:21.140406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:21.166394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081844c-d86d-4b12-b52d-9a847e949613 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:21.306565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:21.307211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.307683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.308395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] PATH_INFO: `/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.309801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3e29dcec0d47dda02e9d7c19a06d33)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:21.312687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:21.429492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3e29dcec0d47dda02e9d7c19a06d33', 'request_id': 'req-b61d1204-61aa-4113-a291-89888500a96f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:21.440219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3e29dcec0d47dda02e9d7c19a06d33', 'request_id': 'req-b61d1204-61aa-4113-a291-89888500a96f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:21.453589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3e29dcec0d47dda02e9d7c19a06d33', 'request_id': 'req-b61d1204-61aa-4113-a291-89888500a96f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:21.470444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] The token cache is being invalidate because project ed3e29dcec0d47dda02e9d7c19a06d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:15:21.471104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:21.472091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b61d1204-61aa-4113-a291-89888500a96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:21.474824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2869/5771] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:15:21 2022] DELETE /identity/v3/projects/ed3e29dcec0d47dda02e9d7c19a06d33 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:21.479487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.480359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.480812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.503133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:21.504662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:21.598852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.599138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.599440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.600088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2903/5772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:21.632762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:21.634626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:21.648244 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2870/5773] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:15:21.649647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:21.662266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c82c5f-a735-4f3f-befb-758df83189d2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:21.684320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:21.685808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.686250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.686702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.687471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:15:21.687781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:21.690377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:21.709479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2904/5774] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:15:21.713822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:21.728338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf066-2931-45a2-939c-1d6dcf4e8f64 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:21.733652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:21.734960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.736257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.736257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.736257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:21.738971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:21.751625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:21.785472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2871/5775] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:15:21 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:21.789360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:21.809517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f7bf-2922-4b7a-b087-50c32d828789 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:21.892715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:21.912025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:21.912517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.912858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.913236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.914006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:21.917920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:21.955481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:21.955862 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2905/5776] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:15:21 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:21.970225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f9fd-1003-4267-8fbe-db658e45894f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:21.977207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:21.977854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:21.978136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:21.978408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:21.979054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:21.980785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:21.993791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2872/5777] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:15:21.998244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:22.009971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5116f3-e886-46cd-bbe2-eedd728cb2bf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:22.019370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:22.020406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:22.020743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:22.021083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:22.021876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:22.023968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d83586-d74b-4f73-ab5a-187873321908 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:22.057035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2906/5778] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:22.057590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:22.071286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d7bc3-7577-41f4-a376-2dda75733831 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:22.078816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:22.079872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:22.080491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:22.081089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] PATH_INFO: `/v3/projects/72af6d56f0b5448fb4b98075f4d6be0b/users/a0c3eaac6b4f4b2685de2d234573e33a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:22.151615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=72af6d56f0b5448fb4b98075f4d6be0b, user_id=a0c3eaac6b4f4b2685de2d234573e33a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:22.165887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:22.207792 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2873/5779] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:15:22 2022] PUT /identity/v3/projects/72af6d56f0b5448fb4b98075f4d6be0b/users/a0c3eaac6b4f4b2685de2d234573e33a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:15:22.212886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909be6-95a1-4262-ae78-31c394d20369 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:22.213190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909be6-95a1-4262-ae78-31c394d20369 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:22.213625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909be6-95a1-4262-ae78-31c394d20369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:22.274639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2f909be6-95a1-4262-ae78-31c394d20369 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:22.276121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2f909be6-95a1-4262-ae78-31c394d20369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:22.438646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2907/5780] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:22.451213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:22.453965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:22.591557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a561e-375e-473f-a9fb-1499c5b0a6fe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:22.605294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:22.606190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:22.606641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:22.607083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:22.622742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:22.625218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:22.638237 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2874/5781] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:24.876305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c749-d2bc-4afe-9934-1124e7e3d3c4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:24.877178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c749-d2bc-4afe-9934-1124e7e3d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:24.877178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8c749-d2bc-4afe-9934-1124e7e3d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:24.954603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-08e8c749-d2bc-4afe-9934-1124e7e3d3c4 None None] MFA Rules not processed for user `a0c3eaac6b4f4b2685de2d234573e33a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:24.958592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08e8c749-d2bc-4afe-9934-1124e7e3d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:25.131915 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2908/5782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:25.146644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:25.148189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:25.269892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca5d-79f0-4a1b-90cf-8488e1907558 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:25.277210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:25.277909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:25.278191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:25.278464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:25.303857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:25.305366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e14ee-30e2-406e-9ea9-c06dac546d04 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:25.333478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2875/5783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:27.519341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:27.519894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:27.519894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:27.555430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:27.556654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:27.712655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2909/5784] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:28.240601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:28.241187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:28.241187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:28.275055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] MFA Rules not processed for user `a0c3eaac6b4f4b2685de2d234573e33a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:28.276652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:28.308326 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2876/5785] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:31.361642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:31.363717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:31.384225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:31.398622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc78f24-61ff-43e6-aa60-4a636287db6f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:31.413686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:31.414554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:31.415022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:31.415473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:31.422093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:31.614160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:31.617160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:31.659309 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2910/5786] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:38.270666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:41.640653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=32 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:45.314776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:45.316810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:45.336270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c140634-b9c2-4657-a9b9-e2d56dda5093 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:45.352768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:45.353854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:45.359360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:45.360220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] PATH_INFO: `/v3/users/906ed53d9d734a028b438ab998fdaaad` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:45.362233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] RBAC: Authorizing `identity:delete_user(user_id=906ed53d9d734a028b438ab998fdaaad)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:45.364369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:45.487553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906ed53d9d734a028b438ab998fdaaad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.491575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906ed53d9d734a028b438ab998fdaaad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.492613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906ed53d9d734a028b438ab998fdaaad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.510564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906ed53d9d734a028b438ab998fdaaad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.525096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d381ad4-6413-4b5d-b7b9-07ece5eb115b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906ed53d9d734a028b438ab998fdaaad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.575830 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2877/5787] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:15:45 2022] DELETE /identity/v3/users/906ed53d9d734a028b438ab998fdaaad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:46.135410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:46.161898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d2f0-d578-4458-892f-bb680bc5f226 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:46.296384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:46.297420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:46.297920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:46.298404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] PATH_INFO: `/v3/projects/93a2ed40295f44e2930a150edcbc798d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:46.301729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a2ed40295f44e2930a150edcbc798d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:46.304143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:46.385852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a2ed40295f44e2930a150edcbc798d', 'request_id': 'req-75fed773-4ed8-4ab6-acf8-1cd1088705e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.396111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a2ed40295f44e2930a150edcbc798d', 'request_id': 'req-75fed773-4ed8-4ab6-acf8-1cd1088705e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.412371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a2ed40295f44e2930a150edcbc798d', 'request_id': 'req-75fed773-4ed8-4ab6-acf8-1cd1088705e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.447704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] The token cache is being invalidate because project 93a2ed40295f44e2930a150edcbc798d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:15:46.447982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.448764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75fed773-4ed8-4ab6-acf8-1cd1088705e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.455749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2911/5788] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:15:46 2022] DELETE /identity/v3/projects/93a2ed40295f44e2930a150edcbc798d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:46.457604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:46.458130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:46.458130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:46.494665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:46.496205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:46.607917 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2878/5789] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:15:46.615555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:46.616072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:46.616571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:46.644781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:46.646705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:46.669441 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2912/5790] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:46.672722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:46.688771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff215cd-1ea7-4a8f-aba4-4555884d99ed None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:46.703278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:46.704184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:46.704664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:46.705761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:46.707655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:15:46.710173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:46.711845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:46.758824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2879/5791] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:15:46.760826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:46.772861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d0d89-8151-420e-8261-0d5282793bf6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:46.799940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:46.800530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:46.800812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:46.801106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:46.801751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:46.811113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:46.894047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2913/5792] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:15:46 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:46.895175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:46.924452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba3a1-3760-4a17-ac53-4f87a1cecd52 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:47.065793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:47.066441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.066721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.066994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.067658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:47.069694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:47.084034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:47.116397 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2880/5793] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:15:46 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:47.117860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:47.135186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2117094-efed-4596-8003-ce983e25c0ea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:47.161797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:47.162439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.162716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.162984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.163639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:47.165408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:47.198862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:47.209206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2914/5794] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:47.210405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0d33-4a07-44b0-a6c3-aef6487239b8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:47.227140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:47.227653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.227931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.228811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.229507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:47.231492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42129498-31db-4803-8de1-7fb7ed73a6df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:47.259510 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2881/5795] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:15:47.260718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:47.279646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab3fd4-f5f7-46ab-a048-49c96270b4a7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:47.297815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:47.298475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.298754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.299038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] PATH_INFO: `/v3/projects/647a75e417314ddbb20364530ad36c54/users/1b327af221c94695bc5b82fa49e3c448/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.354640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] RBAC: Authorizing `identity:create_grant(project_id=647a75e417314ddbb20364530ad36c54, user_id=1b327af221c94695bc5b82fa49e3c448, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:47.357380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:47.396182 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2915/5796] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:15:47 2022] PUT /identity/v3/projects/647a75e417314ddbb20364530ad36c54/users/1b327af221c94695bc5b82fa49e3c448/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:47.401450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.401735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.402009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.451524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:47.456552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:47.666939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2882/5797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:47.698236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:47.700011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:47.746021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:47.808530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fb07-5c00-4358-9f98-1f0dffb3494a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:47.815619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:47.818084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:47.818650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:47.819034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:47.859381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:47.860962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:47.889486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2916/5798] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:51.906916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:51.908653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:51.940827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1846292-0ac9-48e0-81ec-046a7e48fd06 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:51.947112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:51.947736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:51.948017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:51.948292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:51.956663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:51.986197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:51.987936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f1cde-bfdf-4de3-97a6-bcf85d7cc782 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.026814 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2883/5799] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:55.854754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:55.870941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a6867-de47-436e-900c-4e26f3473f30 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:55.881819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:55.882698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:55.883010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:55.883455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:55.886175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:55.925921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:55.939800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2eaca-9701-4140-875c-221d15b01fc4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:55.972015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2917/5800] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:02.010303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=3,keystone:SELECT=40 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:03.141463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34afd-c715-499b-8185-a59a9033efc3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:03.142740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34afd-c715-499b-8185-a59a9033efc3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:03.143262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34afd-c715-499b-8185-a59a9033efc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:03.169451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c9f34afd-c715-499b-8185-a59a9033efc3 None None] MFA Rules not processed for user `a0c3eaac6b4f4b2685de2d234573e33a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:03.171588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9f34afd-c715-499b-8185-a59a9033efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:03.335248 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2884/5801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:05.365578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfb75-4910-4f92-9c41-f9c112c02702 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:05.367297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfb75-4910-4f92-9c41-f9c112c02702 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:05.367985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfb75-4910-4f92-9c41-f9c112c02702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:05.450397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-564dfb75-4910-4f92-9c41-f9c112c02702 None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:05.455551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-564dfb75-4910-4f92-9c41-f9c112c02702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:05.462543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:05.463147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:05.464198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:05.494362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:05.495866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:05.683848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2885/5802] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:05.742304 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2918/5803] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:05.756449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:05.758358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:05.927060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7df5-31ca-45ca-8db0-6252cbdef672 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:05.933457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:05.934380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:05.934833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:05.935463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:05.948367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:05.950352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02d403-f105-418a-be98-3b3c9f579b5d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:05.965839 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2886/5804] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:09.966890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed527-5284-4322-859b-ac54ce52c579 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:09.967501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed527-5284-4322-859b-ac54ce52c579 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:09.967501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed527-5284-4322-859b-ac54ce52c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:09.996385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e64ed527-5284-4322-859b-ac54ce52c579 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:09.999231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e64ed527-5284-4322-859b-ac54ce52c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:10.008040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2919/5805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:12.173942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dac64-f43a-48f7-986f-c636a9db174a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:12.174652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dac64-f43a-48f7-986f-c636a9db174a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:12.175086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dac64-f43a-48f7-986f-c636a9db174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:12.212813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3a8dac64-f43a-48f7-986f-c636a9db174a None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:12.214084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3a8dac64-f43a-48f7-986f-c636a9db174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:12.232163 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2887/5806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:13.935037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673de0f-349d-498b-82e4-18bb3b281f49 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:13.935524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673de0f-349d-498b-82e4-18bb3b281f49 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:13.935524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673de0f-349d-498b-82e4-18bb3b281f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:13.962612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c673de0f-349d-498b-82e4-18bb3b281f49 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:13.964042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c673de0f-349d-498b-82e4-18bb3b281f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:13.979838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2920/5807] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:14.469204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51aff-5cd6-484a-989f-2b1141a6d286 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:14.469850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51aff-5cd6-484a-989f-2b1141a6d286 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:14.470192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51aff-5cd6-484a-989f-2b1141a6d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:14.513267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-37b51aff-5cd6-484a-989f-2b1141a6d286 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:14.514788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-37b51aff-5cd6-484a-989f-2b1141a6d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:14.531264 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2888/5808] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:15.028583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a721830-d3a4-4865-834e-9e5bccb1efc6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.029158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a721830-d3a4-4865-834e-9e5bccb1efc6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.029158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a721830-d3a4-4865-834e-9e5bccb1efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.054106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8a721830-d3a4-4865-834e-9e5bccb1efc6 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:15.055430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a721830-d3a4-4865-834e-9e5bccb1efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:15.081359 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2921/5809] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:16.244821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:16.245435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:16.245722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:16.272630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:16.274702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:16.293442 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2889/5810] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:17.550399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c07ad-2db5-4e9a-aacb-6d4b9a2a59ad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:17.550878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c07ad-2db5-4e9a-aacb-6d4b9a2a59ad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:17.550973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c07ad-2db5-4e9a-aacb-6d4b9a2a59ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:17.574904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-179c07ad-2db5-4e9a-aacb-6d4b9a2a59ad None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:17.576841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-179c07ad-2db5-4e9a-aacb-6d4b9a2a59ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:17.605254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2922/5811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:18.914778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:18.969707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14995-9835-45ba-995c-965a2bbfb907 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:18.983606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:18.984565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:18.985331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:18.996301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:19.001049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:19.031677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:19.034244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:19.051214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2890/5812] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:19.382137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31029c8-0dc5-4d00-9f81-af8abb7ecb77 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:19.382835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31029c8-0dc5-4d00-9f81-af8abb7ecb77 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:19.384048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31029c8-0dc5-4d00-9f81-af8abb7ecb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:19.396023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=65 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:19.418959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f31029c8-0dc5-4d00-9f81-af8abb7ecb77 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:19.422079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f31029c8-0dc5-4d00-9f81-af8abb7ecb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:19.431904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2923/5813] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:19.689718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:19.691814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:19.733618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:19.748857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bc613-e878-4766-9f56-3dde05a85c76 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:19.754495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:19.755388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:19.755861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:19.756303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] PATH_INFO: `/v3/users/a9963cbf91cb49e682819ce4cb1d8a0b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:19.757699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9963cbf91cb49e682819ce4cb1d8a0b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:19.760632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:19.858334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9963cbf91cb49e682819ce4cb1d8a0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:19.859916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9963cbf91cb49e682819ce4cb1d8a0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:19.861343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9963cbf91cb49e682819ce4cb1d8a0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:19.875089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9963cbf91cb49e682819ce4cb1d8a0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:19.891792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9963cbf91cb49e682819ce4cb1d8a0b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:19.931046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2891/5814] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:19 2022] DELETE /identity/v3/users/a9963cbf91cb49e682819ce4cb1d8a0b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:19.931679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c7e8-e3fa-4960-90d6-9744fefd9f6c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:19.931679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c7e8-e3fa-4960-90d6-9744fefd9f6c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:19.931883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c7e8-e3fa-4960-90d6-9744fefd9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:19.964655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5af5c7e8-e3fa-4960-90d6-9744fefd9f6c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:19.967732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5af5c7e8-e3fa-4960-90d6-9744fefd9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.070082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2924/5815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:20.091435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:20.093021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.245843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38648-8c38-4a76-87fd-a7f69d752e93 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:20.255545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:20.257301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:20.257764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:20.259533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:20.292176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:20.293766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:20.315086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c8ce-16d9-4f0b-89af-22b7591f9986 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:20.315425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c8ce-16d9-4f0b-89af-22b7591f9986 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:20.315856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2892/5816] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:16:20.316492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c8ce-16d9-4f0b-89af-22b7591f9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:20.349100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c016c8ce-16d9-4f0b-89af-22b7591f9986 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:20.350338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c016c8ce-16d9-4f0b-89af-22b7591f9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.385418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:20.386916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.410983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017de5-795a-4228-9a13-33e369d3a647 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:20.423065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:20.423690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:20.423970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:20.424240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:20.426240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.454698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:20.456149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:20.477369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2893/5817] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:20.489416 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2925/5818] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:20.756653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:20.759175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:20.777809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96d81-e2dc-4b97-be3c-6a16905fef12 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:20.790397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:20.791205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:20.791827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:20.791997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] PATH_INFO: `/v3/projects/45b08f6adc0945d99c4aae169e8bc68d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:20.793517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b08f6adc0945d99c4aae169e8bc68d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:20.797538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:20.871010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b08f6adc0945d99c4aae169e8bc68d', 'request_id': 'req-ec963533-450a-4001-82c7-5676664eb186'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:20.877737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b08f6adc0945d99c4aae169e8bc68d', 'request_id': 'req-ec963533-450a-4001-82c7-5676664eb186'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:20.879752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:20.890106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b08f6adc0945d99c4aae169e8bc68d', 'request_id': 'req-ec963533-450a-4001-82c7-5676664eb186'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:20.907373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] The token cache is being invalidate because project 45b08f6adc0945d99c4aae169e8bc68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:20.907826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:20.908583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec963533-450a-4001-82c7-5676664eb186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:20.910812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2894/5819] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:20 2022] DELETE /identity/v3/projects/45b08f6adc0945d99c4aae169e8bc68d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:20.915601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:20.915887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:20.916162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:20.947104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:20.949656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.052628 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2926/5820] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:21.060667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973183-accf-41ce-91df-432f76ba667e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.061105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973183-accf-41ce-91df-432f76ba667e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.061216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973183-accf-41ce-91df-432f76ba667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.110678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-40973183-accf-41ce-91df-432f76ba667e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:21.112402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-40973183-accf-41ce-91df-432f76ba667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.146876 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2895/5821] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:21.151121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.162078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c374f-49ca-4433-b3d2-188a62cd67b1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.167386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.168100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.168382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.168645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.169331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:16:21.169634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.171489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.218354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40973183-accf-41ce-91df-432f76ba667e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.223212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2927/5822] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:21.229284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40973183-accf-41ce-91df-432f76ba667e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.239929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.240864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.243098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.243535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.244198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.246192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.310754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2896/5823] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:21.314965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.338408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7f0a-84b4-4b03-9836-911c66f19776 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.387130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:21.439673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.440361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.440859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.441265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.442111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.445485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.475810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.486648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2928/5824] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:21.489508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4437a-42cf-4982-83af-31073b44bd11 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.496518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.498533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.499076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.506724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.507696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.509625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.526761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.527968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2897/5825] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:21.538465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c33562-34fa-4a44-b5f3-70690c5fa8c6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.544297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.545318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.545853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.546496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.547528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.549424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9ebbd-d2d5-4181-ad55-db0267c84f50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.562681 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2929/5826] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:21.567437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.579674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb1cbc-1bbc-46c6-9d2f-774be537f193 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.585409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.586217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.586603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.587009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] PATH_INFO: `/v3/projects/2bd76abd7dee46dd8b22188182c3040e/users/fd74b508b0a1493a8de74463e721cabf/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.629798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd76abd7dee46dd8b22188182c3040e, user_id=fd74b508b0a1493a8de74463e721cabf, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.632799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.656579 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2898/5827] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:16:21 2022] PUT /identity/v3/projects/2bd76abd7dee46dd8b22188182c3040e/users/fd74b508b0a1493a8de74463e721cabf/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:21.666911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.667192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.667496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.739406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] MFA Rules not processed for user `fd74b508b0a1493a8de74463e721cabf`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:21.740714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.807106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.812945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.901563 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2930/5828] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:21.960366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.962244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.982831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c6b1-eb44-45b6-a5c7-fd547c2a7568 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.994336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.994997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.995456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.995776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] PATH_INFO: `/v3/users/0a40eaa5eefa439bb590a7511814f61c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.013801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a40eaa5eefa439bb590a7511814f61c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:22.025223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:22.098870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eb2a2-5811-4cda-ad59-e7095563e2db None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:22.108808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:22.111290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:22.112406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:22.113447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.132451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a40eaa5eefa439bb590a7511814f61c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.137913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a40eaa5eefa439bb590a7511814f61c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.139210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a40eaa5eefa439bb590a7511814f61c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.139705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:22.143996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:22.167845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a40eaa5eefa439bb590a7511814f61c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.177105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2931/5829] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:16:22.183183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8c7e3f72-ddc8-47eb-b3e1-3bc12116d190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a40eaa5eefa439bb590a7511814f61c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.221948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2899/5830] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:21 2022] DELETE /identity/v3/users/0a40eaa5eefa439bb590a7511814f61c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:22.258096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:22.260241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a99c-be99-49bb-bdb6-1b904ed13e1e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:22.260884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a99c-be99-49bb-bdb6-1b904ed13e1e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:22.261213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a99c-be99-49bb-bdb6-1b904ed13e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.272258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=4,keystone:DELETE=11,keystone:SELECT=85 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:22.279978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252de64-cf69-4fb9-96b7-8ae9c4235115 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:22.309636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f0b2a99c-be99-49bb-bdb6-1b904ed13e1e None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:22.310904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f0b2a99c-be99-49bb-bdb6-1b904ed13e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:22.415135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:22.466463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:22.467474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:22.468312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:22.469176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] PATH_INFO: `/v3/users/fd74b508b0a1493a8de74463e721cabf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.471176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd74b508b0a1493a8de74463e721cabf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:22.475532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:22.485205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2900/5831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:22.552550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd74b508b0a1493a8de74463e721cabf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.553576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd74b508b0a1493a8de74463e721cabf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.566941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd74b508b0a1493a8de74463e721cabf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.578883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd74b508b0a1493a8de74463e721cabf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.580417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd74b508b0a1493a8de74463e721cabf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.624136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:22.624423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:22.624742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.628475 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2932/5832] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:22 2022] DELETE /identity/v3/users/fd74b508b0a1493a8de74463e721cabf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:22.651234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:22.657162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:22.698061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:22.701858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:22.801109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba63d4-a966-491a-9b73-78104b7fe320 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:22.807358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2901/5833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:22.810458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:22.811807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:22.812255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:22.812681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] PATH_INFO: `/v3/projects/adb7eccfe81e41db93216cb0441db339` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:22.814019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb7eccfe81e41db93216cb0441db339)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:22.817341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:22.843730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:22.845306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:22.899528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb7eccfe81e41db93216cb0441db339', 'request_id': 'req-a100e9d3-ab44-4113-99bd-5689974c7943'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.913575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb7eccfe81e41db93216cb0441db339', 'request_id': 'req-a100e9d3-ab44-4113-99bd-5689974c7943'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.922757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:22.942874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb7eccfe81e41db93216cb0441db339', 'request_id': 'req-a100e9d3-ab44-4113-99bd-5689974c7943'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.967921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] The token cache is being invalidate because project adb7eccfe81e41db93216cb0441db339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:22.968258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.973530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:22.979030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2933/5834] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:22 2022] DELETE /identity/v3/projects/adb7eccfe81e41db93216cb0441db339 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:22.981508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:22.982102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:22.997470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844353d-ab72-4a2e-be33-a7dd2004b202 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:23.058371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:23.059065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:23.059341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:23.059608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:23.061506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:23.081530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:23.123604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e9d3-ab44-4113-99bd-5689974c7943 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:23.134250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:23.135045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:23.135485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:23.139527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:23.140369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] PATH_INFO: `/v3/users/f60ed4d46390452eba5a3948941beaf5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:23.140778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:23.141979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60ed4d46390452eba5a3948941beaf5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:23.144038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:23.155087 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2902/5835] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:23.271869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60ed4d46390452eba5a3948941beaf5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:23.278394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60ed4d46390452eba5a3948941beaf5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:23.293294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60ed4d46390452eba5a3948941beaf5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:23.314103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60ed4d46390452eba5a3948941beaf5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:23.314909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-913b6567-bbe3-4017-bcbe-a4ab000864f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60ed4d46390452eba5a3948941beaf5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:23.345966 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2934/5836] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:22 2022] DELETE /identity/v3/users/f60ed4d46390452eba5a3948941beaf5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:23.724439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:23.742517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc484-a663-4fe0-9cab-a433714dbdb5 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:23.919646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:23.922814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:23.923097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:23.923434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] PATH_INFO: `/v3/projects/63ba0caa044245efa44111b366231ea8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:23.928700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ba0caa044245efa44111b366231ea8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:23.933769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.050114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ba0caa044245efa44111b366231ea8', 'request_id': 'req-574ce335-943b-441a-b353-42b53b2f5ea8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:24.069930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ba0caa044245efa44111b366231ea8', 'request_id': 'req-574ce335-943b-441a-b353-42b53b2f5ea8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:24.085305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ba0caa044245efa44111b366231ea8', 'request_id': 'req-574ce335-943b-441a-b353-42b53b2f5ea8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:24.105207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] The token cache is being invalidate because project 63ba0caa044245efa44111b366231ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:24.105631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:24.106940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-574ce335-943b-441a-b353-42b53b2f5ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:24.109887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2903/5837] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:23 2022] DELETE /identity/v3/projects/63ba0caa044245efa44111b366231ea8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:24.115034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.115034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.115698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.145654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:24.147311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:24.258140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2935/5838] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:24.265996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.266566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.266566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.289465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:24.290698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:24.304894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.310936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2904/5839] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:24.316377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20936e29-bbc0-48e5-b47d-ef224cf947c9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.321446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.322080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.322357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.322626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.323283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:16:24.323680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.325328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.328748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:24.345304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.351171 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2936/5840] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:24.355512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1219a6-3f11-4441-b7bf-3594ef0560bc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.361507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.362371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.362754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.363258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.364000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.366278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.416702 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2905/5841] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:16:24 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:16:24.421449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.438229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886291ee-2d26-47d0-ac8a-588c3ea2bb2b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.537098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.537272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.543731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.543731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.543731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.543731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.581241 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2937/5842] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:16:24 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:24.585823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.600005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cbb30-e784-456f-8e14-0754469447f1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.614978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.615264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.615541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.616318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.617132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.618740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.639486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2906/5843] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:16:24.643098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.660860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478d432-acb4-43de-809f-220c372332d0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.672926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.673573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.673842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.674115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.674759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.676649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.717086 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2938/5844] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:24.718426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.730131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:24.755194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245feac5-0e34-4188-b39f-bc313ee6f296 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.768402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:24.769570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.770098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.770564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] PATH_INFO: `/v3/projects/3ce2931e024a42219d4ed709e828b03d/users/90e6b24b39a3428882a1dee1bc3281bc/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.789382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce2931e024a42219d4ed709e828b03d, user_id=90e6b24b39a3428882a1dee1bc3281bc, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:24.793007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78047-7177-4575-a988-387ae06fc838 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:24.817312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:24.818486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2907/5845] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:16:24 2022] PUT /identity/v3/projects/3ce2931e024a42219d4ed709e828b03d/users/90e6b24b39a3428882a1dee1bc3281bc/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:24.821862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:24.837748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:24.838099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:24.839247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:24.858747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5d28-9e1c-4a83-9977-5ea365dfbec3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:24.903528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:24.905504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.010797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.011761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.012040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.012306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] PATH_INFO: `/v3/projects/2bd76abd7dee46dd8b22188182c3040e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.014731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd76abd7dee46dd8b22188182c3040e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.016651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.049267 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2908/5846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:25.059623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.067278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.137939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd76abd7dee46dd8b22188182c3040e', 'request_id': 'req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:25.149731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd76abd7dee46dd8b22188182c3040e', 'request_id': 'req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:25.163708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd76abd7dee46dd8b22188182c3040e', 'request_id': 'req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:25.165274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333458e-06e9-4cfb-b29c-62dd2fa92898 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.179973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] The token cache is being invalidate because project 2bd76abd7dee46dd8b22188182c3040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:25.180745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:25.181632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4aa447c8-efbc-4710-b1f3-f2b3e90441c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:25.183926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2939/5847] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:24 2022] DELETE /identity/v3/projects/2bd76abd7dee46dd8b22188182c3040e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:25.189702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58183c-a7c8-42ec-a563-cad55c52f484 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.190217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58183c-a7c8-42ec-a563-cad55c52f484 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.190999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58183c-a7c8-42ec-a563-cad55c52f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.203066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:25.219416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f58183c-a7c8-42ec-a563-cad55c52f484 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:25.221556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f58183c-a7c8-42ec-a563-cad55c52f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.246470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.249503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.249859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.250201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.256882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.304738 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2940/5848] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:25.315055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.315659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.315939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.348565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:25.349919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.365257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2941/5849] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:25.366189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.366831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:25.390666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1425e0-9580-4e45-9a93-e367d6d47ede None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.390903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.393534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.396886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.397702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.398046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.399606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.400761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:16:25.401157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.405962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.425729 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2942/5850] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:25.427112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.452862 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2909/5851] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:25.460209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67139cd-eff8-4e1b-81a1-0376581cde13 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.468342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.469075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.469415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.469900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.470685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.472870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.534251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.547440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2943/5852] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:25.551385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4edd-c415-4f90-8f0c-5e7f95693e2c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.679202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.680041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.680330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.680889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.681810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.684894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.719151 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2910/5853] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:16:25 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:25.727257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.748505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993896-3817-4bd5-85f3-52465da439ae admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.757819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.758593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.759003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.759625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.760415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.762458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.786242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2944/5854] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:25.790665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.806492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e22582-ddb8-4ee7-a5f2-089c6ca3ca0d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.820485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.821511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.822151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.822727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.823543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.826819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:25.839431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2911/5855] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:25.844095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.871631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:25.876795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:25.901854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91397b33-b332-4e52-9d87-7891099a32a9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:25.923354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:25.924279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:25.926437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:25.927891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] PATH_INFO: `/v3/projects/36a2de6962714324aa6489b26cbbae5d/users/f91d316475c1461dadce642aeb1b76f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:25.977581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a2de6962714324aa6489b26cbbae5d, user_id=f91d316475c1461dadce642aeb1b76f6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:25.981450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd63c-6f4f-49ae-b4ec-765c9af7db25 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:26.005857 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2945/5856] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:16:25 2022] PUT /identity/v3/projects/36a2de6962714324aa6489b26cbbae5d/users/f91d316475c1461dadce642aeb1b76f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:26.016419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:26.017110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:26.018305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:26.066635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368068-29b6-49f6-8c86-8431a73b1047 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:26.080413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] MFA Rules not processed for user `f91d316475c1461dadce642aeb1b76f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:26.081764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:26.220645 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2946/5857] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:26.226660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:26.253173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:26.255378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:26.289649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:26.291208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:26.291703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:26.292175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:26.296387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:26.304074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:26.347233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:26.350021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200fae-b395-432d-ad0a-9679b1a026a0 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:26.367540 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2912/5858] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:26.434716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edfad0-5da8-4606-8e61-e5969d9dea6d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:26.439790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:26.440410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:26.440688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:26.441192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:26.455837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:26.457567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:26.472606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2947/5859] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:28.820840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617061-8ff2-4afe-b500-3e9cc211cf48 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:28.821594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617061-8ff2-4afe-b500-3e9cc211cf48 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:28.821900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617061-8ff2-4afe-b500-3e9cc211cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:28.955383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fa617061-8ff2-4afe-b500-3e9cc211cf48 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:28.956652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fa617061-8ff2-4afe-b500-3e9cc211cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:29.102964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2913/5860] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:29.186039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:29.188737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:29.378848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d718fe-da1b-45bc-9884-5ae6e1f1969d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:29.396126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:29.396770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:29.397095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:29.397371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:29.418905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:29.432537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fe905-d35f-48e9-9b67-8d5695c4cb40 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:29.453532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2948/5861] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:29.494013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb37-4840-43df-92fc-ec390db0db88 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:29.497452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb37-4840-43df-92fc-ec390db0db88 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:29.497930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb37-4840-43df-92fc-ec390db0db88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:29.583707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-dbd0fb37-4840-43df-92fc-ec390db0db88 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:29.584983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dbd0fb37-4840-43df-92fc-ec390db0db88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:29.755174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2914/5862] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:30.939121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082163d-c7fa-42fd-b379-831d63c5759a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:30.939709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082163d-c7fa-42fd-b379-831d63c5759a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:30.939709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082163d-c7fa-42fd-b379-831d63c5759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:30.994809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e082163d-c7fa-42fd-b379-831d63c5759a None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:31.005041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e082163d-c7fa-42fd-b379-831d63c5759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:31.034882 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2949/5863] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:37.494543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:37.495108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:37.495335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:37.539558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] MFA Rules not processed for user `90e6b24b39a3428882a1dee1bc3281bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:37.540819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:37.668405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:37.700400 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2915/5864] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:37.702818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:37.703838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:37.704382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:37.739651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] MFA Rules not processed for user `90e6b24b39a3428882a1dee1bc3281bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:37.744038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:37.767150 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2950/5865] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:37.791097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:37.832677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc03ce-4d3d-4aa5-aeab-b89d6a08f053 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:37.856319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:37.857847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:37.859872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:37.860348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:37.906063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:37.915624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748a5e-7955-4293-bbe6-8c8301f93eab service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:37.993592 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2916/5866] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:16:39.790353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:39.794916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:40.170786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b23e2-0656-4258-ab08-f9806f4d2dcc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:40.190760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:40.192694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:40.201259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:40.201619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:40.209408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:40.258245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:40.259943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a53d-d2b9-463c-a837-17b3e7842b41 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:40.302748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2951/5867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:47.948578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:50.277488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:55.486787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:55.489087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:55.490416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:55.517360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] MFA Rules not processed for user `2c1df28a9d734105b8c99def44cbebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:55.519042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:55.553474 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2917/5868] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:05.519021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:07.566668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2335b-c47a-411e-9065-c72489d34d6a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:07.567361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2335b-c47a-411e-9065-c72489d34d6a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:07.568079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2335b-c47a-411e-9065-c72489d34d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:07.666644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c2b2335b-c47a-411e-9065-c72489d34d6a None None] MFA Rules not processed for user `b34b183f2b0b4a4597fb2e3b6495268a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:07.668486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c2b2335b-c47a-411e-9065-c72489d34d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:07.804330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2952/5869] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:11.181824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:11.183825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:11.216448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ffb29-8e67-41e2-8bb3-a5b9f03ec4d6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:11.224493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:11.225821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:11.226594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:11.229273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:11.233307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:11.274538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:11.279613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:11.321617 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2918/5870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:16.311346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:16.311980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:16.311980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:16.351021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:16.353744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:16.362590 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2953/5871] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:17:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:16.384152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:16.398444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482f548-fb28-4085-bc0b-32d15c7e3085 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:16.412978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:16.413749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:16.414059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:16.414417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:16.440489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:16.443306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4b251-b4ed-4ff7-acef-00826ff93381 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:16.463931 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2919/5872] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:17:16.663613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:16.853880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fb70-d64e-4574-9c6f-285185ec8b62 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:16.862222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:16.863099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:16.863674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:16.864609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] PATH_INFO: `/v3/users/f91d316475c1461dadce642aeb1b76f6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:16.868118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91d316475c1461dadce642aeb1b76f6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:16.873844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:16.991548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91d316475c1461dadce642aeb1b76f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:16.992266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91d316475c1461dadce642aeb1b76f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:17.005777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91d316475c1461dadce642aeb1b76f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:17.026147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91d316475c1461dadce642aeb1b76f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:17.027833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91d316475c1461dadce642aeb1b76f6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:17.060171 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2954/5873] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:16 2022] DELETE /identity/v3/users/f91d316475c1461dadce642aeb1b76f6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:17.061379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acd57-dea8-4a4b-82c9-1a96d227e323 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:17.061664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acd57-dea8-4a4b-82c9-1a96d227e323 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:17.061943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acd57-dea8-4a4b-82c9-1a96d227e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:17.102341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b11acd57-dea8-4a4b-82c9-1a96d227e323 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:17.103659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b11acd57-dea8-4a4b-82c9-1a96d227e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:17.342987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2920/5874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:17.388022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:17.390267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:17.436861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:17.557134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3a1a-fea4-4257-8aa1-795752927386 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:17.569375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:17.570320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:17.570814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:17.571302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:17.609433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:17.611022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:17.631829 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2955/5875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:17.760076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:17.760647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:17.760783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:17.795072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:17.796465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:17.930487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2921/5876] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:17.946429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:17.947880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:18.098017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9b8f-2204-40aa-b6f0-5c715a2a42c4 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:18.110908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:18.112050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:18.112050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:18.112050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:18.135284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:18.136890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b02b7-dde8-4563-9919-159417467ff8 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:18.153838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2956/5877] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:17:18.428370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:18.429825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:18.463952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e3561-f37e-4ad3-97c0-42ef294d943f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:18.474614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:18.475732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:18.477409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:18.478325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] PATH_INFO: `/v3/projects/36a2de6962714324aa6489b26cbbae5d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:18.480023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a2de6962714324aa6489b26cbbae5d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:18.485583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:18.603584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a2de6962714324aa6489b26cbbae5d', 'request_id': 'req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:18.614287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a2de6962714324aa6489b26cbbae5d', 'request_id': 'req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:18.627334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a2de6962714324aa6489b26cbbae5d', 'request_id': 'req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:18.664107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] The token cache is being invalidate because project 36a2de6962714324aa6489b26cbbae5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:18.670885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:18.674117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3bbcf4c1-e9b3-4bf3-8093-cdddc6075bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:18.681762 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2922/5878] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:18 2022] DELETE /identity/v3/projects/36a2de6962714324aa6489b26cbbae5d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:18.687226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:18.687738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:18.687738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:18.743710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:18.753747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:18.964820 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2957/5879] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:18.971153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:18.972087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:18.972968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:18.994493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:19.035058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:19.036959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:19.054323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2923/5880] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:19.057875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.072380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0ec0-2b95-4164-8310-a1f122b17db0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.085682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.087098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.087731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.088286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.089196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:19.089667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.092438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.122613 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2958/5881] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:19.126903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.178898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a427-e8d3-43af-addf-efdac2c5619e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.238243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.243294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.247627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.250481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.251284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.259925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.342543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2924/5882] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:19 2022] POST /identity/v3/projects => generated 391 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:19.346377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.358357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286974-523f-48d6-9755-a67fd0f9d6de admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.458868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:19.544886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.547380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.547665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.547940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.548622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.551204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.608617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.609721 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2959/5883] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:19 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:19.623045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436edb-aaad-4f03-9c95-8dfc4001d12e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.639407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.640043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.640320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.640595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.641275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.642880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.666708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.667801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2925/5884] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:19.681057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd912ca-3c96-4cab-bc3f-9dbb47205f48 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.693223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.693864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.694129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.694336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.694932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.696565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21e75-137c-4e50-9225-8aee1d297b13 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.730112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:19.730553 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2960/5885] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:19.742779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588a5b-f85c-4e84-be57-b917b7794f8a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:19.759739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:19.760429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.760706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.761052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] PATH_INFO: `/v3/projects/071b70574a2b44f48a4d9626b6dfefc2/users/d7c8bfbbcbaf4ebe948df760514b8689/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.789276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071b70574a2b44f48a4d9626b6dfefc2, user_id=d7c8bfbbcbaf4ebe948df760514b8689, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:19.791928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:19.837579 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2926/5886] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:19 2022] PUT /identity/v3/projects/071b70574a2b44f48a4d9626b6dfefc2/users/d7c8bfbbcbaf4ebe948df760514b8689/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:19.937831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:19.938114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:19.938392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:19.991398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] MFA Rules not processed for user `d7c8bfbbcbaf4ebe948df760514b8689`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:19.992581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:20.214009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2961/5887] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:20.216249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:20.458252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f1528-957e-45ff-8209-c5347cccc148 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:20.480189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:20.481485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:20.481739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:20.482015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:20.482663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:20.484589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:20.535265 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2927/5888] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:20 2022] POST /identity/v3/projects => generated 393 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:20.536463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:20.552898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbe8d-d741-4d6f-9d14-ad56480f9941 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:20.690414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:20.691040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:20.691317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:20.691739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:20.696299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:20.701572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:20.760493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:20.761020 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2962/5889] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:20 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:20.783520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7f19-cd27-4cf1-9e89-ad41502ebbbe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:20.798141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:20.800181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:20.801047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:20.801846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:20.804810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:20.811996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:20.891226 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2928/5890] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:20.895476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:20.912304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2ad9-4304-4279-97da-900e2b62fe32 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:20.926696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:20.927384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:20.927658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:20.927928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] PATH_INFO: `/v3/projects/0ebea2c88302407d91fca677d5f07704/users/9301f2cbdedf4c1a920059a0e7207507/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:20.965017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebea2c88302407d91fca677d5f07704, user_id=9301f2cbdedf4c1a920059a0e7207507, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:20.968999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:21.016185 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2963/5891] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:20 2022] PUT /identity/v3/projects/0ebea2c88302407d91fca677d5f07704/users/9301f2cbdedf4c1a920059a0e7207507/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:21.020374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:21.042393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dd0c5-829c-47db-b8e7-c7bc4af2e42a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:21.244881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:21.245539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:21.245792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:21.246052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:21.246728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:21.253261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130af6d-29e5-4024-9430-fde18fcb17ef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:21.287636 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2929/5892] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:21.289147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:21.307845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e1ce-ee87-4a3b-bc2a-af865a0cd7ed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:21.364374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:21.365482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:21.366498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:21.367972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] PATH_INFO: `/v3/projects/0ebea2c88302407d91fca677d5f07704/users/9301f2cbdedf4c1a920059a0e7207507/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:21.384679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebea2c88302407d91fca677d5f07704, user_id=9301f2cbdedf4c1a920059a0e7207507, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:21.390752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:21.421025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:21.441409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2964/5893] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:21 2022] PUT /identity/v3/projects/0ebea2c88302407d91fca677d5f07704/users/9301f2cbdedf4c1a920059a0e7207507/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:21.587533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e035c7-ab70-4424-a1a0-1f5ef55b30a5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:21.587533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e035c7-ab70-4424-a1a0-1f5ef55b30a5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:21.587533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e035c7-ab70-4424-a1a0-1f5ef55b30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:21.633013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:21.644783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1e035c7-ab70-4424-a1a0-1f5ef55b30a5 None None] MFA Rules not processed for user `9301f2cbdedf4c1a920059a0e7207507`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:21.648315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1e035c7-ab70-4424-a1a0-1f5ef55b30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:21.783157 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2930/5894] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:21.789747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:21.793245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:21.987219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9d65c-440d-4980-81b9-6e7c272b4526 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:22.003271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:22.004233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:22.004979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:22.005393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:22.026032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:22.032181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:22.061747 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2965/5895] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:22.146735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:22.147188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:22.147464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:22.153823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:22.156519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:22.187474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e46c-dac3-433e-a483-3fc3ecdd9d1f service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:22.196320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:22.210408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:22.213639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:22.214503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:22.217612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:22.219567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:22.387304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:22.390214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:22.392564 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2931/5896] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:22.399972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:22.401473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:22.417402 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2966/5897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:17:22.556576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e699c-50a3-4086-be23-552fca0697b3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:22.575330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:22.576094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:22.576381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:22.576650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:22.594430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:22.602964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:22.623849 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2932/5898] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:17:24.737897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:24.739905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:24.911335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097ce3-23a5-4173-a180-9ced74fd7779 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:24.929736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:24.937773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:24.938300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:24.938748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] PATH_INFO: `/v3/users/90e6b24b39a3428882a1dee1bc3281bc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:24.940233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e6b24b39a3428882a1dee1bc3281bc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:24.942402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:25.062114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:25.086274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e6b24b39a3428882a1dee1bc3281bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:25.087065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e6b24b39a3428882a1dee1bc3281bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:25.099287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e6b24b39a3428882a1dee1bc3281bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:25.123708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e6b24b39a3428882a1dee1bc3281bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:25.124556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e6b24b39a3428882a1dee1bc3281bc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:25.180959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2967/5899] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:24 2022] DELETE /identity/v3/users/90e6b24b39a3428882a1dee1bc3281bc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:25.511708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:25.515093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:25.556554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5f02-a68f-418a-ae5f-2811ecfa3459 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:25.592366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:25.603168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:25.797222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:25.944387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:25.946028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:25.946325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:25.946598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] PATH_INFO: `/v3/users/a0c3eaac6b4f4b2685de2d234573e33a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:25.951709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c3eaac6b4f4b2685de2d234573e33a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:25.968383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.006216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634297d7-b71d-47c1-9077-cbbc0c61e308 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.029883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.033089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.035542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.037170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] PATH_INFO: `/v3/projects/3ce2931e024a42219d4ed709e828b03d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.040132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce2931e024a42219d4ed709e828b03d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.052873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.134773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c3eaac6b4f4b2685de2d234573e33a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.139010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c3eaac6b4f4b2685de2d234573e33a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.139727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c3eaac6b4f4b2685de2d234573e33a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.159706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c3eaac6b4f4b2685de2d234573e33a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.188773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0eceb346-ec0f-4422-8c07-bc72708836e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c3eaac6b4f4b2685de2d234573e33a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.248866 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2933/5900] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:25 2022] DELETE /identity/v3/users/a0c3eaac6b4f4b2685de2d234573e33a => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:26.298288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce2931e024a42219d4ed709e828b03d', 'request_id': 'req-718c7c15-187b-46c1-8d91-1f29e06a840e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.312724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce2931e024a42219d4ed709e828b03d', 'request_id': 'req-718c7c15-187b-46c1-8d91-1f29e06a840e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.338372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce2931e024a42219d4ed709e828b03d', 'request_id': 'req-718c7c15-187b-46c1-8d91-1f29e06a840e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.386131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] The token cache is being invalidate because project 3ce2931e024a42219d4ed709e828b03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:26.388187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.392791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-718c7c15-187b-46c1-8d91-1f29e06a840e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.395746 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2968/5901] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:25 2022] DELETE /identity/v3/projects/3ce2931e024a42219d4ed709e828b03d => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:26.404252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.404252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.404252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.443428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:26.444664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:26.632604 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2934/5902] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:26.641335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.641617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.641912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.678070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:26.679261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:26.708435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.714387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2969/5903] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:26.723814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c0b0-37ec-42ac-8dfb-60d7e6ce5ba2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.742755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.743383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.743668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.744694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.745420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:26.745726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.747399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.775168 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2935/5904] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:26.780202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.799584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63923f-87eb-41fd-9db1-55e996cda53d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.811860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.812509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.812795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.813114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.814144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.816385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.881583 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2970/5905] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:17:26.886460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.900713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745662b-c352-4d36-8ed0-df1b6c87d5d0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.112239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.120017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:27.138925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:27.260523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:27.266183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.270349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.271188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.271678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.274335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.278252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.371983 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2936/5906] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/users => generated 297 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:27.374122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.428833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584dae-a7ce-43c2-be6e-00ba465ed48e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.440440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02def-74e3-4ee5-be99-da70293df7cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.458452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.459105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.459419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.459640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.460430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.462177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.477674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.478496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.478786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.479064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] PATH_INFO: `/v3/projects/72af6d56f0b5448fb4b98075f4d6be0b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.481913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72af6d56f0b5448fb4b98075f4d6be0b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.487040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.528710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2937/5907] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:27.532518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.579291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e314b6-3712-4c12-989a-c36a455f07c9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.609689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.610768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.611059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.611335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.623583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.627901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.672982 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2938/5908] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:27.677185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.707385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72af6d56f0b5448fb4b98075f4d6be0b', 'request_id': 'req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:27.712622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eabc84-03c1-44d1-9e62-de2faa42c531 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.727714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72af6d56f0b5448fb4b98075f4d6be0b', 'request_id': 'req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:27.750469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72af6d56f0b5448fb4b98075f4d6be0b', 'request_id': 'req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:27.811766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] The token cache is being invalidate because project 72af6d56f0b5448fb4b98075f4d6be0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:27.812061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:27.813216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56624d7c-bc7b-4d8c-a05b-da829a8e9e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:27.818957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2971/5909] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:27 2022] DELETE /identity/v3/projects/72af6d56f0b5448fb4b98075f4d6be0b => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:27.823597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245963e9-b4c7-4ee9-b163-3dcb7f0a94a0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.823874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245963e9-b4c7-4ee9-b163-3dcb7f0a94a0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.824155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245963e9-b4c7-4ee9-b163-3dcb7f0a94a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.877710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-245963e9-b4c7-4ee9-b163-3dcb7f0a94a0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:27.881354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-245963e9-b4c7-4ee9-b163-3dcb7f0a94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:27.926773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.927584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.928084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.929262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] PATH_INFO: `/v3/projects/946b5c4d8cbf4ab5b94f15c2704d5ce3/users/85f5e98a834f490fa846a847306085e4/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.988284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=946b5c4d8cbf4ab5b94f15c2704d5ce3, user_id=85f5e98a834f490fa846a847306085e4, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.994653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b01eb-e8ff-4284-bc0f-ddba38e4ccc4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:28.024988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2939/5910] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:27 2022] PUT /identity/v3/projects/946b5c4d8cbf4ab5b94f15c2704d5ce3/users/85f5e98a834f490fa846a847306085e4/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:28.030433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.030972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.031342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.093700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:28.108365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:28.111910 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2972/5911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:28.120022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.121120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.122204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.172660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:28.176410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:28.323494 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2940/5912] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:28.332619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:28.334139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:28.362250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:28.424278 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2973/5913] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:28.426051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:28.434981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:28.457655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fe826-109f-4ed0-925c-68f6ad47dc50 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:28.483910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:28.484497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.485234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.485487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.488143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:28.488339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:28.492285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:28.536547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba13d-fad9-49f7-9482-c900638e3eb6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:28.540596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:28.541414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.541702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.541986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.557141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2974/5914] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:28.557813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:28.570925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:28.572402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:28.592707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2941/5915] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:28.600095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aefd0-ebea-4d0b-95dc-8d140d3e6874 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:28.614591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:28.614953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.615229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.615499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.616944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:28.618976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:28.677749 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2975/5916] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:28 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:28.683761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:28.707494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54d501-179f-40fe-8710-8455ee15503b service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:28.882479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:28.883159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:28.883441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:28.883710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:28.889731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:28.894647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:28.961251 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2942/5917] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:28 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:28.963996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:28.978929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4d6e-b5fa-4882-ab55-2a39a3f7d7e9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:28.999310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:29.007277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:29.008222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:29.008508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:29.009458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:29.014237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:29.043727 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2976/5918] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:29.049944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:29.066136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686133ec-c7f1-4b8a-9869-512ce4eb015c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:29.076684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:29.077631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:29.078056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:29.078470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:29.079256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:29.081053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4c34f-488e-4897-aa3c-de1e00a26985 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:29.108344 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2943/5919] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:29.112697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:29.130579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22b685-a3c5-4477-bca8-925fb2506d24 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:29.139200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:29.140097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:29.140553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:29.141178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] PATH_INFO: `/v3/projects/beae52af385c4bc38ffeeb2d4d47cb8b/users/868b164cde3d4596b559fe9d5fa6a1a9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:29.187860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=beae52af385c4bc38ffeeb2d4d47cb8b, user_id=868b164cde3d4596b559fe9d5fa6a1a9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:29.191463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:29.232758 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2977/5920] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:29 2022] PUT /identity/v3/projects/beae52af385c4bc38ffeeb2d4d47cb8b/users/868b164cde3d4596b559fe9d5fa6a1a9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:29.238918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:29.239209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:29.239485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:29.326841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] MFA Rules not processed for user `868b164cde3d4596b559fe9d5fa6a1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:29.328178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:29.570571 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2944/5921] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:29.578742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:29.580470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:29.758854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083db93-41d8-43b1-a146-b27ed5d406ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:29.794385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:29.795030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:29.795314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:29.795589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:29.835387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:29.836965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7053614-5109-4259-890b-f0bfd58c3765 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:29.891178 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2978/5922] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:17:35.721004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:35.723029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:35.821816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:35.903487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5dcd-4c42-4685-aeb4-31de348151e7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:35.917600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:35.918521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:35.918609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:35.918836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] PATH_INFO: `/v3/users/d7c8bfbbcbaf4ebe948df760514b8689` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:35.923372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c8bfbbcbaf4ebe948df760514b8689)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:35.932194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:36.090168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c8bfbbcbaf4ebe948df760514b8689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:36.090777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c8bfbbcbaf4ebe948df760514b8689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:36.091411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c8bfbbcbaf4ebe948df760514b8689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:36.108087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c8bfbbcbaf4ebe948df760514b8689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:36.130049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c8bfbbcbaf4ebe948df760514b8689'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:36.200791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2945/5923] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:35 2022] DELETE /identity/v3/users/d7c8bfbbcbaf4ebe948df760514b8689 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:36.205735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:36.206196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:36.206433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:36.270291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:36.273354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:36.443603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2979/5924] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:36.483420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:36.485040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:36.654502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449e4e-7fa2-4f29-a287-64945f983144 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:36.673476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:36.674107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:36.674385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:36.677090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:36.712551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:36.722669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:36.769327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2946/5925] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:38.913361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:38.915525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:38.941102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa765302-18a6-465d-9839-2c417cb082ea None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:38.967108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:38.969838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:38.970621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:38.971817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] PATH_INFO: `/v3/projects/071b70574a2b44f48a4d9626b6dfefc2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:38.980375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071b70574a2b44f48a4d9626b6dfefc2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:38.989330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:39.148436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:39.213939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071b70574a2b44f48a4d9626b6dfefc2', 'request_id': 'req-a5f6048f-2828-4554-b0f8-a517b6801803'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.226994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071b70574a2b44f48a4d9626b6dfefc2', 'request_id': 'req-a5f6048f-2828-4554-b0f8-a517b6801803'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.248002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071b70574a2b44f48a4d9626b6dfefc2', 'request_id': 'req-a5f6048f-2828-4554-b0f8-a517b6801803'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.267320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] The token cache is being invalidate because project 071b70574a2b44f48a4d9626b6dfefc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:39.267968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.270796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.278517 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2980/5926] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:38 2022] DELETE /identity/v3/projects/071b70574a2b44f48a4d9626b6dfefc2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:39.282901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:39.310416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af89c1-f4cf-46f2-a324-496e8af938c9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:39.482192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:39.483049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:39.485240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:39.486019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] PATH_INFO: `/v3/users/9301f2cbdedf4c1a920059a0e7207507` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:39.491788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9301f2cbdedf4c1a920059a0e7207507)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:39.494031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:39.497393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:39.610984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9301f2cbdedf4c1a920059a0e7207507'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.614608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9301f2cbdedf4c1a920059a0e7207507'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.615395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9301f2cbdedf4c1a920059a0e7207507'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.635065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9301f2cbdedf4c1a920059a0e7207507'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.649675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-043207f3-86a7-4c87-9d46-607eeb3443b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9301f2cbdedf4c1a920059a0e7207507'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:39.702724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2947/5927] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:39 2022] DELETE /identity/v3/users/9301f2cbdedf4c1a920059a0e7207507 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:40.160582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:40.163190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:40.190350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6048f-2828-4554-b0f8-a517b6801803 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:40.335968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:40.335968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:40.337390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:40.337390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] PATH_INFO: `/v3/users/868b164cde3d4596b559fe9d5fa6a1a9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:40.342694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868b164cde3d4596b559fe9d5fa6a1a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:40.344660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:40.497285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868b164cde3d4596b559fe9d5fa6a1a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:40.497285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868b164cde3d4596b559fe9d5fa6a1a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:40.510067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868b164cde3d4596b559fe9d5fa6a1a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:40.534986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868b164cde3d4596b559fe9d5fa6a1a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:40.535755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868b164cde3d4596b559fe9d5fa6a1a9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:40.580218 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2981/5928] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:40 2022] DELETE /identity/v3/users/868b164cde3d4596b559fe9d5fa6a1a9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:40.589158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:40.589731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:40.590035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:40.674814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:40.681782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:40.734785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:40.736721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:40.875463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:40.990749 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2948/5929] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:41.017411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ac12-ff6c-4e44-bb49-8d1c525514f6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:41.024585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:41.026928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:41.026928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:41.026928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:41.029275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:41.053714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:41.056193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:41.074155 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2982/5930] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:41.094191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:41.095847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:41.261618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253b86-f9df-4565-9c9f-e0f7cd2d6169 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:41.266058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:41.268582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:41.268871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:41.269198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:41.283371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:41.286045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:41.300496 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2949/5931] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:42.140804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:42.143504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:42.187659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c9cdd-65c0-47d2-9c1a-26214f8525a4 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:42.212279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:42.213779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:42.215894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:42.219560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] PATH_INFO: `/v3/projects/0ebea2c88302407d91fca677d5f07704` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:42.226364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebea2c88302407d91fca677d5f07704)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:42.228941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:42.394475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:42.397139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:42.419024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815160aa-b7aa-4736-a4d7-cc5c023b7cb8 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:42.434329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:42.434986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:42.435257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:42.435580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] PATH_INFO: `/v3/projects/beae52af385c4bc38ffeeb2d4d47cb8b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:42.440867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beae52af385c4bc38ffeeb2d4d47cb8b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:42.442823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:42.482458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebea2c88302407d91fca677d5f07704', 'request_id': 'req-96fc20ea-a676-4e01-854b-1718db0e8f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.500936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebea2c88302407d91fca677d5f07704', 'request_id': 'req-96fc20ea-a676-4e01-854b-1718db0e8f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.512688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:42.518032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebea2c88302407d91fca677d5f07704', 'request_id': 'req-96fc20ea-a676-4e01-854b-1718db0e8f7d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.556020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] The token cache is being invalidate because project 0ebea2c88302407d91fca677d5f07704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:42.556855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.557676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-96fc20ea-a676-4e01-854b-1718db0e8f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.563229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2983/5932] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:42 2022] DELETE /identity/v3/projects/0ebea2c88302407d91fca677d5f07704 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:42.566677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069350-6a5e-4e16-9c49-ddf31a605af4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:42.566958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069350-6a5e-4e16-9c49-ddf31a605af4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:42.567228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069350-6a5e-4e16-9c49-ddf31a605af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:42.645472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e069350-6a5e-4e16-9c49-ddf31a605af4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:42.646828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e069350-6a5e-4e16-9c49-ddf31a605af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:42.653373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beae52af385c4bc38ffeeb2d4d47cb8b', 'request_id': 'req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.662144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beae52af385c4bc38ffeeb2d4d47cb8b', 'request_id': 'req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.682528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beae52af385c4bc38ffeeb2d4d47cb8b', 'request_id': 'req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.709715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] The token cache is being invalidate because project beae52af385c4bc38ffeeb2d4d47cb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:42.713638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.715543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-43cfc9a8-dcdb-468c-a5bc-7c14dc543fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:42.730174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2950/5933] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:42 2022] DELETE /identity/v3/projects/beae52af385c4bc38ffeeb2d4d47cb8b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:42.737391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6aa02-c250-4263-a55f-2dc1ef445e90 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:42.737676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6aa02-c250-4263-a55f-2dc1ef445e90 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:42.737956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6aa02-c250-4263-a55f-2dc1ef445e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:42.803526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-86f6aa02-c250-4263-a55f-2dc1ef445e90 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:42.814663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-86f6aa02-c250-4263-a55f-2dc1ef445e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:42.867252 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2984/5934] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:42.873014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:42.875046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:42.877069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:42.945336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:42.947300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:42.971417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2985/5935] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:42.971417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.029017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e504574-ff15-4232-b47a-37b3a0afdcd3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.029017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.029017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.029017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.029621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.029621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:43.029621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.029621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.093674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2986/5936] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:43.107418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.124849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1837d-109c-45e0-86ff-59aa5a6927a9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.131504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.132382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.132759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.133154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.133978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.136319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.139190 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2951/5937] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:43.147428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.151808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.154227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.206331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:43.226374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:43.237769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:43.247875 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2987/5938] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:17:43.251780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.492800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20149-2d84-452c-94bc-2e4237a86f43 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.520792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.523937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.524703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.525295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.527575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.537330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.544690 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2952/5939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:43.549993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.570690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ad950-7c1d-4b67-83bb-c2f96170d95d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.597741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.599335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2988/5940] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:43.604404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.616129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.617921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.618362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.624541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:43.625735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.627928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.643642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35deb-2b93-436b-8278-2761e600f5b3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.659444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.662072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.664845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.666019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.667494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.673392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.687241 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2953/5941] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:43.693548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.698787 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2989/5942] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:43.706533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.727072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaacbc-d12e-46ee-9116-8ef1e584216b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.736598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc759-602f-4cdb-abf5-f9397b4be381 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.746313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.751552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.752439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.754256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.754386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.754763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.755536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.756177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.757078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.760190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.761260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.764254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.794977 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2990/5943] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:43.796045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.830449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466943-bac5-488f-829f-f284ff6e4456 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:43.841012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2954/5944] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:43.845461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:43.851667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:43.854923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.855979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.856846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] PATH_INFO: `/v3/projects/215f8a28f2c24d078d51d5408ac33c9d/users/b06a81c208044e76accd5d4f528940a7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:43.877779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:43.897697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215f8a28f2c24d078d51d5408ac33c9d, user_id=b06a81c208044e76accd5d4f528940a7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:43.905728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dfbd8-5458-407f-970c-bd3cc62a1448 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:43.946226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2991/5945] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:43 2022] PUT /identity/v3/projects/215f8a28f2c24d078d51d5408ac33c9d/users/b06a81c208044e76accd5d4f528940a7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:43.952418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:43.952701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:43.952982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.044417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] MFA Rules not processed for user `b06a81c208044e76accd5d4f528940a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:44.055250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:44.073671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14165f8c-40fe-48ee-9b8f-8e25ae6070c9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.294629 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2992/5946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:44.297270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.313861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.314933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.315316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.315695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.316597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.323505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.376528 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2955/5947] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:43 2022] POST /identity/v3/users => generated 292 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:44.377882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.384272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:44.400099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333815-5a36-4d3e-af21-ea56f242c311 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.415574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.416370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.416744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.417139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.418095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.419825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.451866 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2956/5948] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:44.453214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.467614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408bfc3-f250-4d00-8df5-e13cee3b82da None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.471829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e40be7-21bc-49ad-878c-a3338214863d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.483330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.483970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.484922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.485219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.485908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.486316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.486959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.487242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.487518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.487996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.488160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.495839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.540295 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2957/5949] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:44.541308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.569859 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2993/5950] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:44 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:44.573024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.576427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e04c-e003-4eb3-a64f-eeaac5071326 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.722804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.723511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.723777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.724307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] PATH_INFO: `/v3/projects/e901c15dac8e49e5b0e0ead18d6cd6b5/users/839e2104bc0d4b1fb55d69966eedd998/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.764523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e901c15dac8e49e5b0e0ead18d6cd6b5, user_id=839e2104bc0d4b1fb55d69966eedd998, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.767425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b1ae1-5c82-4684-930e-0a7fd582e1e1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.790307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bcc42-45c9-4a2b-9e8d-1f4dc3750657 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.806201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:44.806847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.807329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.811074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.811074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:44.811074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:44.833878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2958/5951] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:44 2022] PUT /identity/v3/projects/e901c15dac8e49e5b0e0ead18d6cd6b5/users/839e2104bc0d4b1fb55d69966eedd998/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:44.835642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:44.835953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:44.836203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:44.866852 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2994/5952] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:44 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:44.869749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:44.891649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2d67-1e67-43e1-b56f-b027696eb50b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:44.918800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:44.922224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:44.932347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:45.113275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:45.115460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.117678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.119944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.120959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2959/5953] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:45.125136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:45.127122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:45.144390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:45.147784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:45.164094 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2995/5954] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:45.168262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:45.189964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94e760-8c3f-4abb-b995-20c654496c82 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:45.200547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:45.201928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.202428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.202910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] PATH_INFO: `/v3/projects/543111bf01324e1cbdb05d7388108e99/users/e5a36abc6177409d94e5e2394a3c95cd/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.242067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=543111bf01324e1cbdb05d7388108e99, user_id=e5a36abc6177409d94e5e2394a3c95cd, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:45.249845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:45.299592 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2996/5955] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:45 2022] PUT /identity/v3/projects/543111bf01324e1cbdb05d7388108e99/users/e5a36abc6177409d94e5e2394a3c95cd/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:17:45.303413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:45.347986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ee86-1764-4827-b7a0-843287dfce91 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:45.386864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:45.526312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c7f4-c646-4507-8a3a-73a7c06b71ea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:45.539945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:45.540597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.540869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.541178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.541842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:45.544162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:45.579457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:45.580059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.598831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.601364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.601641 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2997/5956] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:45.606919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:45.639313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:45.647141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2cdfc-fda2-41c4-898f-b346fe0b43dd service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:45.652471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e2d7-6f0f-440d-ab81-95d442c26d4a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:45.671714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2960/5957] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:45.682290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:45.682988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.683827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.684102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] PATH_INFO: `/v3/projects/543111bf01324e1cbdb05d7388108e99/users/e5a36abc6177409d94e5e2394a3c95cd/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.693712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543111bf01324e1cbdb05d7388108e99, user_id=e5a36abc6177409d94e5e2394a3c95cd, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:45.708356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:45.747134 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2998/5958] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:45 2022] PUT /identity/v3/projects/543111bf01324e1cbdb05d7388108e99/users/e5a36abc6177409d94e5e2394a3c95cd/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:45.758061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac43f-6dc3-4368-9819-444563c82a25 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:45.759550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac43f-6dc3-4368-9819-444563c82a25 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:45.759884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac43f-6dc3-4368-9819-444563c82a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:45.847193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-308ac43f-6dc3-4368-9819-444563c82a25 None None] MFA Rules not processed for user `e5a36abc6177409d94e5e2394a3c95cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:45.850912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-308ac43f-6dc3-4368-9819-444563c82a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:46.047012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:46.131810 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2961/5959] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:46.153240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:46.155011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:46.343519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453fc7-848d-4a59-ac3b-f2afe6483333 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:46.361211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:46.361848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:46.362130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:46.362400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:46.508814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:46.510635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab54ba1-bec2-4298-bf9c-1763c13e22be service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:46.534902 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 2999/5960] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:48.925817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:48.926349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:48.926436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:49.056931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] MFA Rules not processed for user `85f5e98a834f490fa846a847306085e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:49.059682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:49.178076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2962/5961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:49.206572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4bc0-4619-4bda-8582-5eeb24aa05fc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:49.207105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4bc0-4619-4bda-8582-5eeb24aa05fc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:49.207105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4bc0-4619-4bda-8582-5eeb24aa05fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:49.228617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6f7e4bc0-4619-4bda-8582-5eeb24aa05fc None None] MFA Rules not processed for user `85f5e98a834f490fa846a847306085e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:49.229907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f7e4bc0-4619-4bda-8582-5eeb24aa05fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:49.260226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3000/5962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:49.268677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:49.270196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:49.380231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:49.380611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:49.380951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:49.445655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41873e-0a46-42e8-b420-416e3614eed7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:49.454516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:49.455239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:49.455401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:49.455667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:49.456989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] MFA Rules not processed for user `839e2104bc0d4b1fb55d69966eedd998`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:49.464560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:49.466264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:49.466803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:49.481260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2963/5963] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:17:49.541421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:49.623545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3001/5964] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:49.632930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:49.634690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:49.662068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970831b-5339-4603-bab3-c5a467cbbe2d service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:49.672024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:49.673063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:49.673414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:49.673911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:49.685070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:49.686905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:49.697959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2964/5965] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:50.544768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:50.546372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:50.673892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8342380-4934-4fcc-a1c6-d515f9a9e477 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:50.682686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:50.684043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:50.685019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:50.685623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:50.693007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:50.719017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:50.720749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:50.747744 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3002/5966] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:53.740689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:53.742637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:53.890798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74079-ac28-41d1-859d-4787c61eb294 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:53.894769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:53.895586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:53.896011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:53.896428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:53.898392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:53.920004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:53.921759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:53.929429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:53.941207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2965/5967] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:54.122453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:54.155976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b183b6-7e4a-41b9-912a-6b5df3c2c7c1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:54.181704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:54.185489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:54.185947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:54.186510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:54.197237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:54.235914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:54.237958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:54.265614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3003/5968] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:54.551449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:54.573065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc75b8-377c-4ced-ac0c-457b06d8bf2f service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:54.608129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:54.609059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:54.626178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:54.626793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:54.628974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:54.659532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:54.661332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:54.690373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2966/5969] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:54.737646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:54.740420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:54.769994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:54.772237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:54.963270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a8ce9-c3e0-4b1e-ba56-d261015b1b11 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:54.971046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4427-efc0-4488-b285-11982f5e5d23 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:54.977127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:54.977819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:54.978080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:54.978360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] PATH_INFO: `/v3/users/014bbbe30bae421c95f500eede3ac04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:54.981174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014bbbe30bae421c95f500eede3ac04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:54.983126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:54.986186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:54.987001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:54.987433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:54.987858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:54.994556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:55.026327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:55.031384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676fbf-c6fc-445c-a26d-16409517ee9e service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:55.073818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3004/5970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:55.107140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014bbbe30bae421c95f500eede3ac04c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:55.110037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014bbbe30bae421c95f500eede3ac04c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:55.112143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014bbbe30bae421c95f500eede3ac04c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:55.135021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014bbbe30bae421c95f500eede3ac04c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:55.146793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014bbbe30bae421c95f500eede3ac04c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:55.197323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2967/5971] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:54 2022] DELETE /identity/v3/users/014bbbe30bae421c95f500eede3ac04c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:55.199215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:55.199777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:55.199777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:55.227929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:55.229366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:55.360798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:55.416236 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3005/5972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:55.468105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:55.471932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:55.473866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:55.474889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:55.590705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691ab06-994e-4931-8316-d8fc737ea81a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:55.597577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:55.599614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:55.599969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:55.600329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:55.658996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:55.663779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:55.667423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0caca0-259e-4b78-94cc-407230d929b4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:55.673851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:55.681468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:55.682026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:55.682589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:55.685466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:55.709214 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3006/5973] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:17:55.726546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:55.807640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:55.810797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6225-28fd-40d9-bb4a-b55483e6b7d0 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:55.825943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2968/5974] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:56.009145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:56.010647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:56.040053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707ade-57bf-4a48-9d59-b179353a9fc5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:56.063062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:56.065028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.066616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.066945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] PATH_INFO: `/v3/projects/4c8085a331c845cb8b1e4901f8620fa5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.069235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8085a331c845cb8b1e4901f8620fa5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:56.071435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:56.162943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8085a331c845cb8b1e4901f8620fa5', 'request_id': 'req-388f6407-d8a4-409d-987d-ba9eafd53f81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:56.186320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8085a331c845cb8b1e4901f8620fa5', 'request_id': 'req-388f6407-d8a4-409d-987d-ba9eafd53f81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:56.208407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8085a331c845cb8b1e4901f8620fa5', 'request_id': 'req-388f6407-d8a4-409d-987d-ba9eafd53f81'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:56.229266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] The token cache is being invalidate because project 4c8085a331c845cb8b1e4901f8620fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:56.229695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:56.231089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-388f6407-d8a4-409d-987d-ba9eafd53f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:56.232949 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3007/5975] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:56 2022] DELETE /identity/v3/projects/4c8085a331c845cb8b1e4901f8620fa5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:56.238744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.239073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.239352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.277485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:56.279029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:56.506580 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2969/5976] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:56.515855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.516711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.517145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.594357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:56.596737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:56.632089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3008/5977] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:56.632973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:56.648403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49586f7-7f2d-4393-bf7b-1715fbf1d643 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:56.662151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:56.662978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.663137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.663411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.666568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:56.666938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:56.671561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:56.703034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2970/5978] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:17:56.704778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:56.719691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc106bd3-ff07-4eea-8c0f-d7294eda4f30 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:56.729119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:56.731908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.732429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.733191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.734868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:56.737455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:56.810446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3009/5979] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:56 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:56.814546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:56.833350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba416-f0cd-42f7-8146-ff29c696149e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:56.983702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:56.985856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:56.985856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:56.985856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:56.987658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:56.991977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43302baf-eeb3-42e4-bbd4-fdc112eb3d07 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.047952 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2971/5980] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:56 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:17:57.051870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:57.052740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.053125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.053463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.070628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142ce7-b182-4efc-9ca0-2bba18702bca admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:57.080199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:57.080769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:57.081571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.081855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.082125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.082777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:57.082899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:57.084513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.108329 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3010/5981] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:57.112300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:57.127277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa9e53-c981-4c94-88cc-faefdd987f9a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:57.128023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:57.135582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:57.136784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.137756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.138209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.140110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:57.141999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.157212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3011/5982] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:17:57.161344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:57.174861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b9954-b467-4da7-b92d-aeb6500205f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:57.181296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:57.182171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.182631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.183144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] PATH_INFO: `/v3/projects/1b6c13bc01d64a98a5fe51a9c4a220a4/users/2bb1d0b8cbb448d1b0a18c179759114e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.192488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2972/5983] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:17:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:57.209254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:57.210787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:57.219933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6c13bc01d64a98a5fe51a9c4a220a4, user_id=2bb1d0b8cbb448d1b0a18c179759114e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:57.223567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e61f5-3c64-46da-83a2-0fff73f06b95 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.246874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3012/5984] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:57 2022] PUT /identity/v3/projects/1b6c13bc01d64a98a5fe51a9c4a220a4/users/2bb1d0b8cbb448d1b0a18c179759114e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:17:57.257867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.258537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.259094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.272209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:57.302200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] MFA Rules not processed for user `2bb1d0b8cbb448d1b0a18c179759114e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:57.303947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:57.370511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4448ea-c1d9-4dc7-90f2-fe0c84460d08 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:57.391536 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3013/5985] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:17:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:57.403683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:57.405884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:57.563696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:57.564558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.564925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.565300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.571944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2151e-1bb0-442f-9d3a-e320a266f941 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:57.601335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:57.602063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:57.602409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:57.602752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:57.623280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:57.626116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb17661-b949-4cf6-a44c-9dc58c47854a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.662164 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3014/5986] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:57.733194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:57.737059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:57.757628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2973/5987] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:18:01.670021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:01.671475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:01.671898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:01.720714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:01.725383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:01.747043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3015/5988] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:01.760241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:01.782914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8ff54-7e45-476b-bb1b-b8813f11d752 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:01.815245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:01.818550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:01.818950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:01.819918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:01.853198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:01.859124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be449-9388-429a-ab8c-2550f6da918f service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:01.890441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2974/5989] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:18:11.695793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=59 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:11.880266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:17.918927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:17.920574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:18.305995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953fb11-e92c-4a39-9b01-9581471c0a97 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:18.329730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:18.331191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:18.333101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:18.335747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] PATH_INFO: `/v3/users/b06a81c208044e76accd5d4f528940a7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:18.339575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06a81c208044e76accd5d4f528940a7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:18.344315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:18.511813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06a81c208044e76accd5d4f528940a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:18.513686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06a81c208044e76accd5d4f528940a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:18.550407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06a81c208044e76accd5d4f528940a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:18.592256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06a81c208044e76accd5d4f528940a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:18.593164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06a81c208044e76accd5d4f528940a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:18.677206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3016/5990] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:18:17 2022] DELETE /identity/v3/users/b06a81c208044e76accd5d4f528940a7 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:18.687733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:18.694649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:18.695220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:18.835651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:18.835651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:19.109174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2975/5991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:19.205417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:19.207131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:19.384718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:19.461306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bd9e9-6c02-4a5c-9a7d-0e7ed6bfc904 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:19.470255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:19.471289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:19.471717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:19.472127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:19.508821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:19.512597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:19.560462 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3017/5992] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:20.398738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:20.404701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:20.422445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d2b2-baa5-4826-9930-2d9761116d1c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:20.427735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:20.428384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:20.428661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:20.429659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] PATH_INFO: `/v3/projects/215f8a28f2c24d078d51d5408ac33c9d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:20.430836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] RBAC: Authorizing `identity:delete_project(project_id=215f8a28f2c24d078d51d5408ac33c9d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:20.433281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:20.645937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215f8a28f2c24d078d51d5408ac33c9d', 'request_id': 'req-72735405-147a-49ad-8832-6200f2c5367f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:20.701751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215f8a28f2c24d078d51d5408ac33c9d', 'request_id': 'req-72735405-147a-49ad-8832-6200f2c5367f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:20.734739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215f8a28f2c24d078d51d5408ac33c9d', 'request_id': 'req-72735405-147a-49ad-8832-6200f2c5367f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:20.848698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] The token cache is being invalidate because project 215f8a28f2c24d078d51d5408ac33c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:18:20.849230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:20.854982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:20.876189 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2976/5993] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:18:20 2022] DELETE /identity/v3/projects/215f8a28f2c24d078d51d5408ac33c9d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:20.877550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:20.911791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabaaef-0936-4a24-93dc-da7986d7a5d6 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:21.185724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:21.191148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:21.191468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:21.193719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] PATH_INFO: `/v3/users/e5a36abc6177409d94e5e2394a3c95cd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:21.197954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a36abc6177409d94e5e2394a3c95cd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:21.208296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:21.338943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a36abc6177409d94e5e2394a3c95cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:21.340857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a36abc6177409d94e5e2394a3c95cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:21.357370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a36abc6177409d94e5e2394a3c95cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:21.374501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a36abc6177409d94e5e2394a3c95cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:21.377871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f4fcd922-7d52-4cbf-abee-27acd4a9262f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a36abc6177409d94e5e2394a3c95cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:21.455543 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3018/5994] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:18:20 2022] DELETE /identity/v3/users/e5a36abc6177409d94e5e2394a3c95cd => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:22.647863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:22.650293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:22.721152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735405-147a-49ad-8832-6200f2c5367f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:22.929544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:22.930376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:22.930659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:22.930929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] PATH_INFO: `/v3/projects/543111bf01324e1cbdb05d7388108e99` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:22.935610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=543111bf01324e1cbdb05d7388108e99)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:22.944436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:23.079837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:23.132047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543111bf01324e1cbdb05d7388108e99', 'request_id': 'req-9864df25-a969-4386-bbfc-c25c3d9945e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:23.149735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543111bf01324e1cbdb05d7388108e99', 'request_id': 'req-9864df25-a969-4386-bbfc-c25c3d9945e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:23.165404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543111bf01324e1cbdb05d7388108e99', 'request_id': 'req-9864df25-a969-4386-bbfc-c25c3d9945e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:23.219413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] The token cache is being invalidate because project 543111bf01324e1cbdb05d7388108e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:18:23.219783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:23.223777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9864df25-a969-4386-bbfc-c25c3d9945e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:23.237526 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2977/5995] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:18:22 2022] DELETE /identity/v3/projects/543111bf01324e1cbdb05d7388108e99 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:23.240360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:23.240806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:23.241035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:23.329447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:23.331027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:23.415371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:23.454450 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3019/5996] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:23.464324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:23.464611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:23.464888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:23.513571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:23.515996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:23.540308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2978/5997] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:23.544850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:23.579343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ba98-dd10-4442-a61d-7b90a43ec21f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:23.597279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:23.597972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:23.598251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:23.598520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:23.599185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:18:23.599483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:23.609313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:23.647024 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3020/5998] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:18:23.651897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:23.664218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b812c-b803-4044-9159-5c77c33eea9b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:23.686272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:23.687061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:23.687362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:23.687969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:23.688759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:23.690806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:23.790422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2979/5999] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:18:23 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:18:23.791940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:23.813494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ba31-1fdf-4bc3-83d7-e68fc7ca800e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:23.985082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:23.985566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:23.985966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:23.986227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:23.986870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:23.988824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:24.037591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3021/6000] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:18:23 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:18:24.043853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:24.066800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a0902-2a95-4476-b0ed-eebf028d7d21 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:24.079078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:24.079977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:24.080408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:24.081102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:24.081897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:24.083639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:24.115547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2980/6001] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:18:24.119623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:24.133096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090901fc-d17e-4402-89d2-287ce1e23031 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:24.149140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:24.150018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:24.150470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:24.150940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:24.151849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:24.153688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb38af-8648-4e78-a21a-2b34203f4b06 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:24.195610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:24.202272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3022/6002] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:18:24.217740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb4fa1-d3ec-4a8e-9ea0-aabe3e5d92d0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:24.229064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:24.230409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:24.230693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:24.230961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] PATH_INFO: `/v3/projects/410256baba634b36a15c933c1d8fda88/users/3466c2834c9f488aa00937cf0e2922aa/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:24.280162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410256baba634b36a15c933c1d8fda88, user_id=3466c2834c9f488aa00937cf0e2922aa, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:24.283301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:24.319435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653ea3-01e7-4176-a8e0-de4775484cac None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:24.320476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653ea3-01e7-4176-a8e0-de4775484cac None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:24.320980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653ea3-01e7-4176-a8e0-de4775484cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:24.324123 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2981/6003] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:18:24 2022] PUT /identity/v3/projects/410256baba634b36a15c933c1d8fda88/users/3466c2834c9f488aa00937cf0e2922aa/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:24.377310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad653ea3-01e7-4176-a8e0-de4775484cac None None] MFA Rules not processed for user `3466c2834c9f488aa00937cf0e2922aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:24.380402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad653ea3-01e7-4176-a8e0-de4775484cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:24.563143 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3023/6004] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:24.581934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:24.587607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:24.726757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f4be-e283-480e-8571-34df9578f5b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:24.735457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:24.736194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:24.736668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:24.737109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:24.762983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:24.767649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:24.780583 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2982/6005] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:29.271523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:29.272162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:29.272162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:29.328629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:29.333624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:29.432878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:29.479885 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3024/6006] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:29.504326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:29.505992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:29.622256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:29.668178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab336e-d303-4be2-8798-5a4f5c52f7ca service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:29.684757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:29.685743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:29.686632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:29.687130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:29.708190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:29.710005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:29.732631 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2983/6007] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:18:29.775498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:29.797983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557c64-0708-4872-84b4-7ad33073854a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:29.806925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:29.808484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:29.816420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:29.817215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:29.821065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:29.983569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:29.986777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:30.007686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3025/6008] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:18:39.724878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:39.997160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=35 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:44.040173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:44.042718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:44.265966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9dc7e-e61a-4ad8-b5d7-52c21476c05e service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:44.276438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:44.280036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:44.280311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:44.280578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] PATH_INFO: `/v3/users/2bb1d0b8cbb448d1b0a18c179759114e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:44.288252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb1d0b8cbb448d1b0a18c179759114e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:44.290546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:44.426350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb1d0b8cbb448d1b0a18c179759114e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:44.427075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb1d0b8cbb448d1b0a18c179759114e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:44.428122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb1d0b8cbb448d1b0a18c179759114e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:44.443620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb1d0b8cbb448d1b0a18c179759114e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:44.463901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1866b73f-f5c9-402c-b05a-2444e69ef139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb1d0b8cbb448d1b0a18c179759114e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:44.476769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:44.477777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:44.514995 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2984/6009] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:18:44 2022] DELETE /identity/v3/users/2bb1d0b8cbb448d1b0a18c179759114e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:44.519238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:44.519730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:44.520149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:44.593240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:44.600189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:44.721561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65434805-690d-4142-9813-0440fc31e3ae service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:44.742822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:44.771867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2985/6010] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:44.780948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:44.785451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:44.938207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:44.939004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:44.946859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:44.946859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:44.954861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:44.995634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:44.997884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:45.027324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3026/6011] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:45.029832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8cb6-caa2-45db-88b7-ded1b15ded6c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:45.053147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:45.053872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:45.054330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:45.054615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:45.080809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:45.083419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727761d-09d9-4dc4-8c5e-fd0c62012c60 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:45.105048 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2986/6012] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:45.447438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:45.448947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:45.498748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92548266-cac0-48e3-b986-e3966e08c5b2 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:45.513548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:45.514331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:45.514704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:45.515073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] PATH_INFO: `/v3/projects/1b6c13bc01d64a98a5fe51a9c4a220a4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:45.516604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6c13bc01d64a98a5fe51a9c4a220a4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:45.519635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:45.648260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6c13bc01d64a98a5fe51a9c4a220a4', 'request_id': 'req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:45.660338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6c13bc01d64a98a5fe51a9c4a220a4', 'request_id': 'req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:45.684889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6c13bc01d64a98a5fe51a9c4a220a4', 'request_id': 'req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:45.722316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] The token cache is being invalidate because project 1b6c13bc01d64a98a5fe51a9c4a220a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:18:45.722886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:45.723760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ae5aca-d744-4f3a-9c8a-69df6fe94be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:18:45.731639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3027/6013] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:18:45 2022] DELETE /identity/v3/projects/1b6c13bc01d64a98a5fe51a9c4a220a4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:45.733188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84da85-b75d-4102-8ba7-fc063c8c5b25 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:45.733494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84da85-b75d-4102-8ba7-fc063c8c5b25 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:45.733945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84da85-b75d-4102-8ba7-fc063c8c5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:45.821221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9a84da85-b75d-4102-8ba7-fc063c8c5b25 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:45.822867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9a84da85-b75d-4102-8ba7-fc063c8c5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:45.984992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2987/6014] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:18:45.991522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:45.992450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:45.992917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.007949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df001-f719-439d-baa3-0292b75810ba None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.008342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df001-f719-439d-baa3-0292b75810ba None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.008504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df001-f719-439d-baa3-0292b75810ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.011078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:46.039623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:46.042275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:46.055705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b42df001-f719-439d-baa3-0292b75810ba None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:46.058584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3028/6015] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:46.059804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.062869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b42df001-f719-439d-baa3-0292b75810ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:46.076122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46e38-9ac7-45a7-8857-f83badc2e8a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.083125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.083742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.084153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.084433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.085107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:18:46.085405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.087423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.123624 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3029/6016] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:18:46.128577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.154618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b9e5-b221-4839-b8ec-f2e70f4b48cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.170564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.171209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.188303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.188654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.190564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.198589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.227855 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2988/6017] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:18:46.249146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df001-f719-439d-baa3-0292b75810ba None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.249146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b42df001-f719-439d-baa3-0292b75810ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:46.326043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3030/6018] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:18:46 2022] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:18:46.327788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.360178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:46.437645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df001-f719-439d-baa3-0292b75810ba None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.610168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a8465-3105-4ca4-9804-03cc3bf53fb8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.622868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.623653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.624038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.625785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.626865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.633536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.652691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.653494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.654277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.656315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.708706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3031/6019] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:18:46 2022] POST /identity/v3/users => generated 280 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:18:46.717987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.745481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214700-f3ea-4089-aac8-b3558bf77f96 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.756982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.757744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.757870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.758099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.758758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.774194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.830522 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3032/6020] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:18:46.831184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.845677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.845677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.865497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e970c-d3fe-44bf-bc19-463916ba4078 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.872071 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2989/6021] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:18:46.877331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.877963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.878236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.878500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:46.879139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:46.885595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273f837-f523-4e1c-85e7-2384a738abfc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:46.918647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3033/6022] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:18:46.920735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:46.945268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ca6f4-cd0a-4638-9015-f162465fd297 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:46.966306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:46.970358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:46.972497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:46.973509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] PATH_INFO: `/v3/projects/9d4bb88266964d4ba12ccc1200993685/users/e15bb261353d47c99bea9631b5386a5a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:47.035844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4bb88266964d4ba12ccc1200993685, user_id=e15bb261353d47c99bea9631b5386a5a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:47.041240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:47.101561 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2990/6023] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:18:46 2022] PUT /identity/v3/projects/9d4bb88266964d4ba12ccc1200993685/users/e15bb261353d47c99bea9631b5386a5a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:18:47.102223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96f3d-90a3-4f63-a1fd-2c5b7aabec11 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:47.102471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96f3d-90a3-4f63-a1fd-2c5b7aabec11 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:47.102747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96f3d-90a3-4f63-a1fd-2c5b7aabec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:47.172889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-70e96f3d-90a3-4f63-a1fd-2c5b7aabec11 None None] MFA Rules not processed for user `e15bb261353d47c99bea9631b5386a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:47.182373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70e96f3d-90a3-4f63-a1fd-2c5b7aabec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:47.348703 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3034/6024] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:47.364523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:47.370963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:47.508426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:47.536329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd9c3a-d8a5-495b-b5a9-e9bd1848508b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:47.541659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:47.542543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:47.543837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:47.544219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:47.558878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:47.559862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:47.577577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2991/6025] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:51.278859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe426-7385-4a45-8d35-c53ece381d06 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:51.279323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe426-7385-4a45-8d35-c53ece381d06 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:51.279323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe426-7385-4a45-8d35-c53ece381d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:51.330078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1d0fe426-7385-4a45-8d35-c53ece381d06 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:51.331390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d0fe426-7385-4a45-8d35-c53ece381d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:51.361337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:51.488204 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3035/6026] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:51.502142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:51.690246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb49a-ed08-45cf-9ba3-45b192d46e17 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:51.710901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:51.711608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:51.711813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:51.712087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:51.732723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:51.740923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:51.767311 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2992/6027] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:18:54.029658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9702-6533-4e36-b7d6-b56c5fda3452 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:54.030200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9702-6533-4e36-b7d6-b56c5fda3452 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:54.030200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9702-6533-4e36-b7d6-b56c5fda3452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:54.102522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-403c9702-6533-4e36-b7d6-b56c5fda3452 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:54.104516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-403c9702-6533-4e36-b7d6-b56c5fda3452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:54.127438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3036/6028] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:54.141096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:54.158250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373ae4-f9fb-4302-a709-0d06bf23ee69 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:54.170158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:54.170791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:54.171082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:54.171353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:54.190626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:54.192141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:54.215225 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2993/6029] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:18:54.917674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:54.919300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:54.919739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:54.956888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:54.959018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:54.999300 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3037/6030] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:55.014621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:55.031333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026953a-73a0-447e-8d9c-2bfc493612e7 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:55.054372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:55.059067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:55.059492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:55.059770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:55.096789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:55.098440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810488d7-8fde-43c0-a905-847e54f53b9d service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:55.128577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2994/6031] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:04.948238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=22 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:05.116013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=49 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:05.198642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:05.200281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:05.379971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9152e-7d7a-48ba-8380-a73b3b409b30 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:05.394016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:05.395363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:05.397276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:05.397801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] PATH_INFO: `/v3/users/3466c2834c9f488aa00937cf0e2922aa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:05.401830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3466c2834c9f488aa00937cf0e2922aa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:05.407956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:05.513218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3466c2834c9f488aa00937cf0e2922aa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:05.515027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3466c2834c9f488aa00937cf0e2922aa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:05.529278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3466c2834c9f488aa00937cf0e2922aa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:05.541887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3466c2834c9f488aa00937cf0e2922aa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:05.543015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3466c2834c9f488aa00937cf0e2922aa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:05.579100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3038/6032] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:05 2022] DELETE /identity/v3/users/3466c2834c9f488aa00937cf0e2922aa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:05.583067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787216-9ebe-4ac0-a716-7e4026635fb7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:05.583783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787216-9ebe-4ac0-a716-7e4026635fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:05.584262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787216-9ebe-4ac0-a716-7e4026635fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:05.648504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-60787216-9ebe-4ac0-a716-7e4026635fb7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:05.651847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-60787216-9ebe-4ac0-a716-7e4026635fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:05.756172 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2995/6033] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:05.925893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:05.927680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:06.139934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5ce2-5a4b-4ef2-859f-89c21bec3faf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:06.151315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:06.152529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:06.155001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:06.155362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:06.180481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:06.182547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:06.199271 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3039/6034] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:06.472150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096d3f-6c2c-46a1-bfc6-dd8f5c05e5dc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:06.472785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096d3f-6c2c-46a1-bfc6-dd8f5c05e5dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:06.472882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13096d3f-6c2c-46a1-bfc6-dd8f5c05e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:06.505212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-13096d3f-6c2c-46a1-bfc6-dd8f5c05e5dc None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:06.509217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-13096d3f-6c2c-46a1-bfc6-dd8f5c05e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:06.776834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2996/6035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:07.545547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:07.546356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:07.600198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4792-232b-43e8-97d3-be914f8f0745 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:07.618831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:07.620936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:07.621444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:07.621654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] PATH_INFO: `/v3/projects/410256baba634b36a15c933c1d8fda88` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:07.622925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410256baba634b36a15c933c1d8fda88)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:07.626636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:07.635630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:07.787943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410256baba634b36a15c933c1d8fda88', 'request_id': 'req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:07.807567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410256baba634b36a15c933c1d8fda88', 'request_id': 'req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:07.821615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410256baba634b36a15c933c1d8fda88', 'request_id': 'req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:07.844118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] The token cache is being invalidate because project 410256baba634b36a15c933c1d8fda88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:07.844571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:07.847350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f632c2f6-18e8-44f5-9f9a-f4b1a2cd6699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:07.849388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3040/6036] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:07 2022] DELETE /identity/v3/projects/410256baba634b36a15c933c1d8fda88 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:07.854874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:07.855677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:07.856181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:07.916186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:07.917963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:08.122122 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2997/6037] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:08.130983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.131257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.131533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.158373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:08.159834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:08.174831 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3041/6038] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:08.176290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.206151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f539b7-a2a5-4189-8584-dc25c60ff936 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:08.218218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:08.219241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.219644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.220610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.222983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:08.223453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:08.227354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:08.245901 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2998/6039] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:08.250902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.261166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c0331-5c62-4d6a-99e3-8228642ab290 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:08.285500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:08.287405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.288032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.288803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.290186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:08.295853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:08.399170 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3042/6040] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:08 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:08.400746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.417381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed567-69e8-4f24-a13f-4cd7a2bcf633 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:08.539890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:08.656385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:08.657176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.657666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.658328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.659303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:08.666907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:08.725629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 2999/6041] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:08 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:08.727113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.758256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3473-120f-4202-925d-d7f625673a03 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:08.781520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:08.786450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.788767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.789548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.794287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:08.795974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:08.850889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3043/6042] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:08.856467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.871321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368588-7505-4da9-b171-ac04e2249d7a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:08.882464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:08.883319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:08.886477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:08.886772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:08.888644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:08.890561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508e836-168c-43ad-9d94-59f1e50d5851 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:08.960447 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3000/6043] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:08.964896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:08.987525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3eb5-72e5-4f68-8077-f37ba6d27361 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:09.001468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:09.002268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:09.002555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:09.002830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] PATH_INFO: `/v3/projects/f95e2f84db3946ff9479af1a11ae109c/users/4515cfa9042849c3aaaa76140fb7f274/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:09.034047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e2f84db3946ff9479af1a11ae109c, user_id=4515cfa9042849c3aaaa76140fb7f274, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:09.036897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:09.073730 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3044/6044] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:08 2022] PUT /identity/v3/projects/f95e2f84db3946ff9479af1a11ae109c/users/4515cfa9042849c3aaaa76140fb7f274/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:09.074667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:09.075324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:09.075745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:09.189466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] MFA Rules not processed for user `4515cfa9042849c3aaaa76140fb7f274`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:09.195763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:09.432377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3001/6045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:09.437457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:09.594022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1473-a4fb-4159-91ba-8b24322f3cc3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:09.609555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:09.610297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:09.610685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:09.611063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:09.611810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:09.618175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:09.670069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3045/6046] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:09 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:09.674310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:09.691084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034f9f-ae79-43d1-bf45-ef7c2f9eeb60 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:09.826220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:09.827297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:09.828497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:09.829342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:09.831096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:09.835081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:09.886639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3002/6047] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:09 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:09.888458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:09.907762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9c2-9856-4fdd-9b43-a478cc74357e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:09.919364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:09.920183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:09.922498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:09.922946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:09.924742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:09.926583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:09.960253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3046/6048] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:09.962321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:09.973874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120779cf-6525-4692-9be7-168048113bb1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.007093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:10.007945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.008292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.008725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.011089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:10.012791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb59925-1488-416a-8472-2a8c09a28850 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:10.045979 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3003/6049] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:10.047284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:10.054363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:10.060324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a8bfd-f53d-4209-b87f-c3a150153c67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.077538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:10.080716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.081819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.082208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] PATH_INFO: `/v3/projects/e974fb01c99a4949a99799de82c859b6/users/481fc66152184c56abcc2c5744bfaae5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.127313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e974fb01c99a4949a99799de82c859b6, user_id=481fc66152184c56abcc2c5744bfaae5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:10.135905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:10.169091 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3047/6050] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:10 2022] PUT /identity/v3/projects/e974fb01c99a4949a99799de82c859b6/users/481fc66152184c56abcc2c5744bfaae5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:10.180352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.180640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.180931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.243568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] MFA Rules not processed for user `481fc66152184c56abcc2c5744bfaae5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:10.246832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:10.265420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:10.434974 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3004/6051] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:10.439929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:10.655313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfada-6d3b-40fc-bc40-f8b775cd6ec6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.672250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:10.673204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.673722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.674217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.675124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:10.677443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:10.718374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:10.721715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:10.742606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3048/6052] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:10 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:10.746779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:10.871049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0769-3285-4373-b21d-16c034728b59 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.877184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:10.877809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.878090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.878364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.879000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:10.881272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:10.886139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d11a-de68-4cf4-9781-82858db112aa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.908206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3049/6053] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:10 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:10.912051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:10.935469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac3bc-f944-43c4-878c-8c516d416f39 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:10.954263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:10.955142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:10.955656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:10.956106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:10.958253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:10.961863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:10.989804 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3050/6054] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:11.001829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:11.028215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6647c-0f97-4cf3-9a26-45cfe57ef8e6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:11.032286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:11.033833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.034291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.036093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.038713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:11.046736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:11.047924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.048500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.050592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] PATH_INFO: `/v3/projects/a5100366dde84f4292a03f252995fe56/users/3b7c800c00504bb9b5adae79b544efc6/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.058519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:11.061898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:11.086721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5100366dde84f4292a03f252995fe56, user_id=3b7c800c00504bb9b5adae79b544efc6, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:11.092096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:11.108939 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3005/6055] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:19:11.137197 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3051/6056] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:10 2022] PUT /identity/v3/projects/a5100366dde84f4292a03f252995fe56/users/3b7c800c00504bb9b5adae79b544efc6/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:11.140957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:11.163163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a9b5-d324-4e95-8d1e-1005b2c9366f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:11.324439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:11.327489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.327911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.328500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.329316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:11.333207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63079b45-1659-4786-8014-23ee6abf6ce4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:11.358667 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3006/6057] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:11.362422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:11.382565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d76c4-b935-4cd4-bc19-e024f9f8e589 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:11.390265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:11.390949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.392084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.392084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] PATH_INFO: `/v3/projects/a5100366dde84f4292a03f252995fe56/users/3b7c800c00504bb9b5adae79b544efc6/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.399488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5100366dde84f4292a03f252995fe56, user_id=3b7c800c00504bb9b5adae79b544efc6, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:11.402274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:11.424746 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3052/6058] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:11 2022] PUT /identity/v3/projects/a5100366dde84f4292a03f252995fe56/users/3b7c800c00504bb9b5adae79b544efc6/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:11.444666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.445005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.445244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.494437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:11.557361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] MFA Rules not processed for user `3b7c800c00504bb9b5adae79b544efc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:11.558653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:11.689260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3007/6059] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:11.727952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:11.730748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:11.750661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:11.871098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7820c-19f2-49d3-87fd-1728e50aebbf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:11.875653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:11.876274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:11.876547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:11.876812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:11.949780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:11.951240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:11.963817 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3053/6060] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:15.147235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:15.149275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:15.168958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6208139-0819-4ef1-a062-38d0ecc30d8a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:15.173659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:15.174491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:15.174949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:15.175395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:15.253711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:15.255943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:15.281944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3008/6061] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:16.312229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:16.331056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a03b1-8379-4512-92a0-99c1d19a9017 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:16.334911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:16.335897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:16.336335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:16.336764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:16.368081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:16.370225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:16.407341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3054/6062] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:25.263002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=60 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:25.365122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:25.369538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:25.561270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853ea5-c95e-432a-bf35-f833d7100ac3 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:25.586655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:25.587352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:25.587627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:25.590405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:25.599716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:25.627566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:25.629514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:25.660780 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3009/6063] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:26.389330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=56 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:28.000551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:28.002112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:28.128721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8b5a-264a-433e-b17e-32e9c0a07dd2 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:28.136667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:28.137375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:28.137805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:28.138082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] PATH_INFO: `/v3/users/85f5e98a834f490fa846a847306085e4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:28.139270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f5e98a834f490fa846a847306085e4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:28.142554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:28.218142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f5e98a834f490fa846a847306085e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:28.219312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f5e98a834f490fa846a847306085e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:28.232763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f5e98a834f490fa846a847306085e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:28.256025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f5e98a834f490fa846a847306085e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:28.257401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5901eeeb-a6c8-4883-84e9-860bc0a9dbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f5e98a834f490fa846a847306085e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:28.314970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3055/6064] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:27 2022] DELETE /identity/v3/users/85f5e98a834f490fa846a847306085e4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:29.315937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:29.332981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960ad7-72cf-4067-89e6-dd5290e34c36 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:29.463860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:29.464797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:29.465287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:29.465719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] PATH_INFO: `/v3/projects/946b5c4d8cbf4ab5b94f15c2704d5ce3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:29.469818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946b5c4d8cbf4ab5b94f15c2704d5ce3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:29.472637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:29.557299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'request_id': 'req-f50ef74c-7ee0-46ab-a015-dc3e727f9217'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:29.572979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'request_id': 'req-f50ef74c-7ee0-46ab-a015-dc3e727f9217'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:29.590543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'request_id': 'req-f50ef74c-7ee0-46ab-a015-dc3e727f9217'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:29.616225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] The token cache is being invalidate because project 946b5c4d8cbf4ab5b94f15c2704d5ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:29.621279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:29.625333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:29.629120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3010/6065] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:29 2022] DELETE /identity/v3/projects/946b5c4d8cbf4ab5b94f15c2704d5ce3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:29.636196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02259-f4b1-48bd-a309-dd1c7ca1ed64 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:29.637330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02259-f4b1-48bd-a309-dd1c7ca1ed64 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:29.637826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02259-f4b1-48bd-a309-dd1c7ca1ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:29.717281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-82c02259-f4b1-48bd-a309-dd1c7ca1ed64 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:29.720020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82c02259-f4b1-48bd-a309-dd1c7ca1ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:29.826458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:29.828155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:29.884030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:29.904090 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3056/6066] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:29.911596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:29.911882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:29.912155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:29.955031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:29.956460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:29.982740 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3057/6067] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:29.986760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.002321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4655b-0860-4138-ab2c-45c502ae9223 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.011967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.012849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.013345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.013780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.014598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:30.015052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.016839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.036889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:30.048765 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3058/6068] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:19:30.050199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.082748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfd69a-1041-4a95-8cf7-430efdcefb98 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.106375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.107032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.107312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.107582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.108215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.110171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.129057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef74c-7ee0-46ab-a015-dc3e727f9217 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.135881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.136547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.136828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.137132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] PATH_INFO: `/v3/users/4515cfa9042849c3aaaa76140fb7f274` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.138746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4515cfa9042849c3aaaa76140fb7f274)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.141097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.182110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3059/6069] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:30 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:30.183253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.257880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4515cfa9042849c3aaaa76140fb7f274'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:30.260359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4515cfa9042849c3aaaa76140fb7f274'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:30.268293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4515cfa9042849c3aaaa76140fb7f274'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:30.288644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4515cfa9042849c3aaaa76140fb7f274'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:30.309412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b52df7cd-b4f3-4e66-b50e-cfb3fdf062d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4515cfa9042849c3aaaa76140fb7f274'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:30.346689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9a27e-8e3e-468c-9bbb-fa0e3f9c73be admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.355899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.356536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.356816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.357127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.358377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3011/6070] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:29 2022] DELETE /identity/v3/users/4515cfa9042849c3aaaa76140fb7f274 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:30.360702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.362747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.362915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.363529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.363873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.412234 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3060/6071] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:30 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:30.412838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:30.415330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:30.416096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.418851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:30.455558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa197f59-2d77-4bb4-8465-6e74a4fa879c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.612602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.613449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.613874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.614221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.614946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.616661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.630163 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3061/6072] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:19:30.633725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.646052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502726f-c4a2-448b-81fb-d237a557a907 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.652822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.653932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.654426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.654930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.655805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.657921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.671215 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3062/6073] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:30.675695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3012/6074] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:30.677112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.691311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:30.692881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:30.711373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06cd79-9a0b-46ba-8433-4be02ae91c34 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.728841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:30.729934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.730533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.731023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] PATH_INFO: `/v3/projects/36a1ffb082694e5c814dfbaf1f1d10c4/users/d125418511e64745a6caee0328899c64/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.766627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a1ffb082694e5c814dfbaf1f1d10c4, user_id=d125418511e64745a6caee0328899c64, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:30.776852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470bc0-4dd1-468f-8572-73c4845d51d4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:30.818349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:30.832072 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3063/6075] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:30 2022] PUT /identity/v3/projects/36a1ffb082694e5c814dfbaf1f1d10c4/users/d125418511e64745a6caee0328899c64/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:30.842294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:30.842891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:30.843398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:30.877620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4e52a-065e-42d8-9515-758cfcf92301 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:30.912519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] MFA Rules not processed for user `d125418511e64745a6caee0328899c64`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:30.914008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:30.953695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:31.007651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:31.008482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:31.008808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:31.010185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:31.063389 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3064/6076] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:31.083240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:31.084750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:31.208548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:31.211890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a2b0-9b62-4205-bd39-f4ba04e47ffa service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:31.261266 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3013/6077] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:19:31.281636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:31.281956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:31.282533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:31.284193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7202-a19a-4c4d-863f-4922e200af81 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:31.303987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:31.304624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:31.304922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:31.305199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:31.307610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] MFA Rules not processed for user `b34b183f2b0b4a4597fb2e3b6495268a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:31.309210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:31.317886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:31.319512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:31.342296 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3065/6078] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:31.558097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3014/6079] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:32.242336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:32.244326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:32.286029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7dd2-5c97-4e9e-a45b-9c4b3a9c01c0 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:32.292624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:32.293534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:32.293961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:32.294402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] PATH_INFO: `/v3/projects/f95e2f84db3946ff9479af1a11ae109c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:32.295806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95e2f84db3946ff9479af1a11ae109c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:32.297952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:32.367751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95e2f84db3946ff9479af1a11ae109c', 'request_id': 'req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.376150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95e2f84db3946ff9479af1a11ae109c', 'request_id': 'req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.388281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95e2f84db3946ff9479af1a11ae109c', 'request_id': 'req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.406038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] The token cache is being invalidate because project f95e2f84db3946ff9479af1a11ae109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:32.406868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.408107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.410729 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3066/6080] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:32 2022] DELETE /identity/v3/projects/f95e2f84db3946ff9479af1a11ae109c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:32.414634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:32.436805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a72d-b0ef-47ea-912c-b30b20dfad39 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:32.578726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:32.598823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:32.599483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:32.599766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:32.600042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] PATH_INFO: `/v3/users/481fc66152184c56abcc2c5744bfaae5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:32.601252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=481fc66152184c56abcc2c5744bfaae5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:32.603277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:32.702484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:32.704332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:32.708579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481fc66152184c56abcc2c5744bfaae5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.709927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481fc66152184c56abcc2c5744bfaae5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.711143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481fc66152184c56abcc2c5744bfaae5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.722505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14059b8-185c-4594-b1ad-4c5cfbb1f56f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:32.730166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481fc66152184c56abcc2c5744bfaae5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.730436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:32.731547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:32.732142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:32.732381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] PATH_INFO: `/v3/users/d125418511e64745a6caee0328899c64` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:32.735038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d125418511e64745a6caee0328899c64)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:32.738757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:32.743726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:32.747427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a55e29a6-b820-4276-9969-1e1f6b3a5f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481fc66152184c56abcc2c5744bfaae5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.789399 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3015/6081] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:32 2022] DELETE /identity/v3/users/481fc66152184c56abcc2c5744bfaae5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:32.859410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd125418511e64745a6caee0328899c64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.860962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd125418511e64745a6caee0328899c64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.873986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd125418511e64745a6caee0328899c64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.891300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd125418511e64745a6caee0328899c64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.892927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd125418511e64745a6caee0328899c64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:32.941397 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3067/6082] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:32 2022] DELETE /identity/v3/users/d125418511e64745a6caee0328899c64 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:32.944260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:32.944709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:32.945069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:32.984860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:32.990271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:33.077322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3016/6083] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:33.094569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:33.097060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:33.203524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de233-60c2-4992-a23b-155421c4ff3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:33.208935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:33.209565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:33.209840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:33.210233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:33.221201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:33.222632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:33.235614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3068/6084] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:33.566701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:33.569116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:33.591152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae0fe4-b035-4e4b-9ed9-edd7bba31903 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:33.602937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:33.603957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:33.605055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:33.605515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] PATH_INFO: `/v3/projects/e974fb01c99a4949a99799de82c859b6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:33.607139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e974fb01c99a4949a99799de82c859b6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:33.611644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:33.740830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e974fb01c99a4949a99799de82c859b6', 'request_id': 'req-598b8412-3dbe-426f-b6bf-06346e85c9fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:33.765049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e974fb01c99a4949a99799de82c859b6', 'request_id': 'req-598b8412-3dbe-426f-b6bf-06346e85c9fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:33.778171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e974fb01c99a4949a99799de82c859b6', 'request_id': 'req-598b8412-3dbe-426f-b6bf-06346e85c9fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:33.780967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:33.804731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] The token cache is being invalidate because project e974fb01c99a4949a99799de82c859b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:33.805460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:33.806461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:33.811723 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3017/6085] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:33 2022] DELETE /identity/v3/projects/e974fb01c99a4949a99799de82c859b6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:33.812682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:33.841362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab47dfb-ac72-4341-9789-130fec74afda service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:33.970928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:33.971889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:33.972573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:33.974142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] PATH_INFO: `/v3/users/3b7c800c00504bb9b5adae79b544efc6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:33.975613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7c800c00504bb9b5adae79b544efc6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:33.977939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:34.016837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:34.080635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7c800c00504bb9b5adae79b544efc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:34.083292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7c800c00504bb9b5adae79b544efc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:34.097051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7c800c00504bb9b5adae79b544efc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:34.109873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7c800c00504bb9b5adae79b544efc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:34.110930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7c800c00504bb9b5adae79b544efc6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:34.178903 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3069/6086] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:33 2022] DELETE /identity/v3/users/3b7c800c00504bb9b5adae79b544efc6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:34.598376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:34.599907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:34.632975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8412-3dbe-426f-b6bf-06346e85c9fd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:34.811140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:34.813170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:34.882078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:34.883243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:34.885509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:34.886026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] PATH_INFO: `/v3/projects/36a1ffb082694e5c814dfbaf1f1d10c4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:34.889368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a1ffb082694e5c814dfbaf1f1d10c4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:34.900054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:34.960431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85b73-30f7-4c97-a511-8d15d2489018 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:34.972211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:34.973366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:34.973791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:34.974438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] PATH_INFO: `/v3/projects/a5100366dde84f4292a03f252995fe56` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:34.976336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5100366dde84f4292a03f252995fe56)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:34.979791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.052621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a1ffb082694e5c814dfbaf1f1d10c4', 'request_id': 'req-8a2099a6-7c31-439f-bb05-428070d44909'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.077177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a1ffb082694e5c814dfbaf1f1d10c4', 'request_id': 'req-8a2099a6-7c31-439f-bb05-428070d44909'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.119897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a1ffb082694e5c814dfbaf1f1d10c4', 'request_id': 'req-8a2099a6-7c31-439f-bb05-428070d44909'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.151233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] The token cache is being invalidate because project 36a1ffb082694e5c814dfbaf1f1d10c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:35.151522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.153151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a2099a6-7c31-439f-bb05-428070d44909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.160402 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3018/6087] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:34 2022] DELETE /identity/v3/projects/36a1ffb082694e5c814dfbaf1f1d10c4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:35.166566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679031-ce5f-431f-977f-8da6be5e0546 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.167029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679031-ce5f-431f-977f-8da6be5e0546 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.167477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679031-ce5f-431f-977f-8da6be5e0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.220936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5100366dde84f4292a03f252995fe56', 'request_id': 'req-025ec612-5a10-4cf2-bce0-98d6b379d021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.234901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-de679031-ce5f-431f-977f-8da6be5e0546 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:35.242422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-de679031-ce5f-431f-977f-8da6be5e0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:35.267915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5100366dde84f4292a03f252995fe56', 'request_id': 'req-025ec612-5a10-4cf2-bce0-98d6b379d021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.302152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5100366dde84f4292a03f252995fe56', 'request_id': 'req-025ec612-5a10-4cf2-bce0-98d6b379d021'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.329801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] The token cache is being invalidate because project a5100366dde84f4292a03f252995fe56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:35.330348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.331917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-025ec612-5a10-4cf2-bce0-98d6b379d021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:35.338573 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3070/6088] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:34 2022] DELETE /identity/v3/projects/a5100366dde84f4292a03f252995fe56 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:35.340276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4095-f616-443d-aef0-6274ad1e147a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.340727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4095-f616-443d-aef0-6274ad1e147a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.343002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4095-f616-443d-aef0-6274ad1e147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.387834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3019/6089] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:35.392365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-00ae4095-f616-443d-aef0-6274ad1e147a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:35.393638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-00ae4095-f616-443d-aef0-6274ad1e147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:35.396120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.396120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.396120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.420953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3071/6090] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:35.428824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.430092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.430571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.439620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:35.440955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:35.476821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3020/6091] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:35.482395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:35.492796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:35.496728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:35.512640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6f78-a72e-4bcc-a05a-4a59ec2828fc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:35.526380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3072/6092] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:35.531740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:35.534808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:35.535474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.536187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.536187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.536719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:35.537048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:35.538755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.589977 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3021/6093] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:35.597133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:35.600746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7c1f-b62a-41db-9138-a4805501b1e2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:35.609844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:35.624636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:35.628193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef80e0a-9e31-4fae-8f10-870daeec247b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:35.648210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:35.648841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.649842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.650138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.650780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:35.654454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.654758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.657966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.660736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.661655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:35.668428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:35.671640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.708703 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3073/6094] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:35.709688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:35.757955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce9cd-2fa6-478b-8bb2-fe0715ec78c7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:35.771290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3022/6095] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:35.773285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:35.783330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:35.893579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57fffd-64c1-4a4f-a759-1bdf39e4538a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:35.913697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:35.914225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.919177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.919474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.920160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:35.932057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.969097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:35.972055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:35.972499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:35.973766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:35.975951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:35.984190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:35.989981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3023/6096] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:35.996142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.024113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292390e0-84c2-4e9d-96cb-f691c1ea20c2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.042821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.044014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.044462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.044886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.046766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.049754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.081529 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3024/6097] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:36.085649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.102607 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3074/6098] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:35 2022] POST /identity/v3/projects => generated 375 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:36.105002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.107609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6f35-6462-4865-962b-2514876b14a1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.285867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.286510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.287330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.287659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.288547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.291052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.314446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd88b-c547-49d4-8118-b7b763f691be admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.322524 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3025/6099] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:36.323558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.332543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.333156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.333450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.333696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.334329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.336278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.345542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd506-48ea-4be0-9bf1-47c5e2eb0136 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.358565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.359253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.359538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.359817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] PATH_INFO: `/v3/projects/d5a9fe1de511423fb3da822dd9f429e9/users/136b8c7d428a4780b284456806c2c6da/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.409583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9fe1de511423fb3da822dd9f429e9, user_id=136b8c7d428a4780b284456806c2c6da, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.415561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57c31-b6d4-41da-a78a-f1a31c83843b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.419990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3075/6100] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:36 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:36.432651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.440772 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3026/6101] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:36 2022] PUT /identity/v3/projects/d5a9fe1de511423fb3da822dd9f429e9/users/136b8c7d428a4780b284456806c2c6da/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:36.455858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.456252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.456532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.460607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80291017-3b2b-44d4-a457-796f5c8f0b3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.537745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] MFA Rules not processed for user `136b8c7d428a4780b284456806c2c6da`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:36.539086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:36.606524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:36.647938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.648574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.648853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.649156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.649876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.659377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.689655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3076/6102] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:36.690811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.713070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d8-26b2-4f72-bbdb-6fed0d58d4b4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.730431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.731476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3027/6103] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:36.732343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.732830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.733288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.734088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.736570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.739650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.767211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833159eb-69ab-443d-bd36-d5c81d6be4fb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.778545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3077/6104] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:36.784181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.792094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.793016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.793390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.794343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.813478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.826454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.867107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724904b6-4e83-49a2-95be-20d3388420e8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:36.883124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:36.884626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:36.885120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:36.888063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] PATH_INFO: `/v3/projects/064f2d7843e844549919c80de5e287f0/users/8292cf2932014bd2bd4aed1998dc9cec/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:36.895449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:36.934432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3028/6105] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:36 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:36.940757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:36.944049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=064f2d7843e844549919c80de5e287f0, user_id=8292cf2932014bd2bd4aed1998dc9cec, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:36.951717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30037-0477-40c4-afee-002f8b13fd4a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:36.999311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3078/6106] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:36 2022] PUT /identity/v3/projects/064f2d7843e844549919c80de5e287f0/users/8292cf2932014bd2bd4aed1998dc9cec/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:37.011491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:37.011785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:37.012063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:37.100298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] MFA Rules not processed for user `8292cf2932014bd2bd4aed1998dc9cec`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:37.105663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:37.153142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a255-22d1-426b-95fc-0828df5b1565 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:37.325316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3079/6107] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:37.334946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:37.337502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:37.449942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab9a7-d154-4241-a1f7-ffa137262e70 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:37.460679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:37.461508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:37.461787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:37.462497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:37.490658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:37.492135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:37.506453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:37.507167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:37.507454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:37.507726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:37.508535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:37.514764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:37.522630 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3080/6108] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:37.624587 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3029/6109] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:36 2022] POST /identity/v3/users => generated 291 bytes in 687 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:37.629356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:37.651598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c026c7-fa05-4d3e-99eb-6312feae6232 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:37.661396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:37.662020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:37.662303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:37.662572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:37.663314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:37.686340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:37.735417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3081/6110] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:37.736988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:37.754131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78e1b-db8f-4a67-8a09-b508c3be7144 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:37.771426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:37.772381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:37.772876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:37.774270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] PATH_INFO: `/v3/projects/22b0a935b82f484394555a3ab82daad7/users/971e27fb8ec74ee997c27e6ecc5f3380/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:37.838725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b0a935b82f484394555a3ab82daad7, user_id=971e27fb8ec74ee997c27e6ecc5f3380, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:37.842863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:37.876769 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3030/6111] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:37 2022] PUT /identity/v3/projects/22b0a935b82f484394555a3ab82daad7/users/971e27fb8ec74ee997c27e6ecc5f3380/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:37.880651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:37.898424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce078e9c-b9b3-49f9-82af-8e3f1308c42c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:38.118805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:38.121027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:38.121274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:38.121561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:38.122283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:38.124030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7baed9-014d-4297-b58a-dfeffd12f471 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:38.134274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:38.159253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3082/6112] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:38.161158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:38.178668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330529df-4f70-4d19-a938-da3a39c0927b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:38.194771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:38.198292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:38.199769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:38.207016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] PATH_INFO: `/v3/projects/22b0a935b82f484394555a3ab82daad7/users/971e27fb8ec74ee997c27e6ecc5f3380/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:38.220333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b0a935b82f484394555a3ab82daad7, user_id=971e27fb8ec74ee997c27e6ecc5f3380, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:38.225238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:38.252131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:38.262322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3031/6113] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:38 2022] PUT /identity/v3/projects/22b0a935b82f484394555a3ab82daad7/users/971e27fb8ec74ee997c27e6ecc5f3380/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:38.279501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:38.283369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:38.283742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:38.372877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] MFA Rules not processed for user `971e27fb8ec74ee997c27e6ecc5f3380`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:38.375931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:38.555723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3083/6114] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:38.560345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:38.580299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2bd0b-2c00-4432-afb5-1c53671583b8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:38.591553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:38.592617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:38.593108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:38.593507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:38.595186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:38.598075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:38.641528 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3032/6115] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:19:38 2022] POST /identity/v3/domains => generated 276 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:38.643658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:38.665492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd782ed-1df0-4fac-a6f9-73eca58776b1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:38.916124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:38.916838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:38.917073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:38.917350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:38.918004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:38.955910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.037745 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3084/6116] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:38 2022] POST /identity/v3/groups => generated 280 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:39.043130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.064800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4857a2-5321-4663-a096-65d55c69ad44 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.077172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.077822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.078101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.078359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/be537d99ab5641e4b21b6774f41df466` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.090498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:update_group(group_id=be537d99ab5641e4b21b6774f41df466)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.091622 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:39.091622 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:19:39.091622 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:19:39.093573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.136828 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3033/6117] 10.222.0.16 () {60 vars in 1247 bytes} [Fri Oct 28 10:19:39 2022] PATCH /identity/v3/groups/be537d99ab5641e4b21b6774f41df466 => generated 291 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:39.138111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.149600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d3de-17c2-428a-b9ff-7e2ac8d5b11f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.155088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.155907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.156189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.156459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/be537d99ab5641e4b21b6774f41df466` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.163148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:get_group(group_id=be537d99ab5641e4b21b6774f41df466)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.167134 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:39.167134 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:19:39.167134 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:19:39.169510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.172556 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3085/6118] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:39 2022] GET /identity/v3/groups/be537d99ab5641e4b21b6774f41df466 => generated 291 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:39.176541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.193678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80172f6d-2c42-4bfe-93a2-535300d2adab tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.200753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.201719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.202181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.202790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/be537d99ab5641e4b21b6774f41df466` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.218629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:update_group(group_id=be537d99ab5641e4b21b6774f41df466)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.227323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e977-d220-4786-8ece-370142fa93ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.275918 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3034/6119] 10.222.0.16 () {60 vars in 1246 bytes} [Fri Oct 28 10:19:39 2022] PATCH /identity/v3/groups/be537d99ab5641e4b21b6774f41df466 => generated 307 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:39.280440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.300263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb787b-fce4-4877-ad23-4563215a72f3 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.318331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.319169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.319555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.319933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/be537d99ab5641e4b21b6774f41df466` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.329937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=be537d99ab5641e4b21b6774f41df466)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.332644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.459701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.459979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.460251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.514841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3086/6120] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:39 2022] DELETE /identity/v3/groups/be537d99ab5641e4b21b6774f41df466 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:39.520031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.532776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] MFA Rules not processed for user `839e2104bc0d4b1fb55d69966eedd998`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:39.541360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:39.571048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:39.720082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3035/6121] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:39.720914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f0d7-1368-47c4-800a-9825829cbdc9 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.738226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.738835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.739193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.739375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.740063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.746475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.782904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3087/6122] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:39 2022] POST /identity/v3/groups => generated 325 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:39.789537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.816022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dffa-d692-4f89-a940-1bb928e5ddb5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.829744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.830910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.831320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.831600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:39.832238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:39.834297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:39.900430 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3036/6123] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:39 2022] POST /identity/v3/users => generated 323 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:39.903613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:39.920456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481be24-1f72-481e-9f33-f2e1d04bc20f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:39.929713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:39.930687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:39.930979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:39.931251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.013707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=dda8a14e4365417d812cd07f82456181)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.018631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.082318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.094279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3088/6124] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:19:39 2022] PUT /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:40.109598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48618ca-134a-44ca-b581-25a9b44897d4 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.221536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.222525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.223111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.224654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.226609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.229110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.277626 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3037/6125] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:40 2022] POST /identity/v3/users => generated 323 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:40.281665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.303773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b02f0c-b040-421b-81fb-fd64c2154f9f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.316037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.316729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.317039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.317358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.352757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=35f73f39b80b4db088b97f8c83c4795f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.356362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.397502 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3089/6126] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:19:40 2022] PUT /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:40.398731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.422534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de8b6-7c42-409c-b9a2-854f76e6044e tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.465904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:40.523501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.524151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.524472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.524747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.525437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.527950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.569861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.581609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3038/6127] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:40 2022] POST /identity/v3/users => generated 323 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:40.584568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22a1aa-69eb-435f-9551-ee216f17f5cc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.597986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.598654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.598933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.599204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.624028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=3dbeb7075a244838b407c2bf8e6ead8d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.626713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.664571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3090/6128] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:19:40 2022] PUT /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:40.669759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.688132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18f92-c84d-4d1e-b2a4-e84177cb4327 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.782880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.783619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.784077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.784359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.786469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=b1328c394d7741eca7835f27f65d8227)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.803530 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:40.803530 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:19:40.803530 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:19:40.806922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.857156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3039/6129] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:19:40 2022] GET /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users => generated 1085 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:40.859166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.883128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9ebf-c43c-4787-9005-8258e4009300 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.894691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.895608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.895982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.897590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.901321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=dda8a14e4365417d812cd07f82456181)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.905172 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:40.905172 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:19:40.905172 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:19:40.905465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.948515 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3091/6130] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Oct 28 10:19:40 2022] HEAD /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:40.949716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.966355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370c523-5bab-4bfe-95d9-95a7fee8f622 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.987629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.988722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.989336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.989816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.995644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=dda8a14e4365417d812cd07f82456181)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.997099 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:40.997099 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:19:40.997099 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:19:40.999937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.013060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.059329 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3040/6131] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:19:40 2022] DELETE /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/dda8a14e4365417d812cd07f82456181 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:41.063901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.087543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5192f-9931-4a15-a9ce-f44c8ca245ba tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.206355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:41.231333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.231887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.232221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.233154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.236031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=35f73f39b80b4db088b97f8c83c4795f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.238688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.265158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3092/6132] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Oct 28 10:19:41 2022] HEAD /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:41.265379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.279358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935e98-8322-4a0e-870f-b50d0c69e7f6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.292470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.293037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.293297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.293572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.299351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=35f73f39b80b4db088b97f8c83c4795f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.301333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.323070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.345683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3041/6133] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:19:41 2022] DELETE /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/35f73f39b80b4db088b97f8c83c4795f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:41.349967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.372128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d422-6610-48f8-bdac-862158d2f490 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.493123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.493123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.493123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.493756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.493756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=3dbeb7075a244838b407c2bf8e6ead8d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.514274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.549431 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3093/6134] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Oct 28 10:19:41 2022] HEAD /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:41.553975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.570428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845337-ad44-44cb-b1e9-edf09b5cb309 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.584863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.585580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.585869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.586149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.596226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b1328c394d7741eca7835f27f65d8227, user_id=3dbeb7075a244838b407c2bf8e6ead8d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.598274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.626160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.656538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3042/6135] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:19:41 2022] DELETE /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users/3dbeb7075a244838b407c2bf8e6ead8d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:41.656968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.676781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf9ad-6c17-49cf-9e84-cd3a46e78c3f tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.773974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.774656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.774938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.775211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.776436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=b1328c394d7741eca7835f27f65d8227)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.777510 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:41.777510 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:19:41.777510 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:19:41.778719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.800777 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3094/6136] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:19:41 2022] GET /identity/v3/groups/b1328c394d7741eca7835f27f65d8227/users => generated 145 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:41.804814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.817438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b445b-853d-4e2d-8338-88aad8d04f77 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.824329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.825129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.825515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.825896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users/3dbeb7075a244838b407c2bf8e6ead8d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.827192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3dbeb7075a244838b407c2bf8e6ead8d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.830067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.912609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:INSERT=6,keystone:DELETE=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:41.938066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.939179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.940016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.958120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.977045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbeb7075a244838b407c2bf8e6ead8d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.009304 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3043/6137] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:41 2022] DELETE /identity/v3/users/3dbeb7075a244838b407c2bf8e6ead8d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:42.013141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:42.015207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:42.030506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fafd9-3df5-47b3-acda-ebfb6e865bb1 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:42.201449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:42.202351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:42.203200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:42.203621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users/35f73f39b80b4db088b97f8c83c4795f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:42.204990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_user(user_id=35f73f39b80b4db088b97f8c83c4795f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:42.207223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:42.215110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:42.303438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.305005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.323031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.342012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.344758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f73f39b80b4db088b97f8c83c4795f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.386237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3095/6138] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:42 2022] DELETE /identity/v3/users/35f73f39b80b4db088b97f8c83c4795f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:42.387480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:42.405459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777be81-b2e4-4fef-9616-14f1cce0eda6 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:42.663919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:42.666159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:42.668780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:42.668780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users/dda8a14e4365417d812cd07f82456181` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:42.673732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dda8a14e4365417d812cd07f82456181)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:42.681323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:42.800113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.801101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.802340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.815784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.833839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda8a14e4365417d812cd07f82456181'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:42.866175 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3044/6139] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:42 2022] DELETE /identity/v3/users/dda8a14e4365417d812cd07f82456181 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:42.870512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:42.872349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:42.894314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec251-0a9b-4bfe-b2ca-15baf9fa4566 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.034463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.035281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.035699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.036071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/b1328c394d7741eca7835f27f65d8227` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.037533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b1328c394d7741eca7835f27f65d8227)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.039727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.107604 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3096/6140] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:42 2022] DELETE /identity/v3/groups/b1328c394d7741eca7835f27f65d8227 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:43.114297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.116357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:43.147727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18400-82f2-49e9-9431-8640b3efcf07 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.205898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:43.244398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.245643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.246332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.246830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.247767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.250145 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:43.250145 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:19:43.250145 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:19:43.252891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.282130 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3045/6141] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:43 2022] POST /identity/v3/groups => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:43.284804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.304115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89ce7-884a-49c0-aaed-7105a36746fe tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.317712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.319324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.319674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.319887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.322939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.324972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.379518 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3097/6142] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:43 2022] POST /identity/v3/groups => generated 326 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:43.385322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.400537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b19fc-8fcf-4142-8c87-b2b71d51dd70 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.405770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.406374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.406706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.407348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.407631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.409612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.427639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3046/6143] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:43 2022] POST /identity/v3/groups => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:43.432268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.446828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ecff-a650-4fe7-b45a-576b52915f04 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.452277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.452898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.453213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.453485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.454129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.455389 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:19:43.455389 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:19:43.455389 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:19:43.456436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.478173 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3098/6144] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:19:43 2022] GET /identity/v3/groups => generated 1490 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:43.481001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.494174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728c10c-8161-4174-99e3-881adae95e52 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.499708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.500421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.500777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.501152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/9d6baff1b1de4beaa7112707602742fb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.507312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9d6baff1b1de4beaa7112707602742fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.509942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.593181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.600439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3047/6145] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:43 2022] DELETE /identity/v3/groups/9d6baff1b1de4beaa7112707602742fb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:43.617117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309badc-88e6-4d06-8fff-256ac95755fc tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.639920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:43.692392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.693748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.693964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.694249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/4d4de65b12a24682aec581f968611d6d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.701560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4d4de65b12a24682aec581f968611d6d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.703625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.773009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3099/6146] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:43 2022] DELETE /identity/v3/groups/4d4de65b12a24682aec581f968611d6d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:43.774355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.788774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692b87-6470-4129-9462-07d1b338fc15 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:43.871198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:43.872143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:43.872613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:43.873150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/7ed41ea318b7415b8b17b8a3d5bbeb6f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:43.881314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7ed41ea318b7415b8b17b8a3d5bbeb6f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:43.883946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:43.969134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3048/6147] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:43 2022] DELETE /identity/v3/groups/7ed41ea318b7415b8b17b8a3d5bbeb6f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:43.971580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:43.987184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c945-6756-4e46-8b1f-2b5e70095a5d tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.132943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.133625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.134964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.135282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.136566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.139180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.160391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.164116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:44.198248 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3100/6148] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:43 2022] POST /identity/v3/users => generated 323 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:44.202417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.232588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc1c0-b83b-42f1-951b-7c8cbe01ced8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.234302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:44.247492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.248091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.250139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.251141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.253754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.260998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.297539 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3101/6149] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:44 2022] POST /identity/v3/groups => generated 327 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:44.301796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.325691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c3d3-8fbc-449a-97c7-3237065525bf tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.326142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76677-b478-46f6-8e4e-8a0849530806 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.340671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.343171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.344156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.344467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.344848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.345383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/2bd24f260a3444878d9ee753f88754d9/users/de9dd4eb6dde4f298920558d166580cb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.345847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.346803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] PATH_INFO: `/v3/users/2c1df28a9d734105b8c99def44cbebbb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.349235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1df28a9d734105b8c99def44cbebbb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.351868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.398506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2bd24f260a3444878d9ee753f88754d9, user_id=de9dd4eb6dde4f298920558d166580cb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.402763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.459014 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3102/6150] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:19:44 2022] PUT /identity/v3/groups/2bd24f260a3444878d9ee753f88754d9/users/de9dd4eb6dde4f298920558d166580cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:44.460937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.463429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1df28a9d734105b8c99def44cbebbb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:44.465043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1df28a9d734105b8c99def44cbebbb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:44.465877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1df28a9d734105b8c99def44cbebbb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:44.481747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1df28a9d734105b8c99def44cbebbb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:44.489536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:44.503054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1df28a9d734105b8c99def44cbebbb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:44.539119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3049/6151] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:44 2022] DELETE /identity/v3/users/2c1df28a9d734105b8c99def44cbebbb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:44.582543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4dd51-8130-4277-aa3f-239f84729a9a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.756478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.757989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.757989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.757989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.758816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.761627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.787222 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3103/6152] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:44 2022] POST /identity/v3/groups => generated 326 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:44.792180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.793941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:44.820716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41e31-3bd4-4747-9698-2b9d403102e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:44.835375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:44.836067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:44.837587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:44.837872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/9a2f77cc1ffd4eb4a432d0183c739d61/users/de9dd4eb6dde4f298920558d166580cb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:44.855701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9a2f77cc1ffd4eb4a432d0183c739d61, user_id=de9dd4eb6dde4f298920558d166580cb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:44.857681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:44.929419 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3050/6153] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:19:44 2022] PUT /identity/v3/groups/9a2f77cc1ffd4eb4a432d0183c739d61/users/de9dd4eb6dde4f298920558d166580cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:44.934495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:44.946899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb1bb0-b4ff-4050-afdf-4464ba839d8a tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.007994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.010766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.109998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.111069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.111069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.111303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users/de9dd4eb6dde4f298920558d166580cb/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.112797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=de9dd4eb6dde4f298920558d166580cb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.117053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.161192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3104/6154] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:19:44 2022] GET /identity/v3/users/de9dd4eb6dde4f298920558d166580cb/groups => generated 839 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:45.162169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.171141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16953-2492-4c2c-8f3f-cca6cfb2b786 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.180975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.181641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.181919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.182191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] PATH_INFO: `/v3/projects/513259eefe5a40a3aa16b9c611d655b2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.189292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0ed1-5923-49c2-8ccc-a0e6ef148582 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.190875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513259eefe5a40a3aa16b9c611d655b2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.192993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.197764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.198907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.199387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.199869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/9a2f77cc1ffd4eb4a432d0183c739d61` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.201874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9a2f77cc1ffd4eb4a432d0183c739d61)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.204035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.230319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:45.297623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:45.301005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513259eefe5a40a3aa16b9c611d655b2', 'request_id': 'req-79449b4b-397c-48d8-9e45-a43601dad115'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.314701 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3105/6155] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:45 2022] DELETE /identity/v3/groups/9a2f77cc1ffd4eb4a432d0183c739d61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:45.320155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513259eefe5a40a3aa16b9c611d655b2', 'request_id': 'req-79449b4b-397c-48d8-9e45-a43601dad115'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.320553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.340725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513259eefe5a40a3aa16b9c611d655b2', 'request_id': 'req-79449b4b-397c-48d8-9e45-a43601dad115'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.368335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] The token cache is being invalidate because project 513259eefe5a40a3aa16b9c611d655b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:45.369001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.369930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-79449b4b-397c-48d8-9e45-a43601dad115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.375848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3051/6156] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:45 2022] DELETE /identity/v3/projects/513259eefe5a40a3aa16b9c611d655b2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:45.377758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920562-434a-4cbf-b62e-dc4b7f2e58d6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.378259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920562-434a-4cbf-b62e-dc4b7f2e58d6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.378741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920562-434a-4cbf-b62e-dc4b7f2e58d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.412004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5b920562-434a-4cbf-b62e-dc4b7f2e58d6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:45.414878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b920562-434a-4cbf-b62e-dc4b7f2e58d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.468344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1d8f-a4bd-4f9d-9fbd-45b91d38b1f8 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.474405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.475119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.475396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.475674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/groups/2bd24f260a3444878d9ee753f88754d9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.477023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2bd24f260a3444878d9ee753f88754d9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.479326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.548311 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3052/6157] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:45.550658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.551127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.551412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.573485 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3106/6158] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:19:45 2022] DELETE /identity/v3/groups/2bd24f260a3444878d9ee753f88754d9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:45.577760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.585612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:45.586939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.591550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.719959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3053/6159] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:45.721033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.725092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809a67-bb07-4450-96c0-91db153cfd68 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.735036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.736032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.736264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c72f7-895d-4c1a-818a-4afcf8a01853 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.737662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.738119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/users/de9dd4eb6dde4f298920558d166580cb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.739586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_user(user_id=de9dd4eb6dde4f298920558d166580cb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.741806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.742503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.743755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.744216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.745870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.745870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:45.745870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.748180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.776350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3054/6160] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:45.777680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.810446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d8cc-9567-4a78-b872-76dc3c8c3b84 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:45.822902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:45.825164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:45.827089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:45.827317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:45.829403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:45.833229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:45.838136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9dd4eb6dde4f298920558d166580cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.838953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9dd4eb6dde4f298920558d166580cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.850734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9dd4eb6dde4f298920558d166580cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.855183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:45.866730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9dd4eb6dde4f298920558d166580cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.867826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9dd4eb6dde4f298920558d166580cb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:45.904738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3055/6161] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:45 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:45.905865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.908962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.913013 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3107/6162] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:45 2022] DELETE /identity/v3/users/de9dd4eb6dde4f298920558d166580cb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:45.918855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:45.921817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:45.939490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:46.021361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f7cf-f98e-4bae-ac30-3f280ec74119 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.029276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.030375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.030809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.031464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/domains/4f6a55091b034efdb34d4aff94f9af7a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.034168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4f6a55091b034efdb34d4aff94f9af7a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.036757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.131827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc993a8-6f04-4e37-8359-4f80c9a78ba1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.135692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.137798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.182140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.182823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.188399 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3108/6163] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:19:45 2022] PATCH /identity/v3/domains/4f6a55091b034efdb34d4aff94f9af7a => generated 277 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:19:46.198568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:46.198568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:46.311346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f181-6b04-4af7-b8d0-9cea7cf69404 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.317893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971e27fb8ec74ee997c27e6ecc5f3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b0a935b82f484394555a3ab82daad7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.318549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.318911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.319187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] PATH_INFO: `/v3/domains/4f6a55091b034efdb34d4aff94f9af7a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.322882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.324361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.324749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.325150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.325886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.327924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.338056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4f6a55091b034efdb34d4aff94f9af7a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.339702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.378475 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3056/6164] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:45 2022] POST /identity/v3/users => generated 302 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:46.382498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:46.384548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:46.400245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d82f-e1ec-4d3f-920f-02b7e388e155 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.406764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.418312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.425140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:46.533950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.554626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.558509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.559405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.563125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.563440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.564381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.566058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.572707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.599011 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3057/6165] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:46.601537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:46.601972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] The token cache is being invalidate because project 4f6a55091b034efdb34d4aff94f9af7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:46.606932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.608494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.619778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.626023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.626916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4f6a55091b034efdb34d4aff94f9af7a', 'request_id': 'req-f2c9ce71-3eec-48aa-9325-4f5e97d71452'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.639977 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3109/6166] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:19:46 2022] DELETE /identity/v3/domains/4f6a55091b034efdb34d4aff94f9af7a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:46.641070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:46.642685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:46.644408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ee26-89a6-4961-b53c-d6fb30fe2252 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.736767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:46.776942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.777596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.777874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.778144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.779725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.781986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.817938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3058/6167] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:46.819099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9ce71-3eec-48aa-9325-4f5e97d71452 tempest-GroupsV3TestJSON-1538498888 tempest-GroupsV3TestJSON-1538498888-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.819243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:46.821883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:46.830938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.834821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.835163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.835559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] PATH_INFO: `/v3/users/136b8c7d428a4780b284456806c2c6da` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.841416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=136b8c7d428a4780b284456806c2c6da)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.846631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.849750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bba61-3f10-474f-965c-d457af099d69 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:46.865731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:46.867939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.867939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.867939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] PATH_INFO: `/v3/projects/17006b77eab04eb0908835f557b1fb0e/users/e94c69481f494c3db7be1b1471fea7ff/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.909910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17006b77eab04eb0908835f557b1fb0e, user_id=e94c69481f494c3db7be1b1471fea7ff, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:46.916482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395a078-edec-490c-ae2c-63f850b1c36a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:46.948660 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3059/6168] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:46 2022] PUT /identity/v3/projects/17006b77eab04eb0908835f557b1fb0e/users/e94c69481f494c3db7be1b1471fea7ff/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:46.969498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:46.969816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:46.984523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:46.985651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136b8c7d428a4780b284456806c2c6da'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:46.986655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136b8c7d428a4780b284456806c2c6da'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.014900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136b8c7d428a4780b284456806c2c6da'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.033137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136b8c7d428a4780b284456806c2c6da'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.034471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58305bdf-9fe5-4470-bc7a-fa72b6568e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136b8c7d428a4780b284456806c2c6da'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.084303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:47.085550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] MFA Rules not processed for user `e94c69481f494c3db7be1b1471fea7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:47.086942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.105823 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3110/6169] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:46 2022] DELETE /identity/v3/users/136b8c7d428a4780b284456806c2c6da => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:47.111226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.112106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.112106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.170596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:47.171781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.237135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3060/6170] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:47.253941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:47.256047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.335369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3111/6171] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:47.347934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:47.349537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.384537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877d13-f184-4e8f-adc6-e37e91520cbc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:47.392888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:47.393831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.394307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.394747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] PATH_INFO: `/v3/users/e94c69481f494c3db7be1b1471fea7ff` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.396474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94c69481f494c3db7be1b1471fea7ff)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:47.399405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:47.479069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:47.481164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94c69481f494c3db7be1b1471fea7ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.482166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94c69481f494c3db7be1b1471fea7ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.482986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94c69481f494c3db7be1b1471fea7ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.495251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94c69481f494c3db7be1b1471fea7ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.500068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18894-7cd6-4869-9a9e-0794f14191b8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:47.504860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-56c7e462-182c-46dd-9b2f-e17ffbe54507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94c69481f494c3db7be1b1471fea7ff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:47.526162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:47.526793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.527070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.527339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.528980 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3061/6172] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:47 2022] DELETE /identity/v3/users/e94c69481f494c3db7be1b1471fea7ff => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:47.532478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.533669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.533954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.534372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.558127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:47.559833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:47.561888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:47.573504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.605016 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3112/6173] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:19:47.669295 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3062/6174] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:47.676570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:47.679581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.702410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9342b-435d-4941-9873-cd6aa59af971 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:47.795465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:47.796078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.797084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.797368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.810331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:47.813584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:47.845184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3113/6175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:48.153827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:48.157471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:48.181437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1848054-f1f8-4b20-8be6-b23552fe348e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:48.200545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:48.201955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:48.203775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:48.204179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] PATH_INFO: `/v3/projects/d5a9fe1de511423fb3da822dd9f429e9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:48.208860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a9fe1de511423fb3da822dd9f429e9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:48.213962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:48.365023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a9fe1de511423fb3da822dd9f429e9', 'request_id': 'req-f9e93642-6107-4d9d-b342-696858d3918e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.377932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a9fe1de511423fb3da822dd9f429e9', 'request_id': 'req-f9e93642-6107-4d9d-b342-696858d3918e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.388174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a9fe1de511423fb3da822dd9f429e9', 'request_id': 'req-f9e93642-6107-4d9d-b342-696858d3918e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.405277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] The token cache is being invalidate because project d5a9fe1de511423fb3da822dd9f429e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:48.405589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.407769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.411714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3063/6176] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:48 2022] DELETE /identity/v3/projects/d5a9fe1de511423fb3da822dd9f429e9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:48.424239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:48.475010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709a53-9c86-4630-bfd7-69850f21e708 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:48.598383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:48.600778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:48.633030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:48.689811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:48.690554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:48.690931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:48.691306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] PATH_INFO: `/v3/users/971e27fb8ec74ee997c27e6ecc5f3380` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:48.692869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971e27fb8ec74ee997c27e6ecc5f3380)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:48.695131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:48.696947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:48.721823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93642-6107-4d9d-b342-696858d3918e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:48.733480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:48.734133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:48.734407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:48.734670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] PATH_INFO: `/v3/projects/17006b77eab04eb0908835f557b1fb0e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:48.738341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17006b77eab04eb0908835f557b1fb0e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:48.739581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:48.797235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971e27fb8ec74ee997c27e6ecc5f3380'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.797775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971e27fb8ec74ee997c27e6ecc5f3380'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.812852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17006b77eab04eb0908835f557b1fb0e', 'request_id': 'req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.820951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17006b77eab04eb0908835f557b1fb0e', 'request_id': 'req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.840658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971e27fb8ec74ee997c27e6ecc5f3380'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.850792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17006b77eab04eb0908835f557b1fb0e', 'request_id': 'req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.863704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971e27fb8ec74ee997c27e6ecc5f3380'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.864456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9144c5a2-8f41-4643-9177-96b77129d712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971e27fb8ec74ee997c27e6ecc5f3380'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.885564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] The token cache is being invalidate because project 17006b77eab04eb0908835f557b1fb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:48.885947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.887466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f4da11d6-8b1b-4e3f-91d4-07b856d6087c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:48.892284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3064/6177] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:48 2022] DELETE /identity/v3/projects/17006b77eab04eb0908835f557b1fb0e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:48.893466 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3114/6178] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:48 2022] DELETE /identity/v3/users/971e27fb8ec74ee997c27e6ecc5f3380 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:48.902695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:48.903009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:48.903351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:48.938464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:48.940391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.054052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3065/6179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:49.061736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.062024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.062298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.084094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:49.086191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.104716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3115/6180] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:49.105672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.124214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee76ee-c597-436d-bc2e-ce16d0f526ae None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.130033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.131958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.131958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.131958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.132772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:49.133205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.135956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.153957 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3066/6181] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:19:49.158082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.171258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857be968-b9f2-4916-853a-6e988346e1d8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.177215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.178492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.178983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.179447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.180294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.183194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.222547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3116/6182] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:49.223510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.235557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f823-74fb-41ef-b423-de64918c9e30 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.284956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.286839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.322419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.328958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.328958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.328958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.328958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.328958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.338123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:49.356857 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3067/6183] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:49.361026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.376299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f058a-703d-4ef2-a990-da6d0c6142f9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.383294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.384571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.385358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.385533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.386228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.388863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.404869 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3068/6184] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:49.409441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.422478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b816f4-a23a-489d-ab25-44a4df5d7b6c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.428622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.429445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.429722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.429990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.430656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.430766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2ee19-8698-4b79-96df-e95359cc9c20 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.432372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.437513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.438164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.438439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.438756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] PATH_INFO: `/v3/projects/22b0a935b82f484394555a3ab82daad7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.440553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b0a935b82f484394555a3ab82daad7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.443015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.446229 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3069/6185] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:49.450298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.463290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b74b-f2e1-4064-970e-afff53528efd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.472930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.473915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.474395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.475033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] PATH_INFO: `/v3/projects/7618d7c422b941d4925e0a9f864370b6/users/7096cf2680c24b10a26cfb8ef784533a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.503010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7618d7c422b941d4925e0a9f864370b6, user_id=7096cf2680c24b10a26cfb8ef784533a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.516276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26758-9916-4c1a-bdec-338a35ef520e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.518191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:49.550013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b0a935b82f484394555a3ab82daad7', 'request_id': 'req-f3ecf6a2-2832-45c9-8b56-9492652f96e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:49.554316 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3070/6186] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:49 2022] PUT /identity/v3/projects/7618d7c422b941d4925e0a9f864370b6/users/7096cf2680c24b10a26cfb8ef784533a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:49.558537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b0a935b82f484394555a3ab82daad7', 'request_id': 'req-f3ecf6a2-2832-45c9-8b56-9492652f96e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:49.565330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.565655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.565937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.574482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b0a935b82f484394555a3ab82daad7', 'request_id': 'req-f3ecf6a2-2832-45c9-8b56-9492652f96e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:49.624084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] The token cache is being invalidate because project 22b0a935b82f484394555a3ab82daad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:49.624398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:49.625371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f3ecf6a2-2832-45c9-8b56-9492652f96e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:49.629172 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3117/6187] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:49 2022] DELETE /identity/v3/projects/22b0a935b82f484394555a3ab82daad7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:49.635322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160dac-fb7f-4157-a081-6123e291e733 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.635971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160dac-fb7f-4157-a081-6123e291e733 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.635971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160dac-fb7f-4157-a081-6123e291e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.652835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] MFA Rules not processed for user `7096cf2680c24b10a26cfb8ef784533a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:49.653989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.680034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ae160dac-fb7f-4157-a081-6123e291e733 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:49.681356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ae160dac-fb7f-4157-a081-6123e291e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.796692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3071/6188] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:49.801265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.804034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.820461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3118/6189] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:49.829667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.829948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.830218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.839425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe8234-cc42-4683-aa97-0a07b7186875 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:49.853888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:49.854517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.854795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.855065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.858908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:49.861043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:49.884428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:49.886343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:49.907131 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3119/6190] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:49.908643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.913235 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3072/6191] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:49.914422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:49.926391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c224-f215-4a7d-a839-ba40494d2324 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.029312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.030032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.030815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.030815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.031224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:50.031525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.035579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.050852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc50cb-a4c9-4158-9aba-0075eec5145b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.051079 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3120/6192] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:50.055172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.058224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.058855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.059460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.059667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.060612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.066498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.089461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d96ba7-fbac-486b-a58f-0eb6889a3a78 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.095238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.095995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.096343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.096958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.100877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.108057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.126100 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3073/6193] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:50.130089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.143710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:50.147993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29ef1-48fa-4c66-ba7c-62b4bdadb315 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.158350 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3121/6194] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:50.161973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.162678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.162965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.163234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.163570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.163891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.166279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.203945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3074/6195] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:19:50.219408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.227227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:50.248100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d869-4691-42fd-bdff-a617e0b0c357 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.299793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295247e-f0d0-40a7-85c9-e3cf82458f3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.306567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.307228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.307608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.307976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.308764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.311647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.357147 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3122/6196] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:50.358264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.373066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d4ae-0451-41ec-88b7-454c0df6d7ff admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.380737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.381476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.381980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.382242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.382370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.383123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.383257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.384134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.384508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] PATH_INFO: `/v3/projects/46d77da51e9d4f14a1c54ed23632d454/users/ae33bc0eeac445a896a88eb07b14ecfb/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.385681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.398156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3123/6197] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:50.403339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.408100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d77da51e9d4f14a1c54ed23632d454, user_id=ae33bc0eeac445a896a88eb07b14ecfb, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.411112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.415527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef570-eee2-4543-b8de-08d55ef4b962 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.421063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.421682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.422010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.422673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.423230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.425169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.431629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3075/6198] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:50 2022] PUT /identity/v3/projects/46d77da51e9d4f14a1c54ed23632d454/users/ae33bc0eeac445a896a88eb07b14ecfb/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:50.435962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.445517 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3124/6199] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:50.447567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.460386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974663-441a-4943-bb7a-09e6ca754d7f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.516073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ab62-04d4-42ac-95d5-5fa71f905fa7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.521700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.522426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.522713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.522984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.524889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.526948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.539074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.540030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.540156 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3076/6200] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:50.541272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.541787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] PATH_INFO: `/v3/projects/a2a543c2d7154fd090bf79fda4c5586c/users/b1e48766510741de827906d91b759186/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.544926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.557599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5788-dcfc-48db-8cda-f74e9a80eb41 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.560038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a543c2d7154fd090bf79fda4c5586c, user_id=b1e48766510741de827906d91b759186, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.563413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.563607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125c01a-9ff3-4136-a17a-896cb715f58d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.564975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.565339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.565685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] PATH_INFO: `/v3/projects/46d77da51e9d4f14a1c54ed23632d454/users/ae33bc0eeac445a896a88eb07b14ecfb/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.568357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d77da51e9d4f14a1c54ed23632d454, user_id=ae33bc0eeac445a896a88eb07b14ecfb, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.572171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c4639-cf9b-42df-9c08-c4207701c258 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.591746 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3077/6201] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:50 2022] PUT /identity/v3/projects/46d77da51e9d4f14a1c54ed23632d454/users/ae33bc0eeac445a896a88eb07b14ecfb/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:50.604220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3125/6202] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:50 2022] PUT /identity/v3/projects/a2a543c2d7154fd090bf79fda4c5586c/users/b1e48766510741de827906d91b759186/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:50.604614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.604934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.605319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.619950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.620241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.620517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.641212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] MFA Rules not processed for user `ae33bc0eeac445a896a88eb07b14ecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:50.642822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:50.660535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] MFA Rules not processed for user `b1e48766510741de827906d91b759186`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:50.662211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:50.726994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:50.760190 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3126/6203] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:50.761562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.769245 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3078/6204] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:50.770112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.776086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:50.784718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb1c6-5410-441f-bd6d-f0999c365cd6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.791500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.792514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.793008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.793619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.794263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.796160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.859692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3079/6205] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/projects => generated 350 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:50.861376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:50.879252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed938488-1a9d-49cc-bd9a-8d07d5f191a3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.963050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eea41-3fb7-490d-947e-ff554a1c8fcf tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:50.967198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.967931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.968305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.969648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.969648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.970480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:50.971264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:50.971707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:50.972139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:50.972740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:50.974062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:50.976363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.024515 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3127/6206] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:51.028767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.032953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3080/6207] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:50 2022] POST /identity/v3/projects => generated 350 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:51.035103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.121277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22284b5-46c0-4f8b-9361-9f6a8c65cca3 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.127543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.128260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.128641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.129058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/users/7096cf2680c24b10a26cfb8ef784533a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.129309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018bc9-96a2-4f2f-83e7-54c8b38a69d5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.130947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:get_user(user_id=7096cf2680c24b10a26cfb8ef784533a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.137981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.140649 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3081/6208] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:19:51 2022] GET /identity/v3/users/7096cf2680c24b10a26cfb8ef784533a => generated 288 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:51.144451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.159616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d23322-2b87-4d6f-a3d8-e214cc77f7ef tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.181536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.182171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.182484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.182789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.184104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.187411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.208310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:51.237280 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3082/6209] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/credentials => generated 430 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:51.238428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.246128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.247876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.248386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.249059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.250157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.253274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b21-44ea-47b8-be24-c0d2dc29b607 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.253989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.259772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.260830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.260830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.261755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.264313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.267120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.270816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.272551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.295660 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3083/6210] 10.222.0.16 () {60 vars in 1358 bytes} [Fri Oct 28 10:19:51 2022] PATCH /identity/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca => generated 436 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:51.299603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.300368 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3128/6211] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:51.306200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.319218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad428f29-0ca4-4614-8673-353c4284f1c7 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.326558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.327424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.327852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.328167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.330517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495d93-5e3c-40c7-a51e-2f8f6cbf80cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.330730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.332731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.339676 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3084/6212] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Oct 28 10:19:51 2022] GET /identity/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca => generated 436 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:51.340597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.346726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.347363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.347642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.347912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.348705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.350350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.351725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a93c-d7e6-49c7-921a-a27c816245a4 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.357551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.358193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.358473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.358749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.366379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.367735 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3129/6213] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:51.368968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.369595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.381371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7441e-6981-4035-ba65-21744acd3f3e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.401531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.402231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.402515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.403473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] PATH_INFO: `/v3/projects/5515daf060f34e56a179aad16fb483f5/users/08e8ec23fa2843418ec3f662486f6bed/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.413350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3085/6214] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Oct 28 10:19:51 2022] DELETE /identity/v3/credentials/1d11129be25a5fafc4b3800c9a5c93d856d9452db8ebbb656481cfbfb222c2ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:51.418546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.431212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd1d9-dd8c-4ccc-9081-d7fc854bd2d9 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.441922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.442688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.443167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.443567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.444868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.446789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5515daf060f34e56a179aad16fb483f5, user_id=08e8ec23fa2843418ec3f662486f6bed, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.447258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.449969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.454513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:51.473556 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3130/6215] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:51 2022] PUT /identity/v3/projects/5515daf060f34e56a179aad16fb483f5/users/08e8ec23fa2843418ec3f662486f6bed/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:51.478111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.481244 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3086/6216] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/credentials => generated 431 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:51.495955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.507963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354687-d77a-448d-a3e1-22b7e82450fd tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.572894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46ea46-bfb0-4c60-a531-154e9909672c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.583701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.584496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.584839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.585205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.585866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.588186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.600434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.601730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.605272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.605601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.606289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.608225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.622136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3087/6217] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/credentials => generated 430 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:51.622960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.637702 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3131/6218] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:51.642263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.647524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029773-db62-440a-9b68-f5ee9e238880 tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.655476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5cc1a-a198-4c66-8c0b-d89e5f3c79f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.657699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.658425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.658788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.659066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.659676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.660726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.661381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.661558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.661910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.662306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] PATH_INFO: `/v3/projects/5515daf060f34e56a179aad16fb483f5/users/08e8ec23fa2843418ec3f662486f6bed/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.665672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5515daf060f34e56a179aad16fb483f5, user_id=08e8ec23fa2843418ec3f662486f6bed, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.669042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2f27-54c6-4db5-a9f4-63faec0e7a3e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.681736 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3132/6219] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:51 2022] PUT /identity/v3/projects/5515daf060f34e56a179aad16fb483f5/users/08e8ec23fa2843418ec3f662486f6bed/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:51.685108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.687380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.693962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.696580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c290f-1e68-423a-9da1-189914247220 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.697205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c290f-1e68-423a-9da1-189914247220 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.697635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c290f-1e68-423a-9da1-189914247220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.703453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.707555 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3088/6220] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 10:19:51 2022] GET /identity/v3/credentials => generated 946 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:51.712465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.730817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41250f-1d8b-4db3-b94e-cef472c5481b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.757548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c17c290f-1e68-423a-9da1-189914247220 None None] MFA Rules not processed for user `08e8ec23fa2843418ec3f662486f6bed`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:51.759623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c17c290f-1e68-423a-9da1-189914247220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:51.829195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.830287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.831385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.834121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials/dd8c7b20660fba367d61a2956b744fcef7861f939b05740a6da41f7488fbb929` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.837173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=dd8c7b20660fba367d61a2956b744fcef7861f939b05740a6da41f7488fbb929)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.842649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.879623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3133/6221] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:51.880596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c290f-1e68-423a-9da1-189914247220 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.881680 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3089/6222] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Oct 28 10:19:51 2022] DELETE /identity/v3/credentials/dd8c7b20660fba367d61a2956b744fcef7861f939b05740a6da41f7488fbb929 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:51.885597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.892725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c290f-1e68-423a-9da1-189914247220 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.919021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615aeaf0-213b-44ac-a600-2016ecc893be tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:51.920065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e8ec23fa2843418ec3f662486f6bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5515daf060f34e56a179aad16fb483f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.921382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.921887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.922398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.923606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.932783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.944029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:51.947000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:51.952754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:51.952754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:51.952754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/credentials/b13375ac7bf275a2280cdf0c20be8c8e06996b734809d6e664116ee12f876c98` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:51.953780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b13375ac7bf275a2280cdf0c20be8c8e06996b734809d6e664116ee12f876c98)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:51.958810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:51.990731 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3134/6223] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:51 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:51.992257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:51.997487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3090/6224] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Oct 28 10:19:51 2022] DELETE /identity/v3/credentials/b13375ac7bf275a2280cdf0c20be8c8e06996b734809d6e664116ee12f876c98 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:51.998859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.015457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59274-6df7-412f-bcf3-34b77d3f81fb tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.112468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75d95-4e89-41a5-9461-fa66718fb063 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.117870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e48766510741de827906d91b759186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a543c2d7154fd090bf79fda4c5586c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.118941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.119219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.119490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] PATH_INFO: `/v3/projects/f27cc3b4adc64b5ca0eead9822f1e614` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.120728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] RBAC: Authorizing `identity:delete_project(project_id=f27cc3b4adc64b5ca0eead9822f1e614)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 28 10:19:52.134135 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 28 10:19:52.135181 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:19:52.137344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3135/6225] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:51 2022] DELETE /identity/v3/projects/f27cc3b4adc64b5ca0eead9822f1e614 => generated 136 bytes in 146 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:19:52.141836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.254760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa1951-8223-4a61-b639-c78b5d8358a2 tempest-ProjectsNegativeTestJSON-339916487 tempest-ProjectsNegativeTestJSON-339916487-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.262285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08e8ec23fa2843418ec3f662486f6bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5515daf060f34e56a179aad16fb483f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.263462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.263908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.264366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] PATH_INFO: `/v3/projects/f27cc3b4adc64b5ca0eead9822f1e614` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.266670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f27cc3b4adc64b5ca0eead9822f1e614)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:52.278004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:52.292530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.311481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.312486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.312872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.313273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/projects/bc796945055d443783ff74d38af11096` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.315619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc796945055d443783ff74d38af11096)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:52.318139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:52.358610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27cc3b4adc64b5ca0eead9822f1e614', 'request_id': 'req-c0e294b3-8169-4af2-b24a-c843401f04a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.370085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27cc3b4adc64b5ca0eead9822f1e614', 'request_id': 'req-c0e294b3-8169-4af2-b24a-c843401f04a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.381537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27cc3b4adc64b5ca0eead9822f1e614', 'request_id': 'req-c0e294b3-8169-4af2-b24a-c843401f04a1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.397640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] The token cache is being invalidate because project f27cc3b4adc64b5ca0eead9822f1e614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:52.398489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.398947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc796945055d443783ff74d38af11096', 'request_id': 'req-42eab50c-fbee-41b2-94f9-7917f556e74a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.400189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.406373 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3136/6226] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:52 2022] DELETE /identity/v3/projects/f27cc3b4adc64b5ca0eead9822f1e614 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:52.407839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.409627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:52.413974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc796945055d443783ff74d38af11096', 'request_id': 'req-42eab50c-fbee-41b2-94f9-7917f556e74a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.426778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc796945055d443783ff74d38af11096', 'request_id': 'req-42eab50c-fbee-41b2-94f9-7917f556e74a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.448043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.448299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] The token cache is being invalidate because project bc796945055d443783ff74d38af11096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:52.449421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.450856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.453475 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3091/6227] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:51 2022] DELETE /identity/v3/projects/bc796945055d443783ff74d38af11096 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:52.457641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.466890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:52.499214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e294b3-8169-4af2-b24a-c843401f04a1 tempest-ProjectsNegativeTestJSON-1993614319 tempest-ProjectsNegativeTestJSON-1993614319-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.578819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.579814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.580262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab50c-fbee-41b2-94f9-7917f556e74a tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.580989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.581276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] PATH_INFO: `/v3/users/b1e48766510741de827906d91b759186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.582735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e48766510741de827906d91b759186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:52.584798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:52.596789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae33bc0eeac445a896a88eb07b14ecfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46d77da51e9d4f14a1c54ed23632d454', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.604243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.604553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.604834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] PATH_INFO: `/v3/projects/30aff4f59d884981816cbe9793ed72a6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.611259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30aff4f59d884981816cbe9793ed72a6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:52.618925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:52.673639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e48766510741de827906d91b759186'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.677529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e48766510741de827906d91b759186'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.695427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e48766510741de827906d91b759186'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.711211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e48766510741de827906d91b759186'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.713538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30aff4f59d884981816cbe9793ed72a6', 'request_id': 'req-1c01b478-4eef-4cee-81aa-2acaf2ab237b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.713907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-270e7c48-cfc1-4e99-b73c-9fc90b3445f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e48766510741de827906d91b759186'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.723447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30aff4f59d884981816cbe9793ed72a6', 'request_id': 'req-1c01b478-4eef-4cee-81aa-2acaf2ab237b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.741292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30aff4f59d884981816cbe9793ed72a6', 'request_id': 'req-1c01b478-4eef-4cee-81aa-2acaf2ab237b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.755863 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3137/6228] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:52 2022] DELETE /identity/v3/users/b1e48766510741de827906d91b759186 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:52.758498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.759123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.759574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:52.773921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] The token cache is being invalidate because project 30aff4f59d884981816cbe9793ed72a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:52.775668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.776572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:52.784432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3092/6229] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:52 2022] DELETE /identity/v3/projects/30aff4f59d884981816cbe9793ed72a6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:52.785752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:52.787904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:52.794924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.802700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:52.864380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.869321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.895348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3138/6230] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:52.904183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:52.907769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:52.988491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b478-4eef-4cee-81aa-2acaf2ab237b tempest-CredentialsTestJSON-976943700 tempest-CredentialsTestJSON-976943700-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:52.996662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:52.997849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:52.998129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:52.998397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] PATH_INFO: `/v3/users/7096cf2680c24b10a26cfb8ef784533a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.000260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7096cf2680c24b10a26cfb8ef784533a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:53.002244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:53.055592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f0b53-cbd8-4ea9-8f10-2c3627f57156 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:53.060417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:53.061220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:53.061629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:53.062005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.076957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:53.078524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be16cd-290c-4626-9fda-60853c23d1fa service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:53.089934 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3139/6231] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:53.107716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7096cf2680c24b10a26cfb8ef784533a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.108488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7096cf2680c24b10a26cfb8ef784533a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.109223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7096cf2680c24b10a26cfb8ef784533a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.119694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7096cf2680c24b10a26cfb8ef784533a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.129446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7096cf2680c24b10a26cfb8ef784533a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.156012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3093/6232] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:52 2022] DELETE /identity/v3/users/7096cf2680c24b10a26cfb8ef784533a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:53.160374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:53.161053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:53.161512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.196372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:53.200085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:53.311342 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3140/6233] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:53.334331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:53.336178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:53.443809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888bed-229f-4d61-b457-0692b9d75f4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:53.458159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:53.458913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:53.459138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:53.459408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.480997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:53.482411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:53.518831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3094/6234] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:53.545353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:53.546962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:53.568248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08b41-7f99-476b-af17-5141b6f013a3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:53.587477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:53.588253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:53.588780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:53.589314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] PATH_INFO: `/v3/projects/a2a543c2d7154fd090bf79fda4c5586c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.590880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a543c2d7154fd090bf79fda4c5586c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:53.595719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:53.710878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a543c2d7154fd090bf79fda4c5586c', 'request_id': 'req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.724128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a543c2d7154fd090bf79fda4c5586c', 'request_id': 'req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.745453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a543c2d7154fd090bf79fda4c5586c', 'request_id': 'req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.771298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] The token cache is being invalidate because project a2a543c2d7154fd090bf79fda4c5586c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:53.773273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.774334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.780379 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3141/6235] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:53 2022] DELETE /identity/v3/projects/a2a543c2d7154fd090bf79fda4c5586c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:53.785596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:53.797556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f997a28-1853-4dd8-959b-5cc10f5d34b7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:53.839898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:53.876639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:53.877506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:53.877851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:53.878176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] PATH_INFO: `/v3/users/08e8ec23fa2843418ec3f662486f6bed` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:53.879355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e8ec23fa2843418ec3f662486f6bed)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:53.882449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:53.976191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e8ec23fa2843418ec3f662486f6bed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.982233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e8ec23fa2843418ec3f662486f6bed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:53.985733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e8ec23fa2843418ec3f662486f6bed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:54.004242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e8ec23fa2843418ec3f662486f6bed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:54.033342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e8ec23fa2843418ec3f662486f6bed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:54.074843 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3095/6236] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:53 2022] DELETE /identity/v3/users/08e8ec23fa2843418ec3f662486f6bed => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:55.054974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:55.057607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:55.095260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527ae3-9e8d-4f41-9acb-5a2aa37be22e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:55.133404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:55.292210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:55.293074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:55.293358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:55.293631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] PATH_INFO: `/v3/projects/7618d7c422b941d4925e0a9f864370b6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:55.296269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7618d7c422b941d4925e0a9f864370b6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:55.300374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:55.421631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7618d7c422b941d4925e0a9f864370b6', 'request_id': 'req-5c9f1396-ea5d-442b-8012-e84a227d709c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.441957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7618d7c422b941d4925e0a9f864370b6', 'request_id': 'req-5c9f1396-ea5d-442b-8012-e84a227d709c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.465258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7618d7c422b941d4925e0a9f864370b6', 'request_id': 'req-5c9f1396-ea5d-442b-8012-e84a227d709c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.491130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] The token cache is being invalidate because project 7618d7c422b941d4925e0a9f864370b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:55.491489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.499437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.501264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3142/6237] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:55 2022] DELETE /identity/v3/projects/7618d7c422b941d4925e0a9f864370b6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:55.504788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:55.506394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:55.529302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047725-231a-4682-84be-dd40fffaeec5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:55.626041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:55.628256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:55.766475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:55.767275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:55.768855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:55.769881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] PATH_INFO: `/v3/users/ae33bc0eeac445a896a88eb07b14ecfb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:55.773098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae33bc0eeac445a896a88eb07b14ecfb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:55.776342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:55.794332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1396-ea5d-442b-8012-e84a227d709c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:55.817209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:55.818985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:55.821757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:55.822170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] PATH_INFO: `/v3/projects/5515daf060f34e56a179aad16fb483f5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:55.823932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5515daf060f34e56a179aad16fb483f5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:55.829142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:55.901140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae33bc0eeac445a896a88eb07b14ecfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.904218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae33bc0eeac445a896a88eb07b14ecfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.905441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae33bc0eeac445a896a88eb07b14ecfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.918364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae33bc0eeac445a896a88eb07b14ecfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.930020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:55.934523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c22f349d-53a0-4f64-8b99-a3deaf8c282d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae33bc0eeac445a896a88eb07b14ecfb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.936305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5515daf060f34e56a179aad16fb483f5', 'request_id': 'req-41b2bddd-09cd-40b1-83cf-8a06d4ece244'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.938227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:55.951293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5515daf060f34e56a179aad16fb483f5', 'request_id': 'req-41b2bddd-09cd-40b1-83cf-8a06d4ece244'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.967302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5515daf060f34e56a179aad16fb483f5', 'request_id': 'req-41b2bddd-09cd-40b1-83cf-8a06d4ece244'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.981769 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3096/6238] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:55 2022] DELETE /identity/v3/users/ae33bc0eeac445a896a88eb07b14ecfb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:55.986106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] The token cache is being invalidate because project 5515daf060f34e56a179aad16fb483f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:55.986508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.988442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41b2bddd-09cd-40b1-83cf-8a06d4ece244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:55.991032 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3143/6239] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:55 2022] DELETE /identity/v3/projects/5515daf060f34e56a179aad16fb483f5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:55.997908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:55.998194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:55.998468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.038010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:56.043350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:56.195488 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3097/6240] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:56.205364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.206361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.207049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.252846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:56.254518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:56.276239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3144/6241] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:56.280925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.298289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c374510-1759-47ba-8bf5-f4a7d62a8055 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.325667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.326606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.326889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.327162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.327827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:56.328127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.329808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.362039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3098/6242] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:56.366595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.395772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa098f-ec0f-492c-b25f-8b51f2e92c4d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.423001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.425948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.432029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.435829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.437165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.439379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.541637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3145/6243] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:56 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:56.545850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.570315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e920de-fb2e-4b20-afc8-63e7b38caf2d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.686180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.686796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.687076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.689568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.690279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.692204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.726025 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3099/6244] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:56 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:56.729767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.745472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a885-0dc5-48d8-b476-27991c7c92c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.752936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.755053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.758268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.758720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.759693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.762641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.781126 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3146/6245] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:56.785853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.803620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7d81-84a8-49d4-a691-e868f98a39b0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.828753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.831045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.831327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.831600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.832260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.835408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609cf0a-f060-40bd-b2fa-a63bd6b7c05b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.853292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3100/6246] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:56.856328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:56.869165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21579108-98fd-4fa0-a68c-3de760167fa0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:56.874178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:56.874858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.875188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.875467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] PATH_INFO: `/v3/projects/7469b48f438546ebbc4a21f0633ebee3/users/a86203775721430082b40bab41b6c9ce/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.893413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7469b48f438546ebbc4a21f0633ebee3, user_id=a86203775721430082b40bab41b6c9ce, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:56.896300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:56.921500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3147/6247] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:56 2022] PUT /identity/v3/projects/7469b48f438546ebbc4a21f0633ebee3/users/a86203775721430082b40bab41b6c9ce/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:56.932138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:56.932415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:56.932843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:56.967622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] MFA Rules not processed for user `a86203775721430082b40bab41b6c9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:56.968896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:57.024804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:57.178055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3101/6248] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:57.179606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.201062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769441-eebd-4219-b04e-4d17ac6f8e9d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:57.210826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86203775721430082b40bab41b6c9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7469b48f438546ebbc4a21f0633ebee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:57.211621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.212009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.212393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] PATH_INFO: `/v3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.214715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3148/6249] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:57.221181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.236581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622592bc-ee7e-4fa6-92d8-dcb730772a56 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:57.253299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c95c4-2150-438a-94b0-bbc20d093736 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86203775721430082b40bab41b6c9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7469b48f438546ebbc4a21f0633ebee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:57.253925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c95c4-2150-438a-94b0-bbc20d093736 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.254203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c95c4-2150-438a-94b0-bbc20d093736 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.254474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c95c4-2150-438a-94b0-bbc20d093736 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] PATH_INFO: `/v3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.261513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3102/6250] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:57.263407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.273677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df625-fe71-4059-b4c4-57b2abf21591 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:57.289352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0192-81c3-4ab8-b1c5-c51f09ff4498 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86203775721430082b40bab41b6c9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7469b48f438546ebbc4a21f0633ebee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:57.290686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0192-81c3-4ab8-b1c5-c51f09ff4498 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.291075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0192-81c3-4ab8-b1c5-c51f09ff4498 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.291448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0192-81c3-4ab8-b1c5-c51f09ff4498 tempest-TestApiDiscovery-1708322468 tempest-TestApiDiscovery-1708322468-project] PATH_INFO: `/v3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.293248 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3149/6251] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/v3 => generated 255 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:57.300539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65490ee-1ed8-44d5-aef7-c67667b54690 None None] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.300814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65490ee-1ed8-44d5-aef7-c67667b54690 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.301112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65490ee-1ed8-44d5-aef7-c67667b54690 None None] PATH_INFO: `/` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.310001 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3103/6252] 10.222.0.16 () {56 vars in 895 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:19:57.311169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ff97-145a-4991-b4ee-9f86a5cada39 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.313724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ff97-145a-4991-b4ee-9f86a5cada39 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.314112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ff97-145a-4991-b4ee-9f86a5cada39 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.321488 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3150/6253] 10.222.0.16 () {56 vars in 895 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:19:57.322730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65490ee-1ed8-44d5-aef7-c67667b54690 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.475019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65490ee-1ed8-44d5-aef7-c67667b54690 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:57.500535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:57.501341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.501689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.502028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] PATH_INFO: `/v3/users/a86203775721430082b40bab41b6c9ce` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.505603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86203775721430082b40bab41b6c9ce)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:57.509843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:57.658383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86203775721430082b40bab41b6c9ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:57.660615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86203775721430082b40bab41b6c9ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:57.662184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86203775721430082b40bab41b6c9ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:57.693533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86203775721430082b40bab41b6c9ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:57.706357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86203775721430082b40bab41b6c9ce'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:57.749735 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3104/6254] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:57 2022] DELETE /identity/v3/users/a86203775721430082b40bab41b6c9ce => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:57.754465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.754855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.755240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.788394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:57.790872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:57.905798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.907525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:57.913917 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3151/6255] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:57.925814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:57.927385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:57.929482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faef023-8e14-4e9c-bf0d-a04234e61772 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:57.943247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:57.943947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:57.944240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:57.944566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] PATH_INFO: `/v3/projects/46d77da51e9d4f14a1c54ed23632d454` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:57.947582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d77da51e9d4f14a1c54ed23632d454)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:57.949568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.044554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:58.051971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d77da51e9d4f14a1c54ed23632d454', 'request_id': 'req-60c9a07a-eeec-455f-886d-4749dc64c711'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:58.060202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995b9c5-951d-4d17-b17a-0a10082ff0df None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.064762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d77da51e9d4f14a1c54ed23632d454', 'request_id': 'req-60c9a07a-eeec-455f-886d-4749dc64c711'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:58.077516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d77da51e9d4f14a1c54ed23632d454', 'request_id': 'req-60c9a07a-eeec-455f-886d-4749dc64c711'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:58.107366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] The token cache is being invalidate because project 46d77da51e9d4f14a1c54ed23632d454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:58.107580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:58.108574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60c9a07a-eeec-455f-886d-4749dc64c711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:58.112039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3105/6256] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:57 2022] DELETE /identity/v3/projects/46d77da51e9d4f14a1c54ed23632d454 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:58.119558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:58.122753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6750-444c-410f-8433-37014fc978ff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.122940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6750-444c-410f-8433-37014fc978ff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.123246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6750-444c-410f-8433-37014fc978ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.156409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4c0e6750-444c-410f-8433-37014fc978ff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:58.157773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c0e6750-444c-410f-8433-37014fc978ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:58.201213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.204762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.205079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.205576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.213516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:58.243679 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3106/6257] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:58.250989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.251355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.252050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.300089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:58.304029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:58.325097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.327344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.329980 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3107/6258] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:58.333805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.343131 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3152/6259] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:58.347170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112920e-d6c3-40a2-8d4a-837f2648a1fe None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.353578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.354261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.354538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.354802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.355452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:58.355802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.357477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.376006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3108/6260] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:58.380732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.395116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7be4-f94a-4c13-a1d9-47b21cfb9c7f service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.400932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.401558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.401921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.402195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.402826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.405018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.438279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3153/6261] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:58 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:58.442186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.455213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b879d10-1bee-4d3b-ac7a-5b17f2d10f06 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.573167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.573963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.574310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.574710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.575447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.579977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.641887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3109/6262] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:58 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:58.643167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.681145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ca63-583f-4d0d-a2c7-62deae8462c8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.696339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.698850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.699722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.703492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.705671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.712779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.730204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.737053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3154/6263] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:58.746791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfac8b-8966-4f0f-aa97-be325e992f60 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.752551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.754247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.755027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.755164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.755894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.757452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad52950-f4b6-40a7-91a3-bbba93ce8760 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.797477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:58.807262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3110/6264] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:19:58.820062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd13a5-ee77-4585-ae28-95eb64c731c3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:58.832719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:58.833303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.833585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.833860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] PATH_INFO: `/v3/projects/2bf337d62ca74c9bad8a010dfecedfcc/users/71b7b1eea7ec4e3ba8f1c6a2983ef8a6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:58.880243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf337d62ca74c9bad8a010dfecedfcc, user_id=71b7b1eea7ec4e3ba8f1c6a2983ef8a6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:58.884004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:58.923359 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3155/6265] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:58 2022] PUT /identity/v3/projects/2bf337d62ca74c9bad8a010dfecedfcc/users/71b7b1eea7ec4e3ba8f1c6a2983ef8a6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:58.936955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:58.937120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:58.937372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.008137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] MFA Rules not processed for user `71b7b1eea7ec4e3ba8f1c6a2983ef8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:59.009998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:59.044427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:59.111091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3111/6266] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:59.115424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.140178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.141943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:59.268879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3965-16c6-458d-81d6-338fb68aa07a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.281072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.293656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.293771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.294065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.302777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.304956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.342308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:59.356633 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3156/6267] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:59 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:59.357813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.370076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0742fa-0868-4abc-bdf2-e196d269a5f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.509302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b90a-766e-4819-b792-5eeb83ef4c19 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.510206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.510859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.511275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.511802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] PATH_INFO: `/v3/projects/7469b48f438546ebbc4a21f0633ebee3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.513462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7469b48f438546ebbc4a21f0633ebee3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.515397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.515820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.516016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.516249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.516520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.517183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.519379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.552600 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3157/6268] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:59 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:59.556706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.571404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9db1d-2cfa-430b-a26e-0c4ca1f71367 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.604841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7469b48f438546ebbc4a21f0633ebee3', 'request_id': 'req-975cdcef-1dcf-4599-8d1c-05e2454b6252'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:59.621755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7469b48f438546ebbc4a21f0633ebee3', 'request_id': 'req-975cdcef-1dcf-4599-8d1c-05e2454b6252'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:59.633940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7469b48f438546ebbc4a21f0633ebee3', 'request_id': 'req-975cdcef-1dcf-4599-8d1c-05e2454b6252'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:59.636752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:59.657171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] The token cache is being invalidate because project 7469b48f438546ebbc4a21f0633ebee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:59.659035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:59.660121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-975cdcef-1dcf-4599-8d1c-05e2454b6252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:59.666688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3112/6269] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:59 2022] DELETE /identity/v3/projects/7469b48f438546ebbc4a21f0633ebee3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:19:59.668367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780428-cfa0-4fe0-a67c-fb6a9c08035e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.668727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780428-cfa0-4fe0-a67c-fb6a9c08035e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.669093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780428-cfa0-4fe0-a67c-fb6a9c08035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.705875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.706600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.706943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.707277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.707983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.709713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.718018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-99780428-cfa0-4fe0-a67c-fb6a9c08035e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:59.719866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-99780428-cfa0-4fe0-a67c-fb6a9c08035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:59.749308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3113/6270] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:59.751732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.752018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.752290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.763524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3158/6271] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:59.764417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.769011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:59.798322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:59.799607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:59.815489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32187d1-b4c1-48e0-b581-a5ba13f0f3c7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.824314 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3114/6272] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:59.829561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.830475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.832475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.832926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.834659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] PATH_INFO: `/v3/projects/5ee59151244f4789a70e89aeb646260a/users/190144d21e254b768c2bb08b5f9f9ed8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.848443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbfb6-1cd5-41cf-b80b-612f7644f983 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.861025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:59.862083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:59.862357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:59.862621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:59.863279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:59.863577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.865206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.897341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee59151244f4789a70e89aeb646260a, user_id=190144d21e254b768c2bb08b5f9f9ed8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:59.901434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:59.926873 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3115/6273] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:59.927436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:59.941309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9d12-237a-476b-a2c4-85bb1824de13 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:59.957805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3159/6274] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:59 2022] PUT /identity/v3/projects/5ee59151244f4789a70e89aeb646260a/users/190144d21e254b768c2bb08b5f9f9ed8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:59.959865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.086075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.087246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.087526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.087794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.090872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682080-9e7a-436a-9009-8769c5d6a787 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.091553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.095909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.097152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.097979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.098550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.098981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.099894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.102084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.106935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:00.118445 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3160/6275] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:00.122197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.139408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba25a-9d62-4e0c-87b8-5a8aa427b9ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.160239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.161305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.161586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.161917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] PATH_INFO: `/v3/projects/5ee59151244f4789a70e89aeb646260a/users/190144d21e254b768c2bb08b5f9f9ed8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.168931 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3116/6276] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:59 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:00.171692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee59151244f4789a70e89aeb646260a, user_id=190144d21e254b768c2bb08b5f9f9ed8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.171848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.173869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc562-7691-4e58-81f6-e781e68b78dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.191467 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3161/6277] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:00 2022] PUT /identity/v3/projects/5ee59151244f4789a70e89aeb646260a/users/190144d21e254b768c2bb08b5f9f9ed8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:00.204231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.206965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.207589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.293325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] MFA Rules not processed for user `190144d21e254b768c2bb08b5f9f9ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:00.298020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:00.335916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf725ac8-6630-4a0a-add5-1909c25c46ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.443478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.444264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.444660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.445067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.446492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.449286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.462331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:00.485462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3117/6278] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/users => generated 290 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:00.491141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.507859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d17e-cc86-4dca-9d93-ec31ce24e28a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.515711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.517270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.517719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.518059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.518834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.521425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.535426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3162/6279] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:00.540185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.542932 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3118/6280] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:00.543955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.554665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce436c-b839-41d9-8b54-4b5e1cffcf5d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.560506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766a7d-6fc2-4d3a-9fe3-30f5ff1c716c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.560679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.561378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.561748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.562086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.562825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.564623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.567315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.568127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.568508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.568963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.569836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.574809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.595672 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3119/6281] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:00.597257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.608717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ecb3-39a1-4d74-b4d5-86fd039618c0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.614676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3163/6282] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/domains => generated 275 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:00.623057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.747300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1016b9-9304-4716-b03f-a6ef866325af tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:00.748393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.749475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.750078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.750078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] PATH_INFO: `/v3/projects/26710937b8c34d3fa18941fa85460e4d/users/9d47e17e736046769741e18be4a51ee8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.765283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:00.766096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.766339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.766615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.767296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.769146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.784423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26710937b8c34d3fa18941fa85460e4d, user_id=9d47e17e736046769741e18be4a51ee8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:00.788892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8eb06-3bca-46f1-9ffb-082cc09ad0f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:00.801951 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3164/6283] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/domains => generated 277 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:00.806647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:00.829468 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3120/6284] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:00 2022] PUT /identity/v3/projects/26710937b8c34d3fa18941fa85460e4d/users/9d47e17e736046769741e18be4a51ee8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:00.831566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:00.831860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:00.832134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:00.892412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] MFA Rules not processed for user `9d47e17e736046769741e18be4a51ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:00.893855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:00.946791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:00.966083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2773f7-9c47-43df-b521-99329c7540f5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.088573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3121/6285] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:01.089904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:01.101780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e240c-dcdc-4955-9c50-7757ec8997c6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.107835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d47e17e736046769741e18be4a51ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26710937b8c34d3fa18941fa85460e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.109143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.109503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.109906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] PATH_INFO: `/v3/domains/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.111233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.113214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.113418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.114024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.114308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.114580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.115258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.117600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.120460 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3122/6286] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:01.121618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:01.146068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3165/6287] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:20:00 2022] POST /identity/v3/domains => generated 276 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:01.150041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:01.189818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:01.239054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735c52d-c3f5-494f-b2d3-a429b360ac96 tempest-DefaultDomainTestJSON-1773643102 tempest-DefaultDomainTestJSON-1773643102-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.300075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125edd7-5384-45d8-9d5b-b7fa71183c12 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.316424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.317303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.317742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.319271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.320321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.324181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040220c-cd91-4017-8d16-98c7c314ec2b tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.356395 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3166/6288] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Oct 28 10:20:01 2022] POST /identity/v3/domains => generated 279 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:01.356395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.356395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.356395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.384666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:01.386018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:01.440768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.441649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.442213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.442671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] PATH_INFO: `/v3/users/9d47e17e736046769741e18be4a51ee8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.443987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d47e17e736046769741e18be4a51ee8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.446132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.523520 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3167/6289] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:01.528353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:01.528448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d47e17e736046769741e18be4a51ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.528448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d47e17e736046769741e18be4a51ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.528779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d47e17e736046769741e18be4a51ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.540355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d47e17e736046769741e18be4a51ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.604715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7652deb7-53d8-42eb-8609-ae79fde6604a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d47e17e736046769741e18be4a51ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.677825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3123/6290] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:01 2022] DELETE /identity/v3/users/9d47e17e736046769741e18be4a51ee8 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:01.680891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:01.683398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.684629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.686346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.724221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635a78b-53e6-4901-94dc-426fd854f129 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.737235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:01.738460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:01.798748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.799840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.800175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.800553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/c081999559ef46d4ae912bb29e9a6655` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.814733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c081999559ef46d4ae912bb29e9a6655)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.816634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.846310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.850299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.866532 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3124/6291] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:01.868651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:01.877799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:01.888659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:01.896289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449c85-5ae8-4f84-b1f4-51c30106f08a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:01.914405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:01.915901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:01.916250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:01.916591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] PATH_INFO: `/v3/users/e15bb261353d47c99bea9631b5386a5a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:01.917829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15bb261353d47c99bea9631b5386a5a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:01.919070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.919880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:01.926092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.941472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.963524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project c081999559ef46d4ae912bb29e9a6655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:01.963890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.964544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.974025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.985088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.986490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c081999559ef46d4ae912bb29e9a6655', 'request_id': 'req-ba083247-cc2a-4d52-916c-006859bd54c1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:01.990257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15bb261353d47c99bea9631b5386a5a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.006192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3168/6292] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:01 2022] DELETE /identity/v3/domains/c081999559ef46d4ae912bb29e9a6655 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:02.006192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.006782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15bb261353d47c99bea9631b5386a5a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.008241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.008898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15bb261353d47c99bea9631b5386a5a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.034506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15bb261353d47c99bea9631b5386a5a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.044485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15bb261353d47c99bea9631b5386a5a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.053412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:02.084552 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3125/6293] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:01 2022] DELETE /identity/v3/users/e15bb261353d47c99bea9631b5386a5a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:02.084552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.084552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.144628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083247-cc2a-4d52-916c-006859bd54c1 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:02.208627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063118-43d7-4256-bf53-1912c164c242 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:02.214326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:02.215211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.215768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.216516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.217695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:02.218025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:02.218706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.219138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.219418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.221139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8845d0-1979-4573-bf04-2238c54a6225 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:02.221437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.259963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3126/6294] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:20:02 2022] POST /identity/v3/domains => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:02.262977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.263340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.263682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.309053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:02.309053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.350367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:02.352672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:02.373027 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3169/6295] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:02.374971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.399822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec330a8-a003-4edf-864b-64623e7cbe14 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:02.436988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3127/6296] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:02.453281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.454896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.480600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:02.522638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:02.523497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.524084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.524489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/b3b97f2dfbe94b1c976ea2a7f060aaf8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.541356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b3b97f2dfbe94b1c976ea2a7f060aaf8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:02.545008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:02.578306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:02.587742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.590789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.605668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871248d-13e4-4e17-8c95-2089e34edb18 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:02.640302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.641101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.645030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3170/6297] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:02 2022] PATCH /identity/v3/domains/b3b97f2dfbe94b1c976ea2a7f060aaf8 => generated 250 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:02.649653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.662014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.720607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:02.721556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.722159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.722534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.724973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:02.854084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b415ef-b6d9-4064-ae5e-3b5ab24b5634 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:02.857153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:02.862138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:02.862452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:02.863769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:02.864356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:02.864797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/b3b97f2dfbe94b1c976ea2a7f060aaf8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:02.881228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b3b97f2dfbe94b1c976ea2a7f060aaf8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:02.883976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:02.887007 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3128/6298] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:20:02.915553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.919516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:02.970571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:02.972588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.009672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f30a-3b80-4f9b-a920-cff4b2e27b41 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:03.026966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:03.027622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.027905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.028183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] PATH_INFO: `/v3/projects/26710937b8c34d3fa18941fa85460e4d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.032145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26710937b8c34d3fa18941fa85460e4d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:03.034662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:03.061102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.069552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.088583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.112503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project b3b97f2dfbe94b1c976ea2a7f060aaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:03.113357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.114203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.127168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.136083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.137145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b3b97f2dfbe94b1c976ea2a7f060aaf8', 'request_id': 'req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.154734 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3171/6299] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:02 2022] DELETE /identity/v3/domains/b3b97f2dfbe94b1c976ea2a7f060aaf8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:03.156342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:03.158887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.183984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:03.190701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26710937b8c34d3fa18941fa85460e4d', 'request_id': 'req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.205968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26710937b8c34d3fa18941fa85460e4d', 'request_id': 'req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.221854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26710937b8c34d3fa18941fa85460e4d', 'request_id': 'req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.237162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:03.246938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] The token cache is being invalidate because project 26710937b8c34d3fa18941fa85460e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:03.247638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.249138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7f67f8ab-17b2-4a9a-9f86-d9db254d0fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.256937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3129/6300] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:02 2022] DELETE /identity/v3/projects/26710937b8c34d3fa18941fa85460e4d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:03.260542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.262686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.264050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.363301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:03.369607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4151f52-46e2-4ced-b2dc-0e4d8b37d5b2 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:03.370586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.473051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:03.473790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.474111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.474406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.475168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:03.483354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:03.494968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3130/6301] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:03.496237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:03.502240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.521904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3172/6302] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:20:03 2022] POST /identity/v3/domains => generated 277 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:03.521904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:03.526297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893fe5-bdd0-45dc-94b1-846a6e616264 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:03.528224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.642561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c68b3-0035-4959-a12d-27cccefad501 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:03.649176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:03.650178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.650666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.651455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] PATH_INFO: `/v3/users/8292cf2932014bd2bd4aed1998dc9cec` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.653698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8292cf2932014bd2bd4aed1998dc9cec)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:03.656786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:03.670188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:03.672804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.673236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.675132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] PATH_INFO: `/v3/projects/9d4bb88266964d4ba12ccc1200993685` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.678759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4bb88266964d4ba12ccc1200993685)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:03.689897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:03.748896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8292cf2932014bd2bd4aed1998dc9cec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.749966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8292cf2932014bd2bd4aed1998dc9cec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.763188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8292cf2932014bd2bd4aed1998dc9cec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.775355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:03.783727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8292cf2932014bd2bd4aed1998dc9cec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.785815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e2ab1229-8cbb-4152-8194-e113edc8b57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8292cf2932014bd2bd4aed1998dc9cec'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.811732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4bb88266964d4ba12ccc1200993685', 'request_id': 'req-9642151a-0f9a-428a-9fa4-d9e6d04856ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.827901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4bb88266964d4ba12ccc1200993685', 'request_id': 'req-9642151a-0f9a-428a-9fa4-d9e6d04856ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.840594 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3173/6303] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:03 2022] DELETE /identity/v3/users/8292cf2932014bd2bd4aed1998dc9cec => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:03.842149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7b85-ee4e-47c5-9fff-abdf0e9d8e22 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.842540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7b85-ee4e-47c5-9fff-abdf0e9d8e22 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.842968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7b85-ee4e-47c5-9fff-abdf0e9d8e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.850077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4bb88266964d4ba12ccc1200993685', 'request_id': 'req-9642151a-0f9a-428a-9fa4-d9e6d04856ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.865831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad5f7b85-ee4e-47c5-9fff-abdf0e9d8e22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:03.867230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad5f7b85-ee4e-47c5-9fff-abdf0e9d8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.874460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] The token cache is being invalidate because project 9d4bb88266964d4ba12ccc1200993685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:03.875512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.877169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:03.889851 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3131/6304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:03 2022] DELETE /identity/v3/projects/9d4bb88266964d4ba12ccc1200993685 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:03.892557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:03.894793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:03.967886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3174/6305] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:03.969828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a056-b7f2-45de-81c7-f286fecd8688 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:03.970212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a056-b7f2-45de-81c7-f286fecd8688 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:03.970594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7a056-b7f2-45de-81c7-f286fecd8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:03.978579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:04.007448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1fa7a056-b7f2-45de-81c7-f286fecd8688 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:04.020787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1fa7a056-b7f2-45de-81c7-f286fecd8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.035071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642151a-0f9a-428a-9fa4-d9e6d04856ed admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.045110 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3175/6306] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:04.046574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.046943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.047318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.074345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:04.076306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.091529 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3176/6307] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:04.091529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.098150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880485b5-7941-491b-bd35-5184f2383fe6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.103685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.104399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.104781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.105181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.105926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:04.106324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.108160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.122114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.122776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.123047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.123316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/05dc5599f0384878a2bce2297f58080f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.126936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3177/6308] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:04.127938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.129918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.140398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=05dc5599f0384878a2bce2297f58080f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.146348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.172657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.173529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.201803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.202447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de6b4221-1ded-49a4-8dd6-50e19bcce92a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.203738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c723f-56d8-448d-9708-6436de0837ef admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.208128 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3132/6309] 10.222.0.16 () {60 vars in 1250 bytes} [Fri Oct 28 10:20:03 2022] PATCH /identity/v3/domains/05dc5599f0384878a2bce2297f58080f => generated 277 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:04.208128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.208128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.208128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.234031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:04.236040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.282729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.283557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.283908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.284296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.287935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.317921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:04.351816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3133/6310] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:04.352666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.354788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.369025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0b99-102c-43b5-aba3-9c7c2cac80f5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.374037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.374654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.374952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.375209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.375847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.377108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.378118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.379987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.395746 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3178/6311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:04.397263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.399417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:04.421214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3134/6312] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:04.422498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.443232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:04.544113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bd6d0-6644-4dcc-bdee-6d3c39e9856e service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.545997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d17905-bf33-4722-985b-0b61c59f11e3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.558835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.560127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.561055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.561435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.562250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:04.563011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.565256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.585134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3135/6313] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:04.586194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.607131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d691eb-caf8-495f-901c-f0eef7ff8a4d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.618974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.621787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.621935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.623311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.623880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.625987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.664944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.664944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.666072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.666072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/05dc5599f0384878a2bce2297f58080f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.672834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3136/6314] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:04.674283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.682793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=05dc5599f0384878a2bce2297f58080f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.685476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.687495 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3179/6315] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:20:04 2022] GET /identity/v3/domains/05dc5599f0384878a2bce2297f58080f => generated 277 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:04.688323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b4de4-9c14-4086-8169-fca77d18ba31 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.688611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.694244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.695068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.695348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.695620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.696853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.698936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.702824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7f8c3-c618-46c5-ae69-b7ae0de65c30 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.708407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.709139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.709889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.709889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.710545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.712649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.725465 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3180/6316] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:04.727496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.739402 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3137/6317] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:04.740546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:04.744079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ce69-e1ae-46b7-8fe4-dfe8ee8f6d9d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.823171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:04.836643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.837358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.837717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.838001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/05dc5599f0384878a2bce2297f58080f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.839495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=05dc5599f0384878a2bce2297f58080f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.845432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.883512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.887744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '05dc5599f0384878a2bce2297f58080f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:04.888065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6c52-0c23-45c3-816d-f00094b821ef admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:04.906454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:04.907230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:04.908235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:04.908530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] PATH_INFO: `/v3/projects/f77029b57f9a4ebebe20ebf567026ad0/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:04.946055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77029b57f9a4ebebe20ebf567026ad0, user_id=8b9f59e0a8c34a9dbc1bc1dc7d07cd64, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:04.948771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:04.979333 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3138/6318] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:04 2022] PUT /identity/v3/projects/f77029b57f9a4ebebe20ebf567026ad0/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:04.981704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.001561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.045303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.061155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.093876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project 05dc5599f0384878a2bce2297f58080f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:05.094179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.095356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.111032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.111683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:05.116639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.118304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '05dc5599f0384878a2bce2297f58080f', 'request_id': 'req-cb6f36e7-50ec-47ff-b11c-91668da5c715'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.128225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3181/6319] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:04 2022] DELETE /identity/v3/domains/05dc5599f0384878a2bce2297f58080f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:05.131689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb782c-f935-4bb4-b95b-76d8591b8303 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.131878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.135503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.234994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.236791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.237221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.237629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.238511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.241486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.258254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f36e7-50ec-47ff-b11c-91668da5c715 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.267145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.268129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.268494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.268861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.269734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.271568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.279163 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3139/6320] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:04 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:05.279163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.281627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.283447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3182/6321] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:05.284389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.286429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.303325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ca738-d856-488b-aa8f-b914b20087a6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.309516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.310238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.310612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.310952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] PATH_INFO: `/v3/projects/064f2d7843e844549919c80de5e287f0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.312161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064f2d7843e844549919c80de5e287f0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.314454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.355811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:05.381515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2772b4-bff3-4bf1-acc3-57d4987d57f8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.396511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064f2d7843e844549919c80de5e287f0', 'request_id': 'req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.405807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064f2d7843e844549919c80de5e287f0', 'request_id': 'req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.426371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064f2d7843e844549919c80de5e287f0', 'request_id': 'req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.442192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] The token cache is being invalidate because project 064f2d7843e844549919c80de5e287f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:05.442952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.443651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:05.449799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3183/6322] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:05 2022] DELETE /identity/v3/projects/064f2d7843e844549919c80de5e287f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:05.449799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.449799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.461949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.462775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.463206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.463497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.464179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.465915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.485202 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3140/6323] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 10:20:05 2022] GET /identity/v3/domains => generated 1346 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:05.486144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.488573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.554825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:05.580940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6060d5-c3b8-487c-b74a-7c86b4a30ba9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.601112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.601666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.602492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.602767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.603419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.605112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efc144-b35c-47be-a8e4-6a80fd9651f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.636979 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3184/6324] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:05.642790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.643076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.643354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.657971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb980a58-b2fe-4f22-a2b6-c3d5f66976e5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.681760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.683346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:05.686102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.689072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.689403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.689677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] PATH_INFO: `/v3/projects/f77029b57f9a4ebebe20ebf567026ad0/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.693289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77029b57f9a4ebebe20ebf567026ad0, user_id=8b9f59e0a8c34a9dbc1bc1dc7d07cd64, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.698514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.708413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3185/6325] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:05.709463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.713886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.724771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3141/6326] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:05 2022] PUT /identity/v3/projects/f77029b57f9a4ebebe20ebf567026ad0/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:05.726531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.733895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6788-cc35-455e-96f0-b86770a67930 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.819703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.821514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.821805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.822112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/05dc5599f0384878a2bce2297f58080f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.834956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-37cf93e3-b37e-4fe7-b8d6-a046405b1759 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find domain: 05dc5599f0384878a2bce2297f58080f.: keystone.exception.DomainNotFound: Could not find domain: 05dc5599f0384878a2bce2297f58080f. Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 05dc5599f0384878a2bce2297f58080f. Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:05.841640 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:05.842732 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 05dc5599f0384878a2bce2297f58080f. Oct 28 10:20:05.843711 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:05.845391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3186/6327] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:05 2022] PATCH /identity/v3/domains/05dc5599f0384878a2bce2297f58080f => generated 112 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:05.846526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6accb-3d22-4e85-80a0-80e43d01558b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.846815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6accb-3d22-4e85-80a0-80e43d01558b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.847094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6accb-3d22-4e85-80a0-80e43d01558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.867132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5db4a-11c8-46fc-86e3-e46c75be35ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.872475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-54b6accb-3d22-4e85-80a0-80e43d01558b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:05.873728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-54b6accb-3d22-4e85-80a0-80e43d01558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.873850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.874366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.874765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.875029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.875670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.880205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.886073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3187/6328] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:05.887861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.889047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.890215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.892705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3142/6329] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:05.893657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.907175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875f583-2e27-406b-b113-58e4d806b3fe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:05.912462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:05.913094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:05.913365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:05.913627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:05.914288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:05.916676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:05.929028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] MFA Rules not processed for user `8b9f59e0a8c34a9dbc1bc1dc7d07cd64`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:05.930329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:05.939210 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3143/6330] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:20:05 2022] POST /identity/v3/domains => generated 277 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:05.940289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:05.979847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:06.062380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc3e2c-0cc8-4722-8b64-928f2615d9cb tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.069564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3188/6331] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:06.070437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.075893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.076533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.076813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.077111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.077777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:06.078079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.079709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.089729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c0fc-e662-4cf6-8a49-3145e63b4731 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.098341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.099939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.100557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.101029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] PATH_INFO: `/v3/projects/1b1a2afffb4a49d7ae56f0279470ee91/users/bcbabd6fbd5a44dab58eb138c8a31ff3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.107936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3144/6332] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:06.112186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.126788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1a2afffb4a49d7ae56f0279470ee91, user_id=bcbabd6fbd5a44dab58eb138c8a31ff3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.132141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.168041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3189/6333] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:06 2022] PUT /identity/v3/projects/1b1a2afffb4a49d7ae56f0279470ee91/users/bcbabd6fbd5a44dab58eb138c8a31ff3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:06.168041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.177997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:06.207003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581e6e-2d7c-4445-9446-de731374ffd1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.253986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea27f-c520-42b0-b13a-11e3de2e09bb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.261328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.262001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.262289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.264627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.264627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.266040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.309080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3190/6334] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.309080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.314523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.315268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.315691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.316069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.316840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.319114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad59ca-c87a-4927-af64-abd15576f0f4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.391432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3145/6335] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/users => generated 348 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.392558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.392841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.393145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.433906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] MFA Rules not processed for user `bcbabd6fbd5a44dab58eb138c8a31ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:06.436040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:06.454325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8b23-b369-40cc-9597-05c7ded42e6c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.470487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.481227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.481227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.481227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.481227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.481227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.514176 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3191/6336] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.515144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.521253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:06.563046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3146/6337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:06.564661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.635091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a8e0-68be-4eef-b50d-197352824831 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.643161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.643796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.644075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.645267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.647105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.650099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.652766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:06.660180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f0e0-b56f-45b0-8d94-c7d36374dbf4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.698603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3192/6338] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.699580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.710876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e010e69-8b6a-4616-9795-6e60d3c7d817 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.716475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.717128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.717678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.717961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.718595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.720846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.749673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3193/6339] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.749673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.749673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:06.793522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.794451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.794848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.795034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.796193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.798396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.824446 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3147/6340] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:20:06 2022] POST /identity/v3/groups => generated 324 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:06.825682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.837853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4062dc-a95d-4a51-8a6c-6e0fecceda85 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.838326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83639-be4d-4e15-a179-1fbbd86ece90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.842682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.843290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.843868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.844478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.844769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.845083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.845753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.846026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.846691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.848296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.860339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3148/6341] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:06.864523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.877432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19f0ac-cabd-455a-ba4d-07a042f30e12 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.882666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.883947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.884228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.884500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.885234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.886783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.901914 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3149/6342] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:06.903068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.916576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909b2d-8419-4c27-9388-a00268328c5e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.921987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.922703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.923580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.923717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.925198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f9eaf8d36e164c2ea3dc373c664ac002)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.925853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.926961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.927300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.939023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3194/6343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:06.939023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.950698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5cbfb-946b-492f-b9c0-86b03acd602e service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:06.955959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:06.956582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:06.956864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:06.957184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:06.957833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:06.959636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:06.975451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3195/6344] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:06.976507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:06.983340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:06.984789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:06.992064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee92c8-ab31-4569-bacf-3002cd262cbc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.016011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:07.023853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.025863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.035881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3150/6345] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:06 2022] PATCH /identity/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002 => generated 278 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:07.035881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.035881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.087104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.091223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.091223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.091223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.091565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.093360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.109775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3196/6346] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:07.109775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.110643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.140280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a095c-839f-4a7d-a700-af3450c1eba7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.145933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.146664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.146954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.147228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] PATH_INFO: `/v3/projects/d5744f8f9e9a4835bc6ff6bed387a544/users/3e5625e600884c15a8d757dffd451f2f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.166076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5744f8f9e9a4835bc6ff6bed387a544, user_id=3e5625e600884c15a8d757dffd451f2f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.169854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.210039 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3151/6347] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:07 2022] PUT /identity/v3/projects/d5744f8f9e9a4835bc6ff6bed387a544/users/3e5625e600884c15a8d757dffd451f2f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:07.220997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.222768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.228646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d0afb-b508-47ed-a2a9-dc76115dd2ba admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.260044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:07.332245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79bcb-5c1e-4439-9e16-204aa7c38fc9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.344445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.345184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.345469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.345793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] PATH_INFO: `/v3/projects/43f3d1244dc147c398fc24ddcfc6da34/users/608b9dc1a00d489a94524f99820022f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.346608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.347205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.347635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.348316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.367893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f3d1244dc147c398fc24ddcfc6da34, user_id=608b9dc1a00d489a94524f99820022f6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.370842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70850f42-2b15-4c06-8c81-c08eb12ec546 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.375130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f9eaf8d36e164c2ea3dc373c664ac002)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.377226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.391180 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3152/6348] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:07 2022] PUT /identity/v3/projects/43f3d1244dc147c398fc24ddcfc6da34/users/608b9dc1a00d489a94524f99820022f6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:07.392468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b8f-4cd2-4fe5-8023-6d33d599eacc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.392885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b8f-4cd2-4fe5-8023-6d33d599eacc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.393183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786b8f-4cd2-4fe5-8023-6d33d599eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.431958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.437759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-30786b8f-4cd2-4fe5-8023-6d33d599eacc None None] MFA Rules not processed for user `3e5625e600884c15a8d757dffd451f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:07.439068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.439201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30786b8f-4cd2-4fe5-8023-6d33d599eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.498036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:07.553277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3153/6349] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:07.554439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.554727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.555521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.590682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] MFA Rules not processed for user `608b9dc1a00d489a94524f99820022f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:07.592065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.646280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e6525e15b142fb92d6bb3367e697bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.646958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e6525e15b142fb92d6bb3367e697bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.655254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e6525e15b142fb92d6bb3367e697bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.665580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e6525e15b142fb92d6bb3367e697bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.666329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e6525e15b142fb92d6bb3367e697bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.679730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3154/6350] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:07.681228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.682547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.707645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:07.745210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.754945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.763448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31642c-408f-4fa1-8901-dcdef409863b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.764658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.778955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project f9eaf8d36e164c2ea3dc373c664ac002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:07.779605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.782911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.795242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.799244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.799875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f9eaf8d36e164c2ea3dc373c664ac002', 'request_id': 'req-f6b52627-95b7-40d1-824e-4d3a0498c3ef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.810255 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3197/6351] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:07 2022] DELETE /identity/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:07.810255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.810255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.838361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=23,keystone:SELECT=75,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:07.840268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.842163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.842526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.842800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] PATH_INFO: `/v3/users/bcbabd6fbd5a44dab58eb138c8a31ff3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.844021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbabd6fbd5a44dab58eb138c8a31ff3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.846250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.893644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52627-95b7-40d1-824e-4d3a0498c3ef tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:07.898858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbabd6fbd5a44dab58eb138c8a31ff3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.899538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbabd6fbd5a44dab58eb138c8a31ff3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.899657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:07.900165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:07.900428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbabd6fbd5a44dab58eb138c8a31ff3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.900543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:07.900753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:07.902827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.911705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbabd6fbd5a44dab58eb138c8a31ff3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.920532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbabd6fbd5a44dab58eb138c8a31ff3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:07.940684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3155/6352] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:07 2022] DELETE /identity/v3/users/bcbabd6fbd5a44dab58eb138c8a31ff3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:07.944324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.945751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:07.981388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:07.982832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:07.993992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3198/6353] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:07.994960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:07.996286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:08.005652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:08.033150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437226d5-2ac5-44d3-a368-93a81b901330 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.040800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.041696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.042157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.042607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.043412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.046024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0b14-2712-43ff-bf33-86796f1175ed admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.080308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3156/6354] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:07 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:08.082037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.082501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.083076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.087919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224403-3649-4b40-9f80-eea458f409ff service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.106756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:08.108110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:08.175159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.175982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.176655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.177254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.188067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=f9eaf8d36e164c2ea3dc373c664ac002)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.190240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.190717 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3157/6355] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:08.191635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002.: keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.209247 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.210363 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.211949 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.212755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33830d-4221-48a0-baa9-34b8a4cec17b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.215783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3199/6356] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:20:07 2022] GET /identity/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002 => generated 112 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.216844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.218777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:08.223429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.224454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.224736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.225064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.225700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.228189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.235611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:08.258253 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3158/6357] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:08 2022] POST /identity/v3/users => generated 303 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:08.259734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.274861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8f0c-7a40-47af-ac7d-0b3d9a858cb3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.280417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.281107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.281772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.281772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/users/90e6525e15b142fb92d6bb3367e697bb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.291731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:get_user(user_id=90e6525e15b142fb92d6bb3367e697bb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.293816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.301404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8cd6-ea0f-4f76-848a-cc999f624fdf tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.307160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.308092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.308632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find user: 90e6525e15b142fb92d6bb3367e697bb.: keystone.exception.UserNotFound: Could not find user: 90e6525e15b142fb92d6bb3367e697bb. Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 10:20:08.309050 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.310465 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 90e6525e15b142fb92d6bb3367e697bb. Oct 28 10:20:08.311654 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:08.313081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3159/6358] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/users/90e6525e15b142fb92d6bb3367e697bb => generated 110 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.314073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.314400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.326621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.327553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dba3a-f3dd-4a31-a1a6-fa4a1d632433 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.328247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.334781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.335876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.336160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.337004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.337658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.339683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.344216 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3200/6359] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:08.345403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.352865 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3160/6360] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:08.356453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.359586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee04cd-8466-4be5-a59a-e98d338cedc5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.365771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.366756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.367353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.367818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/groups/92a9b974c3304d519bcc078940dcc765` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.368302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357abd68-7f5e-40bb-ba0d-1af35d564b24 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.374424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.374885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:get_group(group_id=92a9b974c3304d519bcc078940dcc765)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.375247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.375571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.375814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] PATH_INFO: `/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255/users/9af7e368832b4ccfa10ac8539b8723ef/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.378457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find group: 92a9b974c3304d519bcc078940dcc765.: keystone.exception.GroupNotFound: Could not find group: 92a9b974c3304d519bcc078940dcc765. Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 28 10:20:08.395953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.397385 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 92a9b974c3304d519bcc078940dcc765. Oct 28 10:20:08.402541 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.403303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66ba8a4e3c8436aae7b71a9d9266255, user_id=9af7e368832b4ccfa10ac8539b8723ef, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.403388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3201/6361] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/groups/92a9b974c3304d519bcc078940dcc765 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.403463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.403546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.421015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4410a5-9a1e-4dd7-80d3-c69499fd0e99 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.423220 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3161/6362] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:08 2022] PUT /identity/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255/users/9af7e368832b4ccfa10ac8539b8723ef/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:08.427591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.532569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.533249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.533529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.533803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/groups/92a9b974c3304d519bcc078940dcc765` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.537433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ac32e-31fa-46de-a3df-8e10d6a336fb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.540812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:08.543659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.546209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.546209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.546209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find group: 92a9b974c3304d519bcc078940dcc765.: keystone.exception.GroupNotFound: Could not find group: 92a9b974c3304d519bcc078940dcc765. Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 28 10:20:08.546551 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.547598 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 92a9b974c3304d519bcc078940dcc765. Oct 28 10:20:08.548789 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.549699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.549699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.551335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3202/6363] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:20:08 2022] DELETE /identity/v3/groups/92a9b974c3304d519bcc078940dcc765 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.558017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.578861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d45c4-8dee-4cb5-a14d-1ae692e58c10 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.597259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.597926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.598276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.598514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/users/90e6525e15b142fb92d6bb3367e697bb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.615150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_user(user_id=90e6525e15b142fb92d6bb3367e697bb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.621487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.642075 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3162/6364] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:08.643314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find user: 90e6525e15b142fb92d6bb3367e697bb.: keystone.exception.UserNotFound: Could not find user: 90e6525e15b142fb92d6bb3367e697bb. Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 28 10:20:08.652379 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.653748 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 90e6525e15b142fb92d6bb3367e697bb. Oct 28 10:20:08.655054 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.660311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:08.661726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3203/6365] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:08 2022] DELETE /identity/v3/users/90e6525e15b142fb92d6bb3367e697bb => generated 110 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.662620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.674818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457c615-22bc-418a-8fde-ad2d4119dc1e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.685371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c6d1-857c-44cd-a5b5-c54f06277f37 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.687637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.689240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.690864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.691294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] PATH_INFO: `/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255/users/9af7e368832b4ccfa10ac8539b8723ef/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.695172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66ba8a4e3c8436aae7b71a9d9266255, user_id=9af7e368832b4ccfa10ac8539b8723ef, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.699592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76733bcc-a60a-4e24-9418-f8cf5bccde1c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.700983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.701709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.701994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.702370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.727044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:08.727613 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3163/6366] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:08 2022] PUT /identity/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255/users/9af7e368832b4ccfa10ac8539b8723ef/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:08.729455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.730122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.730557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002.: keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:08.732432 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:08.733565 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:08.734692 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:08.747538 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3204/6367] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:08 2022] PATCH /identity/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002 => generated 112 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:08.748514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.759113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466d61-0bf6-49fb-ba5e-04b955131758 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.779874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] MFA Rules not processed for user `9af7e368832b4ccfa10ac8539b8723ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:08.784261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:08.866199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.867403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.868711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.869528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.870246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.873440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.893708 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3205/6368] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/domains => generated 1346 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:08.900408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.940184 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3164/6369] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:08.943139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:08.946160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:08.948191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f416f-83eb-4603-8fd5-c53fd5b5d9b9 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:08.954786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:08.955502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:08.955967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:08.956217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:08.958658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:08.958658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:08.962939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:08.982514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:08.997050 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3206/6370] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:08 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:20:08.998193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.000120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.048314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a79219-1936-4b30-8b9e-9c7b8f73ab93 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.053843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.054481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.054883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.055191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] PATH_INFO: `/v3/projects/1b1a2afffb4a49d7ae56f0279470ee91` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.056888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1a2afffb4a49d7ae56f0279470ee91)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.058998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.078083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83456ad-878a-4768-b550-15d4d3a9de34 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.084450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.085172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.086018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.086838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] PATH_INFO: `/v3/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.087993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9f59e0a8c34a9dbc1bc1dc7d07cd64)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.090043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.117032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1a2afffb4a49d7ae56f0279470ee91', 'request_id': 'req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.125438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1a2afffb4a49d7ae56f0279470ee91', 'request_id': 'req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.135076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1a2afffb4a49d7ae56f0279470ee91', 'request_id': 'req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.148295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] The token cache is being invalidate because project 1b1a2afffb4a49d7ae56f0279470ee91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:09.149452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.149607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9f59e0a8c34a9dbc1bc1dc7d07cd64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.150135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.150291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9f59e0a8c34a9dbc1bc1dc7d07cd64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.152700 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3165/6371] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:08 2022] DELETE /identity/v3/projects/1b1a2afffb4a49d7ae56f0279470ee91 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:09.153590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.159029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.162245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9f59e0a8c34a9dbc1bc1dc7d07cd64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.166704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:09.172424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9f59e0a8c34a9dbc1bc1dc7d07cd64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.173043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9f59e0a8c34a9dbc1bc1dc7d07cd64'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.193205 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3207/6372] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:08 2022] DELETE /identity/v3/users/8b9f59e0a8c34a9dbc1bc1dc7d07cd64 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:09.197776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.199197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.252973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac25f-2624-4c69-9c1f-b523bab2e6a5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.277094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d83cd3-2112-4aef-9345-82b1cdab527d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.282150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.282761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.283055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.283332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.283980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-308225944) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:09.284279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.285931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2c12b-9d28-4c5c-9b13-482bcd834e1a tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.298982 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3208/6373] 10.222.0.16 () {58 vars in 1197 bytes} [Fri Oct 28 10:20:09 2022] GET /identity/v3/domains?name=tempest-test_domain-308225944 => generated 406 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:09.300107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892308f-fccd-44d4-bc10-9fb377f9767e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.300392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892308f-fccd-44d4-bc10-9fb377f9767e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.301045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892308f-fccd-44d4-bc10-9fb377f9767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.322171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7892308f-fccd-44d4-bc10-9fb377f9767e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:09.323374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7892308f-fccd-44d4-bc10-9fb377f9767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.329752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.329934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:09.330968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.331443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.331914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.334254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.411965 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3209/6374] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:09.412128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.413338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b372d3-1a07-43ab-b3c4-cdb85eca2328 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.413625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b372d3-1a07-43ab-b3c4-cdb85eca2328 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.413741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.413891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b372d3-1a07-43ab-b3c4-cdb85eca2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.424688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3166/6375] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:09.425729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.437972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e403f3-30ae-4da9-9d98-ac0bc053b38d service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.439737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a9b372d3-1a07-43ab-b3c4-cdb85eca2328 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:09.441186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a9b372d3-1a07-43ab-b3c4-cdb85eca2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.443864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.444658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.445160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.446170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.451864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3210/6376] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:09.453260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.453540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.453807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.470897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:09.476676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:09.478111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002.: keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:09.478275 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:09.479504 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9eaf8d36e164c2ea3dc373c664ac002. Oct 28 10:20:09.480678 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:09.481691 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3167/6377] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:09 2022] PATCH /identity/v3/domains/f9eaf8d36e164c2ea3dc373c664ac002 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:09.482042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.484135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.494240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3211/6378] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:09.495185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.507493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30bbb-a736-4d18-87dd-8d19e221b535 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.513963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.514720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.515101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.515472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/609bc6b0666c4f5cbe9e9183615d59fe` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.528343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:09.529722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=609bc6b0666c4f5cbe9e9183615d59fe)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.533158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.570693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06420-2de0-4a53-813f-a5c34418363e tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.575537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.576370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.576844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.577338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.592546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.594337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.610431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3168/6379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:09.611338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.615495 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3212/6380] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:09 2022] PATCH /identity/v3/domains/609bc6b0666c4f5cbe9e9183615d59fe => generated 276 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:09.616564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.630033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41595a4-b945-4cfd-ba28-f57e3f0eacb4 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.636745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.637576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.638175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.638403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/609bc6b0666c4f5cbe9e9183615d59fe` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.641988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48429248-2590-4893-b110-34c2125f0dd6 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.654837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=609bc6b0666c4f5cbe9e9183615d59fe)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.655899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.656522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.656804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.656966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.658704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.659398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:09.659710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.662142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.688741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.692948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3169/6381] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:09.694086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.697392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.718694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb92b-7cd2-4c8b-9397-46c799dce9f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:09.737219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:09.737849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:09.738133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:09.738407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:09.739046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:09.740986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:09.798483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.815350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.821787 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3170/6382] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:09 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:09.825768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.839916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.852512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:09.858968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project 609bc6b0666c4f5cbe9e9183615d59fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:09.859778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.860874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.876936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.883083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.885086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '609bc6b0666c4f5cbe9e9183615d59fe', 'request_id': 'req-39aae22b-6918-41d2-90c9-0516c6319dd3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:09.899898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3213/6383] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:09 2022] DELETE /identity/v3/domains/609bc6b0666c4f5cbe9e9183615d59fe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:09.903218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:09.906065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:09.996943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea43fd-d177-4967-96d2-79dc7e1e102e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.012765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.016270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.016270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.016270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.017011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.022846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.049336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aae22b-6918-41d2-90c9-0516c6319dd3 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.079610 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3171/6384] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:09 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:10.081220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.084219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.109772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b9b1c-5b5a-42bb-9ae2-5dd4b97062a8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.116869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.118463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.118852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.119230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.120102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.122089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.136259 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3172/6385] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:10.140655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.165393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d872f-3962-4e55-8722-4cb972d3d915 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.179677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.182438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.182820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.185343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.186005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.186288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.186960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/d9b10ce1366e4da8883fc37b1e31814c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.187901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.190111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.191135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.210464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d9b10ce1366e4da8883fc37b1e31814c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.214452 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3173/6386] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:10.216211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.218958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.231559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33ed4-571e-4f53-b045-8c73cbbca89b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.245248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.245950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.246246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.246528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] PATH_INFO: `/v3/projects/bae9031cc8a247f0862a7c7576211ea4/users/9147c678369e4587b01511fe7c9fceca/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.262665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.268413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.280751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae9031cc8a247f0862a7c7576211ea4, user_id=9147c678369e4587b01511fe7c9fceca, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.283997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5c718-7537-4a87-9518-3b39f7d297f5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.301949 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3174/6387] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:10 2022] PUT /identity/v3/projects/bae9031cc8a247f0862a7c7576211ea4/users/9147c678369e4587b01511fe7c9fceca/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:10.316065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433054-6082-410a-8919-647041d9f2fa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.316707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433054-6082-410a-8919-647041d9f2fa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.317202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433054-6082-410a-8919-647041d9f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.342460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.345916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.355003 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3214/6388] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:09 2022] PATCH /identity/v3/domains/d9b10ce1366e4da8883fc37b1e31814c => generated 278 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:10.358218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.361102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.397582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-57433054-6082-410a-8919-647041d9f2fa None None] MFA Rules not processed for user `9147c678369e4587b01511fe7c9fceca`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:10.401495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57433054-6082-410a-8919-647041d9f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.475935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:10.480142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:10.525990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab56c0-865f-402e-b2c8-3c223ca7b1a5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.586851 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3175/6389] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:10.604381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57433054-6082-410a-8919-647041d9f2fa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.605995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57433054-6082-410a-8919-647041d9f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.650350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.652560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.652850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.653428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/d9b10ce1366e4da8883fc37b1e31814c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.686563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d9b10ce1366e4da8883fc37b1e31814c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.688539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.725097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.730064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.741102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57433054-6082-410a-8919-647041d9f2fa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.751402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:10.752051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:10.752328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:10.752642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:10.764633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:10.767379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:10.781326 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3176/6390] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:20:10.782513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.785015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.802715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.810186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.820266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.838535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project d9b10ce1366e4da8883fc37b1e31814c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:10.839108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.839890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.856247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.864219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.866036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd9b10ce1366e4da8883fc37b1e31814c', 'request_id': 'req-2af7a5ac-7e23-494a-9aea-468878cf85b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:10.883611 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3215/6391] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:10 2022] DELETE /identity/v3/domains/d9b10ce1366e4da8883fc37b1e31814c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:10.884710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:10.887013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:10.918910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0cfb-fae8-4836-9f72-435284a4237c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:10.938799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:11.000974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a5ac-7e23-494a-9aea-468878cf85b5 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:11.007132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:11.012028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:11.012691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:11.012691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/77704b5ad6f54663800f745977b7cdac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:11.026623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=77704b5ad6f54663800f745977b7cdac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:11.028749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:11.043396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:11.045139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:11.045420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:11.045769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] PATH_INFO: `/v3/projects/f77029b57f9a4ebebe20ebf567026ad0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:11.047541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77029b57f9a4ebebe20ebf567026ad0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:11.051244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:11.073987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.074972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.102500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:11.126678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.129241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.137687 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3216/6392] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:10 2022] PATCH /identity/v3/domains/77704b5ad6f54663800f745977b7cdac => generated 276 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:11.140848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:11.142399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:11.155373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77029b57f9a4ebebe20ebf567026ad0', 'request_id': 'req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.168594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77029b57f9a4ebebe20ebf567026ad0', 'request_id': 'req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.185172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77029b57f9a4ebebe20ebf567026ad0', 'request_id': 'req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.204764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] The token cache is being invalidate because project f77029b57f9a4ebebe20ebf567026ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:11.205227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.206039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.208064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3177/6393] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:10 2022] DELETE /identity/v3/projects/f77029b57f9a4ebebe20ebf567026ad0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:11.212864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:11.214349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:11.312400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26523-574f-4658-aa11-da48f3b79123 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:11.364265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e48c1-7e42-4ef4-b039-fbae41bec7cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:11.372234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:11.373148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:11.373251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:11.373477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] PATH_INFO: `/v3/users/3e5625e600884c15a8d757dffd451f2f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:11.374644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5625e600884c15a8d757dffd451f2f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:11.377568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:11.428985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '190144d21e254b768c2bb08b5f9f9ed8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee59151244f4789a70e89aeb646260a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:11.429657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:11.430062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:11.430546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] PATH_INFO: `/v3/domains/77704b5ad6f54663800f745977b7cdac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:11.446734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=77704b5ad6f54663800f745977b7cdac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:11.448709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:11.481765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.486489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '77704b5ad6f54663800f745977b7cdac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.488744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:11.493414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5625e600884c15a8d757dffd451f2f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.495302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5625e600884c15a8d757dffd451f2f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.496242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5625e600884c15a8d757dffd451f2f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.529476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5625e600884c15a8d757dffd451f2f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.549651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5625e600884c15a8d757dffd451f2f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.598900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.608760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3178/6394] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:11 2022] DELETE /identity/v3/users/3e5625e600884c15a8d757dffd451f2f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:11.624168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.636626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.663916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] The token cache is being invalidate because project 77704b5ad6f54663800f745977b7cdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:11.665333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.667617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.694645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.709621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.712278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b33c4614-ca8e-4750-851b-a982327a19c7 tempest-DomainsTestJSON-1373598161 tempest-DomainsTestJSON-1373598161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '77704b5ad6f54663800f745977b7cdac', 'request_id': 'req-b33c4614-ca8e-4750-851b-a982327a19c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:11.728953 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3217/6395] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:11 2022] DELETE /identity/v3/domains/77704b5ad6f54663800f745977b7cdac => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:11.732969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:11.735253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:11.834398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:11.903662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8834-10da-49bd-9ad4-1d8e9e4b77b7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:11.936253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:11.936995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:11.937255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:11.937528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] PATH_INFO: `/v3/users/71b7b1eea7ec4e3ba8f1c6a2983ef8a6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:11.943472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b7b1eea7ec4e3ba8f1c6a2983ef8a6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:11.952882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:12.100608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b7b1eea7ec4e3ba8f1c6a2983ef8a6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.101353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b7b1eea7ec4e3ba8f1c6a2983ef8a6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.103130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b7b1eea7ec4e3ba8f1c6a2983ef8a6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.116855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b7b1eea7ec4e3ba8f1c6a2983ef8a6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.127946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b7b1eea7ec4e3ba8f1c6a2983ef8a6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.161483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3179/6396] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:11 2022] DELETE /identity/v3/users/71b7b1eea7ec4e3ba8f1c6a2983ef8a6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:12.166910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.167533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.168580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.215423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:12.217193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:12.336941 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3218/6397] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:12.358626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:12.363693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:12.422381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:12.424054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:12.445200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9933884-f532-4444-926d-e9f1c032ab59 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:12.460457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:12.463347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.464590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.465668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] PATH_INFO: `/v3/projects/d5744f8f9e9a4835bc6ff6bed387a544` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.471056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5744f8f9e9a4835bc6ff6bed387a544)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:12.479042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:12.510368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbc07f-ea31-40d0-9d3c-f0b917a3db2a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:12.521563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:12.522277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.522560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.522836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.541149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:12.542771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d705298-6151-448b-998a-fc9ddebdf6e3 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:12.568589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3180/6398] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:12.596138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5744f8f9e9a4835bc6ff6bed387a544', 'request_id': 'req-81334345-757c-4932-8a76-1da13ca801bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.606288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5744f8f9e9a4835bc6ff6bed387a544', 'request_id': 'req-81334345-757c-4932-8a76-1da13ca801bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.616273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5744f8f9e9a4835bc6ff6bed387a544', 'request_id': 'req-81334345-757c-4932-8a76-1da13ca801bb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.618810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:12.635517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] The token cache is being invalidate because project d5744f8f9e9a4835bc6ff6bed387a544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:12.635812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.636506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-81334345-757c-4932-8a76-1da13ca801bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:12.643407 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3219/6399] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:12 2022] DELETE /identity/v3/projects/d5744f8f9e9a4835bc6ff6bed387a544 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:12.646200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.646602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.646973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.678558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:12.681010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:12.776456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:12.807887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.808435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.808435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.813263 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3181/6400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:12.843785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:12.845336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:12.860883 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3220/6401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:12.862131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:12.877925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c569-8625-49f2-8c31-99f686374275 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:12.887372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:12.888873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.889550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.890085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.891063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:12.891781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:12.894459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:12.916041 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3182/6402] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:12.920218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:12.937729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d38c-f318-43b5-9091-e96540cff1b5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:12.951147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:12.955021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:12.955882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:12.957048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:12.960983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:12.966695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.018987 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3221/6403] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:12 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:13.023312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.037247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c558a-dfd9-4701-ab71-a4fc9bc10f2c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.163514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.165183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.165944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.165944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.166362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.169926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.207049 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3183/6404] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:13 2022] POST /identity/v3/users => generated 304 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:13.211204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.225509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d918-31b6-4257-96f6-97d5bc66b368 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.239315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.240229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.241055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.241784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.244221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.246811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.266322 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3222/6405] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:20:13.271964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.287068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6675870-bfbf-4ebd-be02-7906cb06198b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.292289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.293323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.293607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.294420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.295393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.297793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.315529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.318524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:13.319186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3184/6406] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:13.321260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.345099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f05d8d-cbf2-423a-a21a-a540f93305bb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.349584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71089-e93e-4f25-bff9-11e24a37747a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.358725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.359858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.360387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.361277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] PATH_INFO: `/v3/projects/2bf337d62ca74c9bad8a010dfecedfcc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.363237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf337d62ca74c9bad8a010dfecedfcc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.364477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.365206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.365488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.365764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] PATH_INFO: `/v3/projects/f1d3f86c29a54f33b5a2a85c7e733886/users/b38ecf652dca499985efef29c04bf5d5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.366546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.403455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d3f86c29a54f33b5a2a85c7e733886, user_id=b38ecf652dca499985efef29c04bf5d5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.406162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e3e5-6ae6-435a-ba13-319eb3af71b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.432988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3185/6407] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:13 2022] PUT /identity/v3/projects/f1d3f86c29a54f33b5a2a85c7e733886/users/b38ecf652dca499985efef29c04bf5d5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:13.440431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985418-fa86-4326-b715-09f063c8d56a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.441136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985418-fa86-4326-b715-09f063c8d56a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.441566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985418-fa86-4326-b715-09f063c8d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.465714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf337d62ca74c9bad8a010dfecedfcc', 'request_id': 'req-5c21ea2a-4c9a-4b56-8e80-211215360ede'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.494604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf337d62ca74c9bad8a010dfecedfcc', 'request_id': 'req-5c21ea2a-4c9a-4b56-8e80-211215360ede'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.511124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf337d62ca74c9bad8a010dfecedfcc', 'request_id': 'req-5c21ea2a-4c9a-4b56-8e80-211215360ede'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.530424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] The token cache is being invalidate because project 2bf337d62ca74c9bad8a010dfecedfcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:13.530737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.531897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.533069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-26985418-fa86-4326-b715-09f063c8d56a None None] MFA Rules not processed for user `b38ecf652dca499985efef29c04bf5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:13.540282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3223/6408] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:13 2022] DELETE /identity/v3/projects/2bf337d62ca74c9bad8a010dfecedfcc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:13.540509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26985418-fa86-4326-b715-09f063c8d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:13.541882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.545121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:13.701920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ea2a-4c9a-4b56-8e80-211215360ede admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.714949 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3186/6409] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:13.716792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.717475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.717765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.718054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] PATH_INFO: `/v3/users/190144d21e254b768c2bb08b5f9f9ed8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.719314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985418-fa86-4326-b715-09f063c8d56a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.719576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=190144d21e254b768c2bb08b5f9f9ed8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.720725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26985418-fa86-4326-b715-09f063c8d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:13.724362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.753045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985418-fa86-4326-b715-09f063c8d56a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:13.758160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:13.758783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:13.759064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:13.759333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:13.759988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:13.761940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:13.825268 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3187/6410] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:13 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:13.829143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:13.837463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:13.839337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:13.858477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190144d21e254b768c2bb08b5f9f9ed8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.860196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190144d21e254b768c2bb08b5f9f9ed8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.873662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190144d21e254b768c2bb08b5f9f9ed8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.895490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190144d21e254b768c2bb08b5f9f9ed8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.898731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190144d21e254b768c2bb08b5f9f9ed8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:13.955096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3224/6411] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:13 2022] DELETE /identity/v3/users/190144d21e254b768c2bb08b5f9f9ed8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:13.977991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd3a0f-e1cf-4379-95c3-e804e87ea268 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.097852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.098831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.099194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.099573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.100287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.103247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.133521 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3188/6412] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:13 2022] POST /identity/v3/users => generated 309 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:14.136984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.138881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:14.168403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a60-2e9c-458e-81a1-a648df68a20e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.183727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.186692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.188452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.189278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.190954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.196773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.220350 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3225/6413] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:14.225277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.240834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02233ce-6f98-4b1c-a325-88559e48f0f5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.248660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.250907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.251379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.252076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] PATH_INFO: `/v3/projects/006eefc4914e4bebafca20cc6bf69e1d/users/0710171c960f44c8923fa570ab91718c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.281075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=006eefc4914e4bebafca20cc6bf69e1d, user_id=0710171c960f44c8923fa570ab91718c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.286282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.306651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3189/6414] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:14 2022] PUT /identity/v3/projects/006eefc4914e4bebafca20cc6bf69e1d/users/0710171c960f44c8923fa570ab91718c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:14.310974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.330399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cb65-de7a-44b9-ac82-cadc64a3cde1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.465285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.466442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.467114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.467631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.469525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.472023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d064e-e4bb-408f-b526-a0ab09301ef6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.497086 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3226/6415] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:14.500851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.512512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906a88-a022-479e-9180-318b4fb1b36a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.528135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.528851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.529223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.529558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] PATH_INFO: `/v3/projects/006eefc4914e4bebafca20cc6bf69e1d/users/0710171c960f44c8923fa570ab91718c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.531676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=006eefc4914e4bebafca20cc6bf69e1d, user_id=0710171c960f44c8923fa570ab91718c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.535670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.558695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3190/6416] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:14 2022] PUT /identity/v3/projects/006eefc4914e4bebafca20cc6bf69e1d/users/0710171c960f44c8923fa570ab91718c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:14.560875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.562701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.563387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.628668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] MFA Rules not processed for user `0710171c960f44c8923fa570ab91718c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:14.631648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:14.704058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.705898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:14.754543 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3227/6417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:14.773691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.775459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:14.822923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec126b-bd10-4d6b-8298-98ae16a7416e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.829788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:14.830588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:14.830960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:14.831285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] PATH_INFO: `/v3/projects/5ee59151244f4789a70e89aeb646260a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:14.832871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee59151244f4789a70e89aeb646260a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:14.835146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:14.838959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:14.883791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:14.918027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee59151244f4789a70e89aeb646260a', 'request_id': 'req-62951fa7-a483-4db2-8072-d40910749d4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:14.928639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee59151244f4789a70e89aeb646260a', 'request_id': 'req-62951fa7-a483-4db2-8072-d40910749d4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:14.943072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee59151244f4789a70e89aeb646260a', 'request_id': 'req-62951fa7-a483-4db2-8072-d40910749d4a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:14.958412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fbc78-510a-4f32-a506-06c29dd8d155 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:14.972836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] The token cache is being invalidate because project 5ee59151244f4789a70e89aeb646260a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:14.974571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:14.981677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:14.986201 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3191/6418] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:14 2022] DELETE /identity/v3/projects/5ee59151244f4789a70e89aeb646260a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:14.989266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:14.991696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.065356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.066070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.066425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.067612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.072524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.132306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62951fa7-a483-4db2-8072-d40910749d4a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.139270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.140520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.143351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.143678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.147455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.182486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.190617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c962e0-5fe1-4d2e-9f5c-5f20a8cf622c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.211865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3228/6419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:15.213872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637517c5-6105-4c73-b6f5-c1b54b7e9df1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.214021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637517c5-6105-4c73-b6f5-c1b54b7e9df1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.214462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637517c5-6105-4c73-b6f5-c1b54b7e9df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.267331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-637517c5-6105-4c73-b6f5-c1b54b7e9df1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:15.268985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-637517c5-6105-4c73-b6f5-c1b54b7e9df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.324165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.325633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.362942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3192/6420] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:15.364170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.365579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.390017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63076-0e25-4b3e-87c4-e09eaf5f5016 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.395288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.395917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.396437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.396811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.399804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.410279 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3229/6421] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:15.419837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.420010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.420759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.467908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:15.487372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:15.490215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:15.500043 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3230/6422] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:15.504181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.524252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b630d-311d-47aa-a487-650bf1ed6abe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.531873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.532515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.532796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.533245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.534308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:15.534615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.536322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.552827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.557015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3231/6423] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:15.562792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.564393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.583154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b8b-044e-495c-b5a5-d068a0b81ea9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.588944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3193/6424] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:15 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:15.597313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.597949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.598231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.598507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.599149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.603501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.634222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:15.651347 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3232/6425] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:15 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:15.655159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.667566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b193720-e087-4fda-b216-ff728b0ff15d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.751317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.752484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.753009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.753617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.754768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.758091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.821771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3194/6426] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:15 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:15.822268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.841062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810f9b-5ad5-4850-9a1d-7782292f76c0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.856037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.856776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.858265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.860563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.861607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.867100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.887858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3233/6427] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:15.892365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.907150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c218-24a9-4985-a2c8-6f4a72953300 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.914175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.914804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.915412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.915695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.916347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.918882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8690a-993c-4f1f-93e8-f78ff1d520de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:15.940666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:15.953936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3195/6428] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:15.960832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7a7-205d-4a6f-b6b3-b40f3a9ffc8c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:15.970648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:15.971367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:15.971646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:15.971920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] PATH_INFO: `/v3/projects/091b26ec034040f7895de77b01c78576/users/dea9093b71f14d2f9ac8fcbc43f059b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:15.994631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091b26ec034040f7895de77b01c78576, user_id=dea9093b71f14d2f9ac8fcbc43f059b5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:15.997765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.027081 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3234/6429] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:15 2022] PUT /identity/v3/projects/091b26ec034040f7895de77b01c78576/users/dea9093b71f14d2f9ac8fcbc43f059b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:16.030808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.035039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.037083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.087387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] MFA Rules not processed for user `dea9093b71f14d2f9ac8fcbc43f059b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:16.088636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:16.131677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.134583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:16.250791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3196/6430] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:16.254839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.342062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697026a1-22a1-4313-bb64-233acd905d04 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:16.346303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:16.359455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:16.360152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.360822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.360822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.364682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:16.438622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1aa2-4190-40ca-9bde-8b1d0a645b9a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:16.461636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:16.461636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.461636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.461636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.462023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:16.462023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.533196 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3197/6431] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:16 2022] POST /identity/v3/projects => generated 365 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:16.535225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:16.536359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.538687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.576609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3235/6432] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:16 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:20:16.676098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6bcd-8ab6-402a-be45-5fc54a66f016 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:16.685824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:16.685824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.686410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.687037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.692803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:16.694898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.748835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3198/6433] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:16 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:16.750759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.772747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec19e5-a4c2-43d8-8195-a4b399fe84dd service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:16.781280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:16.782219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.782680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.783188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.784622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:16.787791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.808374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3236/6434] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:16.811288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.831031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6199b1-2472-42cb-8eb7-a4243ee2cb36 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:16.838926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:16.839675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:16.841524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:16.841823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] PATH_INFO: `/v3/projects/f59e623abc02452b80e4adc87bdac34a/users/cf2711de8d0f4f2c8637c2dcc89750f4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:16.868368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e623abc02452b80e4adc87bdac34a, user_id=cf2711de8d0f4f2c8637c2dcc89750f4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:16.871511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:16.897033 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3199/6435] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:16 2022] PUT /identity/v3/projects/f59e623abc02452b80e4adc87bdac34a/users/cf2711de8d0f4f2c8637c2dcc89750f4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:16.900788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:16.919314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3dc76-e22c-4aa1-b113-585d2072f722 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.051445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:17.096221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.097252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.098562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.099467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.100524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.103063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb930a08-706b-4aa2-b890-f780a4643be3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.127423 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3237/6436] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:17.128550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.151766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee510-e5f2-4767-8f97-91ec26ec4a69 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.158642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.160469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.160951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.161397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] PATH_INFO: `/v3/projects/f59e623abc02452b80e4adc87bdac34a/users/cf2711de8d0f4f2c8637c2dcc89750f4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.168472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e623abc02452b80e4adc87bdac34a, user_id=cf2711de8d0f4f2c8637c2dcc89750f4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.174431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.242829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3200/6437] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:17 2022] PUT /identity/v3/projects/f59e623abc02452b80e4adc87bdac34a/users/cf2711de8d0f4f2c8637c2dcc89750f4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:17.356936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.357233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.357824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.397641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] MFA Rules not processed for user `cf2711de8d0f4f2c8637c2dcc89750f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:17.399441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:17.548026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.548602 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3238/6438] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:17.573272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1da83f-764d-4247-aee4-268b0e97d7fd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.597912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.598723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.605841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.606179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.606938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.608571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.648155 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3201/6439] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/roles => generated 235 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:17.652163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.667893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fbce6-d8d2-4bae-aa2a-6b38f407c01b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.681410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.682058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.682398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.682680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.683366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.685616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.718098 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3239/6440] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/roles => generated 235 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:17.721438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.770199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ed47-b473-40c2-8875-22d1e4740f21 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.793594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.796041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.796430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.796598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.798907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.802346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.840119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3202/6441] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/roles => generated 235 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:17.842943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.856255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8733-e16d-413c-a84c-db3eff2f5ad7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:17.871237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:17.872027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:17.872308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:17.872585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:17.873299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:17.877013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:17.908685 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3240/6442] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/domains => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:17.912370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:17.927533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85578455-b80a-4f45-b0d3-9471cd006a56 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.032613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:18.065121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.065936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.066902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.067252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.068033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.070196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.138205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3203/6443] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:17 2022] POST /identity/v3/projects => generated 400 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:18.140091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.157360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55b71-3d46-4f8c-b750-97d53860feb8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.374694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.375648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.375941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.376218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/groups` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.376862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.386348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.430403 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3241/6444] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:20:18 2022] POST /identity/v3/groups => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:18.434888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.451536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000add-a102-462a-b99c-da9f00f826ff tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.465437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.466084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.466369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.466648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.467347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.470563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.516648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.517230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3204/6445] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:18 2022] POST /identity/v3/roles => generated 235 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:18.537825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f978f8e-703a-4a55-b324-79e4306e3229 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.567668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.571427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.576642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.577620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.581093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.585527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.656798 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3242/6446] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:18 2022] POST /identity/v3/users => generated 442 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:18.661086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.705242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147ab1-5f0a-42a9-bc2a-d38191d5a599 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.722144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.722792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.724275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.724560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.725450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.728077 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:18.728077 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:18.728077 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:18.730813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.775965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3205/6447] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:18 2022] POST /identity/v3/roles => generated 269 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:18.779358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.795662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aadc-d104-4523-bb35-9d9d231e78bd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:18.816564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:18.817366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:18.817805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:18.818316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/b1b084f325664c11a7fea71d678a34a4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:18.858274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:18.869945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=b1b084f325664c11a7fea71d678a34a4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:18.874524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:18.913170 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3243/6448] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:18 2022] PUT /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/b1b084f325664c11a7fea71d678a34a4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:18.917579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:18.928590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919633d0-2960-4a2c-92ec-f13614058452 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:19.102880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:19.103661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:19.104333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:19.104333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:19.104997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Adding query filter params (scope.project.id=18eec3c0a5bb4f45891144153228afba, user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:19.105308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:19.106368 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:19.106368 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:19.106368 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:19.107512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:19.235205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3206/6449] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:20:18 2022] GET /identity/v3/role_assignments?scope.project.id=18eec3c0a5bb4f45891144153228afba&user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a&effective => generated 228 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:19.239111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:19.260417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf422-a4a2-46d5-87ac-b9f3d854e002 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:19.270447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:19.271129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:19.271411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:19.271686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/b1b084f325664c11a7fea71d678a34a4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:19.276961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=b1b084f325664c11a7fea71d678a34a4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:19.279692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:19.298781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role b1b084f325664c11a7fea71d678a34a4 was removed from user 9b4d0bedc46b46cca4ef8a348e6f9f0a on project 18eec3c0a5bb4f45891144153228afba. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:19.299077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:19.301189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:19.328639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3244/6450] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:20:19 2022] DELETE /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/b1b084f325664c11a7fea71d678a34a4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:19.332889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:19.334709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:19.357856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab928708-e393-4874-98b0-2ca95fc2c02e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:19.500021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:19.509329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:19.510952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:19.511199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:19.511796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/b1b084f325664c11a7fea71d678a34a4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:19.513777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b1b084f325664c11a7fea71d678a34a4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:19.517609 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:19.517609 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:19.517609 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:19.523281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:19.625322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role b1b084f325664c11a7fea71d678a34a4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:19.625722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:19.628943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:19.635422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3207/6451] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:19 2022] DELETE /identity/v3/roles/b1b084f325664c11a7fea71d678a34a4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:19.636661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:19.657921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f730a-7632-45d4-a6c4-1e150919104c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:19.757663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:19.759452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:19.761548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:19.763304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/7c8c9a18c80d4af2be5e2f36325335a9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:19.786741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=7c8c9a18c80d4af2be5e2f36325335a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:19.791511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:19.830766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:19.831657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3245/6452] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:19 2022] PUT /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/7c8c9a18c80d4af2be5e2f36325335a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:19.834185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:19.858832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdd0b6-2018-4ffa-882a-b02c3d63e42b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.021539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.022250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.022611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.022904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.026010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.027142 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:20.027142 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:20.027142 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:20.028152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.075135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:20.075991 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3208/6453] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:19 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 521 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:20.092762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9de5c4-79f3-4440-adc4-0fba3bbc0445 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.206714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.207407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.207704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.207972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.208707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Adding query filter params (scope.project.id=18eec3c0a5bb4f45891144153228afba, user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:20.209322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.210354 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:20.210354 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:20.210354 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:20.213045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.316101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:20.330686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3246/6454] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:20:20 2022] GET /identity/v3/role_assignments?scope.project.id=18eec3c0a5bb4f45891144153228afba&user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a&effective => generated 1061 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:20.334854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f217-02e1-4986-b8fc-135263cac361 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.343313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.344352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.344352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.344567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.346902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.348186 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:20.348186 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:20.348186 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:20.349157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.375411 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3209/6455] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:20 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:20.380308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:20.404615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cacc7f-44c2-4641-b55d-3b9499a1b0ad tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.497018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:20.654132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.655196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.655696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.656191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.657211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Adding query filter params (scope.project.id=18eec3c0a5bb4f45891144153228afba, user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:20.662832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.665806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.800958 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3247/6456] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:20:20 2022] GET /identity/v3/role_assignments?scope.project.id=18eec3c0a5bb4f45891144153228afba&user.id=9b4d0bedc46b46cca4ef8a348e6f9f0a&effective => generated 577 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:20.807470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:20.825841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e7d1-c4d8-48a4-89f4-aed0cd69ad23 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.837559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.838226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.838506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.838776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.843636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.845529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c.: keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = query.one() Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._iter().one() Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._only_one_row( Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:20.892574 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:20.893916 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 28 10:20:20.895039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 28 10:20:20.895039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 28 10:20:20.895039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 28 10:20:20.895039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:20.895039 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:20.896207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3210/6457] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:20 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 137 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:20.901338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:20.918261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d488-e59f-4a9f-8dc5-225dbcd7beef tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:20.939332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:20.941620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:20.942515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:20.942515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/7c8c9a18c80d4af2be5e2f36325335a9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:20.956687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=7c8c9a18c80d4af2be5e2f36325335a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:20.961469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:20.977917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 7c8c9a18c80d4af2be5e2f36325335a9 was removed from user 9b4d0bedc46b46cca4ef8a348e6f9f0a on project 18eec3c0a5bb4f45891144153228afba. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:20.978212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:20.985402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:21.012954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3248/6458] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:20:20 2022] DELETE /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/7c8c9a18c80d4af2be5e2f36325335a9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:21.013435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.016173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:21.044419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d74ad-2e09-40d3-aa0b-47b1ae2f83fd tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.169356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.170281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.170882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.171322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.172258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:21.174294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:21.196793 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3211/6459] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:21 2022] POST /identity/v3/roles => generated 271 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:21.200662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.219632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70174d-7f56-41bf-8811-9d87e55f8ab4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.235401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.236384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.236879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.237310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.238092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Adding query filter params (domain_id=6964fb727d884ceea8575c5488c98ab9) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:21.238516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:21.239646 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:21.239646 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:21.239646 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:21.248489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:21.269515 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3249/6460] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Oct 28 10:20:21 2022] GET /identity/v3/roles?domain_id=6964fb727d884ceea8575c5488c98ab9 => generated 408 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:21.270490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.282693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554c2a-c22e-44ea-9adf-cf29e441fe27 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.290103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.291180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.291699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.292190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/3b53cedea04f4b55b909aaeb5723100a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.294502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3b53cedea04f4b55b909aaeb5723100a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:21.296413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:21.309216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:21.373399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 3b53cedea04f4b55b909aaeb5723100a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:21.373668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:21.375021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:21.382607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3212/6461] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:21 2022] DELETE /identity/v3/roles/3b53cedea04f4b55b909aaeb5723100a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:21.384620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.386748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:21.412178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e627201-1873-4670-b745-947843043da3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.595447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.596755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.597436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.598031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.599212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Adding query filter params (domain_id=6964fb727d884ceea8575c5488c98ab9) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:21.599903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:21.602342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:21.613191 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3250/6462] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Oct 28 10:20:21 2022] GET /identity/v3/roles?domain_id=6964fb727d884ceea8575c5488c98ab9 => generated 148 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:21.617494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.651940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecd3a9-9813-4177-9390-4b852421624d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.665487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.665487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.665487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.665761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/3b53cedea04f4b55b909aaeb5723100a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.742568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Could not find role: 3b53cedea04f4b55b909aaeb5723100a.: keystone.exception.RoleNotFound: Could not find role: 3b53cedea04f4b55b909aaeb5723100a. Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 28 10:20:21.747689 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:21.748887 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3b53cedea04f4b55b909aaeb5723100a. Oct 28 10:20:21.749868 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:21.754925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.768238 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3213/6463] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:21 2022] DELETE /identity/v3/roles/3b53cedea04f4b55b909aaeb5723100a => generated 110 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:21.771150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a002a-0226-41e8-9438-44e0a40aba59 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:21.812654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:21.814879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:21.815170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:21.815452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:21.842527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:21.851128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:21.900380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3251/6464] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:21 2022] PUT /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:21.904466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:21.920606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045b9f-0e5c-432e-8e95-af816fbe80f8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.109342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.110192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.110613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.111003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.113007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6964fb727d884ceea8575c5488c98ab9, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.114170 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:22.114170 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:22.114170 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:22.117052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.142309 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3214/6465] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Oct 28 10:20:21 2022] GET /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles => generated 410 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:22.143664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:22.162910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a51494-939b-4c2e-80c6-6d715f882b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.174647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.175344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.175624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.175898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.178168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.179383 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:22.179383 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:22.179383 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:22.188110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.238426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3252/6466] 10.222.0.16 () {58 vars in 1465 bytes} [Fri Oct 28 10:20:22 2022] HEAD /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:22.243121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:22.255890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e803-b956-4a53-8c13-c9f1c2517bc4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.263810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.264528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.264809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.265133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.267349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.270199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.278260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role adb732c31d81474ea2c3ad5248881e45 was removed from group d6fbac3df8ec4c50a42573fc8e0e1f7e on domain 6964fb727d884ceea8575c5488c98ab9. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:22.278746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:22.279640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:22.304174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:22.304807 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3215/6467] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:20:22 2022] DELETE /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:22.306416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:22.320251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22806-af6a-4e57-8fca-c2ed5410c022 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.378275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:22.486297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.487746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.494911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.495417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.498286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=18eec3c0a5bb4f45891144153228afba, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.501390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.529795 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3253/6468] 10.222.0.16 () {60 vars in 1486 bytes} [Fri Oct 28 10:20:22 2022] PUT /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:22.533681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:22.553107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc436e-d517-4feb-8b5a-925da2db54a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.717438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.718906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.719364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.720461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.722847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_grants(project_id=18eec3c0a5bb4f45891144153228afba, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.725670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd647a48-b573-4975-96b9-fd72b132b5ce tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.778253 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3216/6469] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Oct 28 10:20:22 2022] GET /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles => generated 411 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:22.782277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:22.801447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6f93-28e0-4d62-ba4a-0cf4dc0b7946 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:22.807693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:22.808779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.809204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.809842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/users/9b4d0bedc46b46cca4ef8a348e6f9f0a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.812341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:22.814648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:22.871469 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3254/6470] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Oct 28 10:20:22 2022] PUT /identity/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/users/9b4d0bedc46b46cca4ef8a348e6f9f0a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:22.875578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:22.876084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:22.876517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:22.999801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] MFA Rules not processed for user `9b4d0bedc46b46cca4ef8a348e6f9f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:23.001878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:23.022880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:23.075098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:23.078747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:23.267267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f7bca-812e-4886-8b26-40c399b82fb9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:23.276682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:23.278668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:23.279303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:23.280401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:23.297568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:23.345926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3217/6471] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:23.347222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:23.405365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:23.408246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdebeed-d493-4059-9c91-2cb18c979165 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:23.431208 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3255/6472] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:23.478851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:23.479210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:23.479956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:23.526043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] MFA Rules not processed for user `608b9dc1a00d489a94524f99820022f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:23.527752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:23.578229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:23.593831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e02fd-d0c6-4c4e-8bd9-c00a096ce7c8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:23.610107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:23.610804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:23.617481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:23.617777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:23.623226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_grant(project_id=18eec3c0a5bb4f45891144153228afba, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:23.624279 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:23.624279 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:23.624279 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:23.638709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:23.658693 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3218/6473] 10.222.0.16 () {58 vars in 1468 bytes} [Fri Oct 28 10:20:23 2022] HEAD /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:23.664255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:23.673417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3256/6474] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:23.699389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295226e-f817-4763-81bb-b8c8c92fd561 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:23.716971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:23.721264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:23.721734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:23.724292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:23.732164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=18eec3c0a5bb4f45891144153228afba, group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:23.735318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:23.759593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role adb732c31d81474ea2c3ad5248881e45 was removed from group d6fbac3df8ec4c50a42573fc8e0e1f7e on project 18eec3c0a5bb4f45891144153228afba. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:23.759957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:23.760714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:23.789028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3219/6475] 10.222.0.16 () {58 vars in 1470 bytes} [Fri Oct 28 10:20:23 2022] DELETE /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:23.790225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:23.826314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93922ce-78db-4b0a-b4a6-e257626834c3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:23.970716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:23.971761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:23.972266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:23.972758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/users/9b4d0bedc46b46cca4ef8a348e6f9f0a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:23.975302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:23.977729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:23.990750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:24.020774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3257/6476] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:20:23 2022] DELETE /identity/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/users/9b4d0bedc46b46cca4ef8a348e6f9f0a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:24.021928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.024610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:24.048305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9a1-853d-4375-9e7d-845df0c8a92c tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.228153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.230996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.231459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.231654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.235751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.236638 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:24.236638 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:24.236638 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:24.240200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.258929 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3220/6477] 10.222.0.16 () {60 vars in 1381 bytes} [Fri Oct 28 10:20:24 2022] PUT /identity/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:24.262956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.294375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943596ca-fb18-48de-8779-3eacc42eabe0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.319656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.320884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.321240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.321529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.324539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.326059 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:24.326059 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:24.326059 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:24.326924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.364840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3258/6478] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:20:24 2022] GET /identity/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles => generated 376 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:24.369251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.375028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:24.392824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04080-646a-485b-a0c2-884a66696eb0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.402286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.405212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.405720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.407037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.412546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.414712 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:24.414712 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:24.414712 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:24.420886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.450259 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3221/6479] 10.222.0.16 () {58 vars in 1363 bytes} [Fri Oct 28 10:20:24 2022] HEAD /identity/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:24.452013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.464477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53f05-e719-49cf-b00f-b340e5a70dc8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.480370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.481800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.483629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.484127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.488256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.490825 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:24.490825 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:24.490825 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:24.493854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.517552 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3259/6480] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Oct 28 10:20:24 2022] DELETE /identity/v3/system/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:24.518752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.532702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0816-3a9e-4e0e-9b56-3e6b09a291d4 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.545747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.546440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.546721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.546994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.553396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.557628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.596009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3222/6481] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Oct 28 10:20:24 2022] PUT /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:24.599839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.627564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1748c-a818-41cb-b651-d7d05a1c3590 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.814865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.815645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.815999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.816351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.821865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6964fb727d884ceea8575c5488c98ab9, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.823013 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:24.823013 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:24.823013 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:24.825027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.883438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3260/6482] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Oct 28 10:20:24 2022] GET /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles => generated 409 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:24.885008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.901711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcaa7a-0c35-460a-8cd8-f1f029687a6a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.916040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.917380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.917660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.917934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:24.924218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:24.926962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:24.951285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3223/6483] 10.222.0.16 () {58 vars in 1462 bytes} [Fri Oct 28 10:20:24 2022] HEAD /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:24.956233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:24.968541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821052-55df-4737-8193-7abba7e32080 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:24.990915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:24.991704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:24.991995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:24.992842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:25.005219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6964fb727d884ceea8575c5488c98ab9, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:25.007970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:25.038434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role adb732c31d81474ea2c3ad5248881e45 was removed from user 9b4d0bedc46b46cca4ef8a348e6f9f0a on domain 6964fb727d884ceea8575c5488c98ab9. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:25.038742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:25.041597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:25.091955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3261/6484] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Oct 28 10:20:24 2022] DELETE /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:25.094016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:25.100781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:25.123692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e9110-867d-47e7-8b97-7c7a9fe1d988 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:25.347539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:25.348616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:25.349178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:25.349695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:25.354961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:25.380285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:25.429845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3224/6485] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:25 2022] PUT /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:25.433791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:25.449581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42c80-c12e-4a53-9277-d9fb4e8697f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:25.486475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:25.647617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:25.651019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:25.651544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:25.651969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:25.656846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_grants(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:25.674482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:25.710734 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3262/6486] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Oct 28 10:20:25 2022] GET /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles => generated 410 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:25.715573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:25.731393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8af4d-78ea-48e1-b496-d9970a08e8ac tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:25.745798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:25.759171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:25.759508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:25.759726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:25.785414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:25.789428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:25.808293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3225/6487] 10.222.0.16 () {58 vars in 1465 bytes} [Fri Oct 28 10:20:25 2022] HEAD /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:25.813647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:25.829417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413d651-44d2-40e9-8b6e-1375b50545a8 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:25.842909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:25.844181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:25.844797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:25.848719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:25.854557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=18eec3c0a5bb4f45891144153228afba, user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:25.858766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:25.875593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role adb732c31d81474ea2c3ad5248881e45 was removed from user 9b4d0bedc46b46cca4ef8a348e6f9f0a on project 18eec3c0a5bb4f45891144153228afba. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:25.875593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:25.877671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:25.905386 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3263/6488] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Oct 28 10:20:25 2022] DELETE /identity/v3/projects/18eec3c0a5bb4f45891144153228afba/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:25.911643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:25.915503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:25.940776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1d8d9-8437-4421-92dd-4bab2c55bb14 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.130263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.131830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.132408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.133105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.135320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.136814 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:26.136814 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:26.136814 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:26.138320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.147965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3226/6489] 10.222.0.16 () {60 vars in 1378 bytes} [Fri Oct 28 10:20:25 2022] PUT /identity/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:26.152617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.168037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e10d2-9653-4b83-88f1-89b65f8aeeeb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.179647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.180782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.181327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.182392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.186136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.188461 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:26.188461 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:26.188461 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:26.192226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.223666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3264/6490] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:20:26 2022] GET /identity/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles => generated 375 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:26.228512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.253758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e8d3-a16c-4890-afd3-66a06afdaf26 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.265088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.265911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.266392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.267827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.270701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.272208 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:26.272208 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:26.272208 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:26.273692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.294798 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3227/6491] 10.222.0.16 () {58 vars in 1360 bytes} [Fri Oct 28 10:20:26 2022] HEAD /identity/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:26.300743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.332826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fb3d-e605-4ab8-8617-9fa901bd26c3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.385283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.386412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.386889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.387969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.396550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a, role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.405492 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:26.405492 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:26.405492 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:26.407199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.435957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3265/6492] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Oct 28 10:20:26 2022] DELETE /identity/v3/system/users/9b4d0bedc46b46cca4ef8a348e6f9f0a/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:26.443373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.460796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459dbb6-dabb-4415-9c67-7be93475e332 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.491265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.491894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.492222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.494631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.496769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.505998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.565074 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3228/6493] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:26 2022] POST /identity/v3/roles => generated 270 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:26.571228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.599245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0eba3-cfaf-4f19-8d73-ffe91ad15465 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.618514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.620017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.620834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.621696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.623305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.627933 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:26.627933 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:26.627933 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:26.643063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.690622 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3266/6494] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:26 2022] POST /identity/v3/roles => generated 269 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:26.698420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.730640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34114-5ec3-4544-b538-299b53e5cbd9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:26.736648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:26.737631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:26.738098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:26.738553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/622e8b1b7a81475c8fc6dddd549e1172` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:26.740672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=622e8b1b7a81475c8fc6dddd549e1172)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:26.742996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:26.775885 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3229/6495] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:26 2022] PUT /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/622e8b1b7a81475c8fc6dddd549e1172 => generated 530 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:26.780825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:26.810763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa215a-4e60-432b-ac4e-c8a1138550bf tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:27.019984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:27.021108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:27.021597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:27.022087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:27.023869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:27.028190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:27.066497 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3267/6496] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:20:26 2022] POST /identity/v3/domains => generated 276 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:27.069233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:27.081401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c85b4-62ad-42a1-9b02-a59f76636172 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:27.094429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:27.197031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:27.197952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:27.200098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:27.200475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:27.201467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:27.207073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:27.243878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:27.245430 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3230/6497] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:27 2022] POST /identity/v3/roles => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:27.295233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad11ce0-df49-4860-8689-f4f1839e9c83 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:27.308513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:27.310065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:27.310570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:27.311077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/c109a3fa76a7453c83e92d49b5d56013` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:27.313506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=c109a3fa76a7453c83e92d49b5d56013)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:27.314842 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:27.314842 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:27.314842 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:27.316125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:27.363082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3268/6498] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:27 2022] PUT /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/c109a3fa76a7453c83e92d49b5d56013 => generated 530 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:27.368230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:27.388408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ba577-3572-4bce-8cbe-8e4141bab15f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:27.642509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:27.643301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:27.643714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:27.644104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:27.650865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:27.653836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:27.712071 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3231/6499] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:27 2022] PUT /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/adb732c31d81474ea2c3ad5248881e45 => generated 526 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:27.716370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:27.732780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153362-c8ec-43d8-add8-caac51788b3d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:27.771318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:27.986881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:27.988788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:27.989587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:27.990075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/adb732c31d81474ea2c3ad5248881e45/implies/c42418cdec2a49349264d14783de4e89` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:27.992112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=adb732c31d81474ea2c3ad5248881e45, implied_role_id=c42418cdec2a49349264d14783de4e89)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:27.994690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] c42418cdec2a49349264d14783de4e89 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: c42418cdec2a49349264d14783de4e89 cannot be an implied roles. Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 28 10:20:28.093734 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: c42418cdec2a49349264d14783de4e89 cannot be an implied roles. Oct 28 10:20:28.095792 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:28.111969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:28.113440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3269/6500] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:27 2022] PUT /identity/v3/roles/adb732c31d81474ea2c3ad5248881e45/implies/c42418cdec2a49349264d14783de4e89 => generated 116 bytes in 392 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:28.126754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc579b-c250-4c01-b514-cfaefdec2992 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:28.140164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:28.141123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:28.141532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:28.141954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:28.144370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:28.146926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:28.165953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3232/6501] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:28 2022] DELETE /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:28.170893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:28.215190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e0d7-e171-4478-8bf4-0ef205a36967 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:28.376782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:28.377680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:28.378073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:28.378458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/c109a3fa76a7453c83e92d49b5d56013` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:28.380453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=c109a3fa76a7453c83e92d49b5d56013)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:28.383420 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:28.383420 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:28.383420 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:28.384593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:28.407091 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3270/6502] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:28 2022] DELETE /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/c109a3fa76a7453c83e92d49b5d56013 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:28.411335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:28.439563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e458-bee5-472a-aac9-6bd5edf35806 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:28.705069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:28.706237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:28.706727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:28.707234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c109a3fa76a7453c83e92d49b5d56013` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:28.708979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c109a3fa76a7453c83e92d49b5d56013)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:28.715063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:28.742464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:28.815734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role c109a3fa76a7453c83e92d49b5d56013 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:28.816027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:28.816757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:28.822686 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3233/6503] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:28 2022] DELETE /identity/v3/roles/c109a3fa76a7453c83e92d49b5d56013 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:28.824031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:28.826442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:28.866502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ce0f0-6c85-4ffc-aedc-cd8fd9c7d461 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:29.168263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:29.169211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:29.169571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:29.169928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/ff0d66762ecd4767901e1de505bae7cc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:29.239887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ff0d66762ecd4767901e1de505bae7cc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:29.241637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:29.303356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.309918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.362288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:29.369583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.370306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.375900 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3271/6504] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:28 2022] PATCH /identity/v3/domains/ff0d66762ecd4767901e1de505bae7cc => generated 277 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:29.377234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:29.403753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf4d2-0cac-4733-8134-c6c6b857313f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:29.529665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:29.530343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:29.530629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:29.530902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/ff0d66762ecd4767901e1de505bae7cc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:29.557272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ff0d66762ecd4767901e1de505bae7cc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:29.559182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:29.619075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.627866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.761652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.777048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.797520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.828154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] The token cache is being invalidate because project ff0d66762ecd4767901e1de505bae7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:29.829965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.834339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.871504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.877640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.881578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ff0d66762ecd4767901e1de505bae7cc', 'request_id': 'req-d2e705df-924c-418f-8a31-3eac0b3ed604'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:29.919103 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3234/6505] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:29 2022] DELETE /identity/v3/domains/ff0d66762ecd4767901e1de505bae7cc => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:29.923425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:29.926563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:29.956179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af993-d739-47b5-b1fe-75c19cf621f2 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:30.084311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:30.088594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:30.089044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:30.089388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89/implies/622e8b1b7a81475c8fc6dddd549e1172` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:30.095153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c42418cdec2a49349264d14783de4e89, implied_role_id=622e8b1b7a81475c8fc6dddd549e1172)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:30.098564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:30.127933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3272/6506] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:29 2022] DELETE /identity/v3/roles/c42418cdec2a49349264d14783de4e89/implies/622e8b1b7a81475c8fc6dddd549e1172 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:30.129203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:30.131596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:30.168442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e705df-924c-418f-8a31-3eac0b3ed604 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:30.192171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:30.306784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:30.307525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:30.307738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:30.308003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/622e8b1b7a81475c8fc6dddd549e1172` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:30.310516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=622e8b1b7a81475c8fc6dddd549e1172)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:30.312369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:30.429082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 622e8b1b7a81475c8fc6dddd549e1172 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:30.429705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:30.437073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:30.440302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3235/6507] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:30 2022] DELETE /identity/v3/roles/622e8b1b7a81475c8fc6dddd549e1172 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:30.444612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:30.447006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:30.476060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0e9cc-6b3b-45de-8540-62a6abfb1069 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:30.634652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:30.636507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:30.636809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:30.637659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/c42418cdec2a49349264d14783de4e89` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:30.640333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c42418cdec2a49349264d14783de4e89)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:30.643049 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:30.643049 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:30.643049 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:30.645151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:30.721571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role c42418cdec2a49349264d14783de4e89 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:30.723295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:30.724674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:30.736152 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3273/6508] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:30 2022] DELETE /identity/v3/roles/c42418cdec2a49349264d14783de4e89 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:30.737256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:30.758125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2014d8-9c42-4560-8006-017a8bf5ebe7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:30.955229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:30.956022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:30.956405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:30.956806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:30.960383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:30.965447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.041185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3236/6509] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:30 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 521 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:31.045728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.050016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:31.070349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6826e21-9e4b-44d4-ba5e-915236f498f1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.252739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.253484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.253773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.254082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.257036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.258690 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:31.258690 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:31.258690 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:31.259875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.260986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.262117 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:31.262117 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:31.262117 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:31.263017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.264800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:31.276040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3274/6510] 10.222.0.16 () {58 vars in 1345 bytes} [Fri Oct 28 10:20:31 2022] HEAD /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:31.282554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.306886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6668de7-7b92-4978-908f-e0a906413062 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.322966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.323749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.324125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.324495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.326513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.327546 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:31.327546 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:31.327546 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:31.328558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.351657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3237/6511] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:20:31 2022] GET /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 521 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:31.354573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.374155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402f60e-2730-4975-abfe-fcae4157cffe tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.394564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.395358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.395724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.396863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.399489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.403641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.430048 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3275/6512] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:31 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:31.430875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.450332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8aa4-71b4-47fa-972d-2cf7d8de19bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.566363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:31.599729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.599729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.599729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.600101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.604427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.609207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c.: keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = query.one() Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._iter().one() Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._only_one_row( Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:31.629745 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 28 10:20:31.630738 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 28 10:20:31.631684 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 28 10:20:31.631684 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:31.631684 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:20:31.632260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3238/6513] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Oct 28 10:20:31 2022] GET /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 137 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:31.639380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.657746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba78c-5a8d-4fc6-baca-dea2449481a0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.669355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.671647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.673259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.673662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.678670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.680684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c.: keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = query.one() Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._iter().one() Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._only_one_row( Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:31.708200 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 28 10:20:31.709562 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 28 10:20:31.710917 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 28 10:20:31.710917 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 28 10:20:31.710917 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 28 10:20:31.710917 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 7c8c9a18c80d4af2be5e2f36325335a9 does not imply 7456965641424fc2b825a80e632cb04c. Oct 28 10:20:31.710917 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:31.717275 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3276/6514] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:31 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 137 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:31.719960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.746708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb056d7d-9f53-431c-9187-a32bcb75a19b tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:31.764125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:31.766531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:31.767001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:31.767440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:31.773626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:31.788739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:31.862013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3239/6515] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:31 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 521 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:31.867275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:31.885711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92373ead-129e-418c-a693-ad49889498f5 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.027591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.031234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.032319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.033628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.040429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.042151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.094190 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3277/6516] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:31 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186 => generated 521 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:32.096766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.112827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f8657-ea4a-470f-b24b-c8f5e6abe5e7 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.236330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.238388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:32.247321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.250793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.251127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.251413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.255773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dada394cf732424baafdfa64de5b2186, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.257897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.313643 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3240/6517] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:32 2022] PUT /identity/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45 => generated 521 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:32.317401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.430243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc108-0b22-4bf8-a3a5-517db724a842 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.448703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa414-33ec-4a2f-853c-2067e7ecc188 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.460273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.462935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.463227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.463660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.464398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.467605 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:32.467605 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:32.467605 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:32.468865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.499368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.499993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.500272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.500544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.502425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:32.532120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3241/6518] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:20:32 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:32.537741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.543173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:32.573876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e0948-fd2d-46de-8e34-f8c4e2180a52 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.587060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.590583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.591070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.591492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.596037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dada394cf732424baafdfa64de5b2186, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.597271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.598736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.599644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.612970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3278/6519] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:20:32.618781 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3242/6520] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:32 2022] DELETE /identity/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:32.624254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.649879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8618c01-201e-4534-becd-afcbd0a8d2b1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.760193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.761505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.762109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.762605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.766644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.768505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:32.788771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3279/6521] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:32 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:32.795001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:32.821681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba5292-b809-4a80-9d4a-d85f0c4913a9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:32.879915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:32.988616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:32.989390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:32.989675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:32.989954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:32.996711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:32.997854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.034470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3243/6522] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:32 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:33.040677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.054717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859231-d899-45e7-b4f1-d89a6331d65a tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.205832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.208788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.209407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.210067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.213497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.217819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.247853 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3280/6523] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:33 2022] GET /identity/v3/roles => generated 2324 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:33.253182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.268689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565024a-9a53-4cdb-8a0e-02a3c2547389 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.305965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.306748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.307116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.307467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.308395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.311227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.333278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3244/6524] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:33 2022] POST /identity/v3/roles => generated 234 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:33.338377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.350660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff2c7-059d-4ac4-b702-208cd4934499 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.357348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.358228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.358685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.359590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/1ababa7e845544b7a88bbf0e6f54940e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.361328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:update_role(role_id=1ababa7e845544b7a88bbf0e6f54940e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.362663 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:33.362663 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:33.362663 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:33.364418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.416402 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3281/6525] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 10:20:33 2022] PATCH /identity/v3/roles/1ababa7e845544b7a88bbf0e6f54940e => generated 238 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:33.419718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.432571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a9306-6d6a-4d98-86c4-e66a25215477 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.438175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.439045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.439520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.439956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/1ababa7e845544b7a88bbf0e6f54940e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.453113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:get_role(role_id=1ababa7e845544b7a88bbf0e6f54940e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.454347 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:33.454347 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:33.454347 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:33.456099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.458744 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3245/6526] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:33 2022] GET /identity/v3/roles/1ababa7e845544b7a88bbf0e6f54940e => generated 238 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:33.471520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.487564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde3a3-244e-4b57-949d-e1b938b79c39 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.511909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.511909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.513800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.514114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.517380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.520950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.551533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.555156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3282/6527] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:33 2022] GET /identity/v3/roles => generated 2553 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:20:33.566459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6469f-8be1-4511-a68f-63b73ce84a40 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.593749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.595988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.599269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.599643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/1ababa7e845544b7a88bbf0e6f54940e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.604455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1ababa7e845544b7a88bbf0e6f54940e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.609836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.703440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 1ababa7e845544b7a88bbf0e6f54940e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:33.703851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:33.715795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:33.721301 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3246/6528] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:33 2022] DELETE /identity/v3/roles/1ababa7e845544b7a88bbf0e6f54940e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:33.726374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.730357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:33.754756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739312-8ff1-469a-b97b-6600ef410d11 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:33.785924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:33.812398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:33.814712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:33.902849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:33.904340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:33.904791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:33.905249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:33.907692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:33.909766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:33.975047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3283/6529] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:33 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 521 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:33.976195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.019873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecff5c7-c289-4750-9848-fdc49436a8a3 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.102482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331bed-5076-4762-a74f-b48cb9440f2e tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.123920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.124593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.125247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.125525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.127251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.128878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.200490 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3284/6530] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:33 2022] PUT /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186 => generated 521 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:34.204039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.220266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.221562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.222996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.223373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] PATH_INFO: `/v3/users/b38ecf652dca499985efef29c04bf5d5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.226952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38ecf652dca499985efef29c04bf5d5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.229356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.236751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:34.368793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38ecf652dca499985efef29c04bf5d5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:34.369826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38ecf652dca499985efef29c04bf5d5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:34.378109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38ecf652dca499985efef29c04bf5d5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:34.382497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063f48-43e5-44f5-9674-adf1dfdcb4a1 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.391363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38ecf652dca499985efef29c04bf5d5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:34.397783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.399272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.399564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.399840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.408163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-81c17c08-1e61-49fd-a3ad-4a5592ee931f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38ecf652dca499985efef29c04bf5d5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:34.410055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dada394cf732424baafdfa64de5b2186, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.412188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.448632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:34.457382 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3247/6531] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:33 2022] DELETE /identity/v3/users/b38ecf652dca499985efef29c04bf5d5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:34.467176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.467619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.468144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.468267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3285/6532] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Oct 28 10:20:34 2022] PUT /identity/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45 => generated 521 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:34.469196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.477902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:34.521061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:34.528097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:34.573164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0aa01-cc24-4ae5-bade-920a577e8d6d tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.579013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.580171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.580617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.581094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186/implies` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.582723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.584024 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:34.584024 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:34.584024 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:34.586225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.594662 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3286/6533] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:20:34 2022] GET /identity/v3/roles/dada394cf732424baafdfa64de5b2186/implies => generated 490 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:34.605914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.630276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55dc91-ed69-4c27-befe-47fb0329db80 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.647979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.649408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.649863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.650243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.654775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.657277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.675369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3287/6534] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:20:34 2022] GET /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies => generated 661 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:34.681050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.700350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224eff4-e615-4ee3-8091-ca154d9bee37 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.705134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3248/6535] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:34.712641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.714090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:34.714926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.715713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.716106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.716494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.723664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dada394cf732424baafdfa64de5b2186, implied_role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.725652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.747023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3288/6536] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:34 2022] DELETE /identity/v3/roles/dada394cf732424baafdfa64de5b2186/implies/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:34.751496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.841568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3582b-0a34-4061-a215-d7df6be3bfb6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.933090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:34.939655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80375ac-6479-49fe-b460-f39ebe8c5b98 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:34.947550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.948634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.949197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.949702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:34.951961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:34.953952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:34.973591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3289/6537] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:34 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/dada394cf732424baafdfa64de5b2186 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:34.977916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:34.989867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:34.990500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:34.990781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:34.991052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.135442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156587a4-4b87-4e13-82e8-e881fb52f7c0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:35.150773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:35.151437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:35.151720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:35.151994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.153905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7c8c9a18c80d4af2be5e2f36325335a9, implied_role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:35.155547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:35.174361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:35.175031 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3290/6538] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Oct 28 10:20:34 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9/implies/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:35.178854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:35.180391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:35.190770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:35.194801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3249/6539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:20:35.326778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb1258-eff8-4115-aefd-ca99cb175993 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:35.333871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:35.334535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:35.334826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:35.335097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/ff0d66762ecd4767901e1de505bae7cc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.356800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Could not find domain: ff0d66762ecd4767901e1de505bae7cc.: keystone.exception.DomainNotFound: Could not find domain: ff0d66762ecd4767901e1de505bae7cc. Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ff0d66762ecd4767901e1de505bae7cc. Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:20:35.370854 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:20:35.371964 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ff0d66762ecd4767901e1de505bae7cc. Oct 28 10:20:35.372958 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:20:35.374011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3291/6540] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:35 2022] PATCH /identity/v3/domains/ff0d66762ecd4767901e1de505bae7cc => generated 112 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:20:35.377710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:35.403328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29467-1ff8-4139-9a09-1c1b45f10db7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:35.418726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:35.419825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:35.420484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:35.420980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/users/9b4d0bedc46b46cca4ef8a348e6f9f0a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.423051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9b4d0bedc46b46cca4ef8a348e6f9f0a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:35.431402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:35.554931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.556185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.557129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.587058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.613675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4d0bedc46b46cca4ef8a348e6f9f0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.659953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3250/6541] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:35 2022] DELETE /identity/v3/users/9b4d0bedc46b46cca4ef8a348e6f9f0a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:35.665074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:35.668279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:35.694977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe85a-3699-4da6-a8eb-16fdf9ddad07 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:35.806326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:35.806826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:35.807117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:35.807400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/adb732c31d81474ea2c3ad5248881e45` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.809135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=adb732c31d81474ea2c3ad5248881e45)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:35.811150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:35.856100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role adb732c31d81474ea2c3ad5248881e45 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:35.856475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.857091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:35.859536 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3292/6542] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:35 2022] DELETE /identity/v3/roles/adb732c31d81474ea2c3ad5248881e45 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:35.863363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:35.875721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7ef2-2740-489f-a95a-e25f40908f0f tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:35.962220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:35.963503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:35.964693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:35.965843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:35.967795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d6fbac3df8ec4c50a42573fc8e0e1f7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:35.970114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:35.974317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.055788 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3251/6543] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:20:35 2022] DELETE /identity/v3/groups/d6fbac3df8ec4c50a42573fc8e0e1f7e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:36.059983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:36.062164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:36.088130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691c50-ad7e-4980-827a-3c64a80231bb tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:36.177585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:36.178259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:36.178549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:36.178824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/projects/18eec3c0a5bb4f45891144153228afba` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:36.181059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18eec3c0a5bb4f45891144153228afba)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:36.183927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:36.200400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.262248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18eec3c0a5bb4f45891144153228afba', 'request_id': 'req-2a121956-2d0f-4576-9231-d1917b9570e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.277413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18eec3c0a5bb4f45891144153228afba', 'request_id': 'req-2a121956-2d0f-4576-9231-d1917b9570e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.293137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18eec3c0a5bb4f45891144153228afba', 'request_id': 'req-2a121956-2d0f-4576-9231-d1917b9570e0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.332670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] The token cache is being invalidate because project 18eec3c0a5bb4f45891144153228afba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:36.333091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.334134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.341044 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3293/6544] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:36 2022] DELETE /identity/v3/projects/18eec3c0a5bb4f45891144153228afba => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:36.345936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:36.346073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:36.347499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:36.349269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:36.375812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a7e73-c58e-45c6-a66e-37bd032e5189 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:36.492249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121956-2d0f-4576-9231-d1917b9570e0 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:36.503885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:36.504720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:36.504966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:36.505241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] PATH_INFO: `/v3/projects/f1d3f86c29a54f33b5a2a85c7e733886` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:36.507100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d3f86c29a54f33b5a2a85c7e733886)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:36.511906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:36.519022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:36.531506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:36.532484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:36.533214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:36.536855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6964fb727d884ceea8575c5488c98ab9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:36.539505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:36.579683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.590036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.640583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.641382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.644216 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3252/6545] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:20:36 2022] PATCH /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9 => generated 276 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:36.650091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:36.654020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:36.690907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d3f86c29a54f33b5a2a85c7e733886', 'request_id': 'req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.708730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d3f86c29a54f33b5a2a85c7e733886', 'request_id': 'req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.736860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d3f86c29a54f33b5a2a85c7e733886', 'request_id': 'req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.757142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] The token cache is being invalidate because project f1d3f86c29a54f33b5a2a85c7e733886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:36.757488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.758175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:36.759962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3294/6546] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:36 2022] DELETE /identity/v3/projects/f1d3f86c29a54f33b5a2a85c7e733886 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:36.764148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:36.765157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:36.842058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05d81-16e1-40e8-a8ff-a574af3333d9 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:36.857468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.902197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.920785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6be0b-acb0-4ac2-abc0-4f567e82d82b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:36.926542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:36.927238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:36.927524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:36.927957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] PATH_INFO: `/v3/users/0710171c960f44c8923fa570ab91718c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:36.929070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0710171c960f44c8923fa570ab91718c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:36.931701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:36.984805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:36.986287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:36.987187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:36.987736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/domains/6964fb727d884ceea8575c5488c98ab9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:36.999721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0710171c960f44c8923fa570ab91718c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.002434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0710171c960f44c8923fa570ab91718c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.006296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6964fb727d884ceea8575c5488c98ab9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:37.008487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:37.020315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0710171c960f44c8923fa570ab91718c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.035396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0710171c960f44c8923fa570ab91718c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.037912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0710171c960f44c8923fa570ab91718c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.047288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.054262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6964fb727d884ceea8575c5488c98ab9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.085703 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3295/6547] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:36 2022] DELETE /identity/v3/users/0710171c960f44c8923fa570ab91718c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:37.158805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.176715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.194866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.219030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] The token cache is being invalidate because project 6964fb727d884ceea8575c5488c98ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:37.219818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.220810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.232067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.237178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.237938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6964fb727d884ceea8575c5488c98ab9', 'request_id': 'req-3f048fbd-731c-44d4-91bb-2e1279518869'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.247789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3253/6548] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:36 2022] DELETE /identity/v3/domains/6964fb727d884ceea8575c5488c98ab9 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:37.251817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:37.254470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:37.399418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1d85-ca00-4649-adaf-369cb4c77fdb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:37.486141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:37.493264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:37.494351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:37.494955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:37.495349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/dada394cf732424baafdfa64de5b2186` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:37.496387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:37.497189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dada394cf732424baafdfa64de5b2186)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:37.498246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:37.499230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:37.560587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role dada394cf732424baafdfa64de5b2186 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:37.561838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.563078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.566534 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3296/6549] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:37 2022] DELETE /identity/v3/roles/dada394cf732424baafdfa64de5b2186 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:37.570900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:37.572860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:37.641422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048fbd-731c-44d4-91bb-2e1279518869 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:37.659570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:37.672254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd94b-7315-4faf-8570-9def9ae93d91 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:37.678779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:37.680502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:37.680868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:37.681270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7456965641424fc2b825a80e632cb04c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:37.683410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7456965641424fc2b825a80e632cb04c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:37.686813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:37.739904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:37.740757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:37.741260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:37.741711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] PATH_INFO: `/v3/projects/006eefc4914e4bebafca20cc6bf69e1d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:37.744032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006eefc4914e4bebafca20cc6bf69e1d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:37.746787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:37.764552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 7456965641424fc2b825a80e632cb04c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:37.765101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.767362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.772639 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3297/6550] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:37 2022] DELETE /identity/v3/roles/7456965641424fc2b825a80e632cb04c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:37.777504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:37.783325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:37.837331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006eefc4914e4bebafca20cc6bf69e1d', 'request_id': 'req-37f4632a-3fd3-458f-96f1-2509ea130439'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.844686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006eefc4914e4bebafca20cc6bf69e1d', 'request_id': 'req-37f4632a-3fd3-458f-96f1-2509ea130439'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.856689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006eefc4914e4bebafca20cc6bf69e1d', 'request_id': 'req-37f4632a-3fd3-458f-96f1-2509ea130439'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.877867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] The token cache is being invalidate because project 006eefc4914e4bebafca20cc6bf69e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:37.878511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.880635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f4632a-3fd3-458f-96f1-2509ea130439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:37.885416 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3254/6551] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:37 2022] DELETE /identity/v3/projects/006eefc4914e4bebafca20cc6bf69e1d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:37.889664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac668ba-0e7a-47c1-b843-9937b41a3a1a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:37.890144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac668ba-0e7a-47c1-b843-9937b41a3a1a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:37.890570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac668ba-0e7a-47c1-b843-9937b41a3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:37.909024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9e73-7d8b-4f1b-89c8-53df3c827b77 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:37.919126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eac668ba-0e7a-47c1-b843-9937b41a3a1a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:37.920612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eac668ba-0e7a-47c1-b843-9937b41a3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:37.973679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:38.017332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2711de8d0f4f2c8637c2dcc89750f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f59e623abc02452b80e4adc87bdac34a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.018366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.018806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.019402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] PATH_INFO: `/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.020996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7c8c9a18c80d4af2be5e2f36325335a9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.024085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.024665 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3255/6552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:38.032250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.032670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.033075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.055844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:38.057244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.082434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invalidating the token cache because role 7c8c9a18c80d4af2be5e2f36325335a9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:38.082982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.083822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.089011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3298/6553] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:37 2022] DELETE /identity/v3/roles/7c8c9a18c80d4af2be5e2f36325335a9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:38.090433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.091903 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3256/6554] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:38.095252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.096134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.110288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3bbe-5401-4e3f-abba-e8bad42faea2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.177607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3af91-8c4f-4c25-8a51-05ed5ccccdf6 tempest-RolesV3TestJSON-141381852 tempest-RolesV3TestJSON-141381852-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.184254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.185193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.185476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.185753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] PATH_INFO: `/v3/users/dea9093b71f14d2f9ac8fcbc43f059b5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.189007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea9093b71f14d2f9ac8fcbc43f059b5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.189641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.193282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:38.222559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.223302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.223699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.224047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.225773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:38.226163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.228224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.248574 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3257/6555] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:38.253041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.255462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.272652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1134e-58d6-4620-9c8d-8ad17decceec admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.278953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea9093b71f14d2f9ac8fcbc43f059b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.279914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea9093b71f14d2f9ac8fcbc43f059b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.281119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.281818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.282173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.282499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.283246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.285711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.291598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea9093b71f14d2f9ac8fcbc43f059b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.300943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea9093b71f14d2f9ac8fcbc43f059b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.302010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-19116e82-7c19-43e7-82b5-4eedf43520d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea9093b71f14d2f9ac8fcbc43f059b5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:38.324507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3299/6556] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:38 2022] DELETE /identity/v3/users/dea9093b71f14d2f9ac8fcbc43f059b5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:38.329249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.329556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.329873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.345067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3258/6557] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:38 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:38.348715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.352304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.357113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:38.358312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.385246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:38.449002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a00e1f-2286-4d01-86c3-5ae5c697956d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.459246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3300/6558] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:20:38.463081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.463471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.463752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.464023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.464895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.467004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.482033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.484629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.510174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3259/6559] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:38 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:38.513126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.535735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2f31-cf47-4573-a9a4-9e7b006f0d70 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.542091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.542903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.543334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.543610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.545222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.546891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.563025 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3260/6560] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:38.565156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.578086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9f96-08b9-46a6-8f82-2dd8a92463e4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.584952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.585978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.586404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.586817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.589675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.591494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.612929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977ca7-8ab4-4cf4-9d4f-c1eea6e7a00a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.613538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3261/6561] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:38.614737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.617149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.617967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.618347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.618755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.627738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86806-2a01-4dd5-8193-8d6e445ab4b8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.635550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.636733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.637057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.637332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] PATH_INFO: `/v3/projects/a538273ed5864777b0ebd5b1ca67e8bd/users/08bc01cbeeb74f1bb04b51f54f6aaded/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.637582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.639173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600dd4-11bc-47be-83da-23f7721935d9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.656929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3301/6562] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:38.661538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a538273ed5864777b0ebd5b1ca67e8bd, user_id=08bc01cbeeb74f1bb04b51f54f6aaded, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.664838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.684327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3262/6563] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:38 2022] PUT /identity/v3/projects/a538273ed5864777b0ebd5b1ca67e8bd/users/08bc01cbeeb74f1bb04b51f54f6aaded/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:38.698099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.698439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.698710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.743634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] MFA Rules not processed for user `08bc01cbeeb74f1bb04b51f54f6aaded`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:38.744978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.830903 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3302/6564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:38.853693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:38.856234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:38.939452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:38.951380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36ea50-7fac-4239-a208-b9bff9058817 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:38.955257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:38.955878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:38.956156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:38.956420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:38.965874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:38.967299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:38.977705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3263/6565] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:39.297225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:39.299377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:39.387620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:39.401392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75223-2178-49a9-8cdf-5f225b275a36 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:39.406185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:39.408146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:39.408146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:39.408146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] PATH_INFO: `/v3/projects/091b26ec034040f7895de77b01c78576` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:39.409685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=091b26ec034040f7895de77b01c78576)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:39.411962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:39.519518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091b26ec034040f7895de77b01c78576', 'request_id': 'req-58960ece-076d-4cfb-b422-f8fe4c787dcf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.526837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091b26ec034040f7895de77b01c78576', 'request_id': 'req-58960ece-076d-4cfb-b422-f8fe4c787dcf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.535127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091b26ec034040f7895de77b01c78576', 'request_id': 'req-58960ece-076d-4cfb-b422-f8fe4c787dcf'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.550578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] The token cache is being invalidate because project 091b26ec034040f7895de77b01c78576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:39.551201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.551733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.553332 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3303/6566] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:39 2022] DELETE /identity/v3/projects/091b26ec034040f7895de77b01c78576 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:39.557722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:39.569144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e079a-c657-4ca5-841e-c3caed3f5611 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:39.691775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:39.692433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:39.692713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:39.693219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] PATH_INFO: `/v3/users/cf2711de8d0f4f2c8637c2dcc89750f4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:39.695959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2711de8d0f4f2c8637c2dcc89750f4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:39.700374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:39.799332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2711de8d0f4f2c8637c2dcc89750f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.799984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2711de8d0f4f2c8637c2dcc89750f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.800669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2711de8d0f4f2c8637c2dcc89750f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.819830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2711de8d0f4f2c8637c2dcc89750f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.830582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e1170193-9907-4271-a579-786a077519f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2711de8d0f4f2c8637c2dcc89750f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:39.878188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3264/6567] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:39 2022] DELETE /identity/v3/users/cf2711de8d0f4f2c8637c2dcc89750f4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:40.566156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:40.567634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:40.591050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960ece-076d-4cfb-b422-f8fe4c787dcf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:40.717686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:40.718373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:40.718627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:40.718899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] PATH_INFO: `/v3/projects/f59e623abc02452b80e4adc87bdac34a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:40.720132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59e623abc02452b80e4adc87bdac34a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:40.722096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:40.844624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59e623abc02452b80e4adc87bdac34a', 'request_id': 'req-a66336d6-e253-4c9a-810c-1ed672f42739'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:40.853023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59e623abc02452b80e4adc87bdac34a', 'request_id': 'req-a66336d6-e253-4c9a-810c-1ed672f42739'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:40.863078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59e623abc02452b80e4adc87bdac34a', 'request_id': 'req-a66336d6-e253-4c9a-810c-1ed672f42739'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:40.906289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] The token cache is being invalidate because project f59e623abc02452b80e4adc87bdac34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:40.906642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:40.907256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a66336d6-e253-4c9a-810c-1ed672f42739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:40.909429 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3304/6568] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:40 2022] DELETE /identity/v3/projects/f59e623abc02452b80e4adc87bdac34a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:40.914564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:40.915208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:40.915208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:40.942317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:40.943530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:41.057283 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3265/6569] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:41.064811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.065132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.065406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.095649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:41.098835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:41.111457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3305/6570] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:41.115531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.131670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1311b-6557-48fc-98e0-3d5aa5259628 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.142548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.143096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.143382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.143642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.144368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:41.144676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.148621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.154226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:41.178194 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3266/6571] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:41.182996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.201035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575bbd-2567-40ee-a001-8a7498a7d7ed None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.207264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.208249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.208821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.209519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.210799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.213294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.220523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:41.263282 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3306/6572] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:41.266973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.279065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354c059-e93c-4984-a85e-0dce2c0009ea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.352464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.353125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.353410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.353681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.354321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.356438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.382214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3267/6573] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:41.386435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.398373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed50ea-ceb8-42a3-bfec-f5d480be6f33 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.403994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.404759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.405085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.405402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.406211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.407984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.423614 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3307/6574] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:41.427398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.444770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239861f-c6ec-4547-9812-6e9987f0f77b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.458830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.459860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.460721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.461423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.462469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.464338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05880fff-96c5-4cd2-9318-31555d7ccee8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.482290 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3268/6575] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:41.486644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.498146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f39a47-26f3-4026-8e78-e65d9701d09f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.503980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.504665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.504975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.505255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] PATH_INFO: `/v3/projects/cc1ae3212f16452abaadecce2daee2b1/users/31d0c1d49b574464a5c866aff432b4f3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.532066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1ae3212f16452abaadecce2daee2b1, user_id=31d0c1d49b574464a5c866aff432b4f3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.534793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.556710 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3308/6576] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:41 2022] PUT /identity/v3/projects/cc1ae3212f16452abaadecce2daee2b1/users/31d0c1d49b574464a5c866aff432b4f3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:41.568672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.569015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.569342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.608255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] MFA Rules not processed for user `31d0c1d49b574464a5c866aff432b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:41.609688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:41.707538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3269/6577] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:41.713467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:41.893143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a2512-f6e9-47f3-86e2-f08a75b208f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:41.902881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:41.904407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:41.906236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:41.906633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:41.907834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:41.914388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:41.985676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3309/6578] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/projects => generated 365 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:41.987100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.003713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861da3e1-fe65-46bd-b744-6ee9e19d2d55 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.096426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.103961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.104462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.104896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.105764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.109844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:42.124252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:42.151930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3270/6579] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:41 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:42.152560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.166231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba634f-aa4d-4a2f-961c-ae0142cd577c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.177628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.178314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.178568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.178844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.179537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.184005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:42.214663 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3310/6580] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:20:42.221361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.237903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beac89-7a23-4b5e-ae53-c695af563d8c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.248293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.249186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.249576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.249961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] PATH_INFO: `/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb/users/549780d133da4e7cb5a0ff1208e58f5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.270947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd86b62ca6ef47bab0aae5a85567daeb, user_id=549780d133da4e7cb5a0ff1208e58f5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.274977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:42.313079 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3271/6581] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:42 2022] PUT /identity/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb/users/549780d133da4e7cb5a0ff1208e58f5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:42.314110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.346001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5564a-33c6-454c-b198-031dcd7cbc24 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.447757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.448439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.448774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.449130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.449923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.463966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b365c6-709c-45d6-91ba-ca4cf2620489 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:42.500855 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3311/6582] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:42.504093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.520240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d76c0f-5a4a-48e2-a963-29f3e6557815 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.544310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.550238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.550684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.551061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] PATH_INFO: `/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb/users/549780d133da4e7cb5a0ff1208e58f5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.559581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd86b62ca6ef47bab0aae5a85567daeb, user_id=549780d133da4e7cb5a0ff1208e58f5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.575025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:42.618095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3272/6583] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:42 2022] PUT /identity/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb/users/549780d133da4e7cb5a0ff1208e58f5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:42.628138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.628462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.628734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.707623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] MFA Rules not processed for user `549780d133da4e7cb5a0ff1208e58f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:42.708871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:42.732155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:42.871838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3312/6584] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:42.877128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:42.893702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccee0-84c9-41f7-9ed9-d00e69cf1896 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:42.912038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:42.912682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:42.912992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:42.913268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:42.922565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:42.924405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:43.048878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3273/6585] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:42 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:43.049597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:43.067221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f33a1-1621-432a-9a6f-3af203664fa1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:43.161416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:43.166399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:43.176358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:43.176358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:43.176358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:43.179050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:43.238447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3313/6586] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:43 2022] POST /identity/v3/users => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:43.243143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:43.256597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff68a-b0b5-4d8a-a2ba-30bcf3729d97 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:43.262117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:43.262766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:43.270539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:43.270880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/3c4b053ae2b1483da47be2ce541d7ef4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:43.301296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_user(user_id=3c4b053ae2b1483da47be2ce541d7ef4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:43.310356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:43.311891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3274/6587] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:43 2022] GET /identity/v3/users/3c4b053ae2b1483da47be2ce541d7ef4 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:43.324100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:43.348281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4ae8-ce48-4f6d-af47-a593394f0a20 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:43.356720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:43.357932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:43.358275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:43.358556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/3c4b053ae2b1483da47be2ce541d7ef4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:43.359834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3c4b053ae2b1483da47be2ce541d7ef4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:43.362258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:43.480433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4b053ae2b1483da47be2ce541d7ef4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.482924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4b053ae2b1483da47be2ce541d7ef4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.504858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4b053ae2b1483da47be2ce541d7ef4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.528603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4b053ae2b1483da47be2ce541d7ef4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.529586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4b053ae2b1483da47be2ce541d7ef4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.575566 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3314/6588] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:43 2022] DELETE /identity/v3/users/3c4b053ae2b1483da47be2ce541d7ef4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:43.579334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:43.582287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:43.627758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0abb85-d205-47c0-ba5e-485d691ecf07 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:43.708292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:43.708755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:43.709173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:43.709320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/fd95c124e11940b99ef8633e9b1ca9f8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:43.710520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd95c124e11940b99ef8633e9b1ca9f8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:43.713063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:43.783146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd95c124e11940b99ef8633e9b1ca9f8', 'request_id': 'req-71ac393e-628e-4f03-89bf-ad2d590a5af1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.799367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd95c124e11940b99ef8633e9b1ca9f8', 'request_id': 'req-71ac393e-628e-4f03-89bf-ad2d590a5af1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.812863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd95c124e11940b99ef8633e9b1ca9f8', 'request_id': 'req-71ac393e-628e-4f03-89bf-ad2d590a5af1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.833403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] The token cache is being invalidate because project fd95c124e11940b99ef8633e9b1ca9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:43.833713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.835131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:43.836849 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3275/6589] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:43 2022] DELETE /identity/v3/projects/fd95c124e11940b99ef8633e9b1ca9f8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:43.841902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:43.863409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5f506-f1e4-40d0-b8a6-9ab8cab81479 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:43.868924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:43.996781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:43.997892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:43.998524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:43.999329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.000196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.002808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.081994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.083370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:44.084002 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3315/6590] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:43 2022] POST /identity/v3/projects => generated 358 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:44.121186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac393e-628e-4f03-89bf-ad2d590a5af1 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.134190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:44.211331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.212244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.212594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.212975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.213746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.215821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.249424 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3276/6591] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:44 2022] POST /identity/v3/users => generated 417 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:44.253414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.289637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b410db-3753-4e33-b4c9-7afbd9530024 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.304011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.309153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.310591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.310937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.313672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.319339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.378904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3316/6592] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:44 2022] POST /identity/v3/roles => generated 240 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:44.383514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.399610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6cf4-ec36-4d49-b9ae-64e2e3b9278c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.416788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.417515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.417743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.418072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/a77d6eb74ad641e78f94ec9b70bc71db` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.463375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_user(user_id=a77d6eb74ad641e78f94ec9b70bc71db)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.468246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.470288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3277/6593] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:44 2022] GET /identity/v3/users/a77d6eb74ad641e78f94ec9b70bc71db => generated 417 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:44.474780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.490789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067902bd-db24-46b7-ac4c-e6b89e720c7f tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.502660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.503314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.503595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.505550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/roles/7e9befda6b3b4b28ac5ef2f31864d4c8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.518264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_role(role_id=7e9befda6b3b4b28ac5ef2f31864d4c8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.519344 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:44.519344 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:44.519344 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:44.526821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.544094 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3317/6594] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:44 2022] GET /identity/v3/roles/7e9befda6b3b4b28ac5ef2f31864d4c8 => generated 240 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:44.547703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.567505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd153-0e13-47c3-b47f-9fb1302dabce tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.583195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.583826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.584110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.591338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.592028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.595758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.670699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3278/6595] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:44 2022] POST /identity/v3/projects => generated 358 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:44.674779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.694441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d620fb3-b408-4289-b378-b6b6c55cb173 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.808352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.809416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.810375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.810979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/d6c3eddcc48d4f8682b25950655c9711` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.813414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6c3eddcc48d4f8682b25950655c9711)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.819052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.822365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3318/6596] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:44 2022] GET /identity/v3/projects/d6c3eddcc48d4f8682b25950655c9711 => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:44.829108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.843981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce19c-34d3-488b-aa68-052ff2fa4cbc tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:44.860228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:44.861413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:44.861943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:44.862428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/d6c3eddcc48d4f8682b25950655c9711/users/a77d6eb74ad641e78f94ec9b70bc71db/roles/7e9befda6b3b4b28ac5ef2f31864d4c8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:44.870109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d6c3eddcc48d4f8682b25950655c9711, user_id=a77d6eb74ad641e78f94ec9b70bc71db, role_id=7e9befda6b3b4b28ac5ef2f31864d4c8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:44.873932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:44.901573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3279/6597] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:44 2022] PUT /identity/v3/projects/d6c3eddcc48d4f8682b25950655c9711/users/a77d6eb74ad641e78f94ec9b70bc71db/roles/7e9befda6b3b4b28ac5ef2f31864d4c8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:44.905650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:44.920104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5270-f104-4b63-8fab-57a3c440d495 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:45.056792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:45.057684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:45.058033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:45.058146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:45.058902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:45.061092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:45.157376 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3319/6598] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:44 2022] POST /identity/v3/projects => generated 360 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:45.163347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:45.185353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaf3e9-9a2f-453f-8038-0b9aa48cb35e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:45.378238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:45.383360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:45.384145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:45.384633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/ff286ff020b142ee81efeb1b1859cf82` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:45.386204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_project(project_id=ff286ff020b142ee81efeb1b1859cf82)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:45.390456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:45.413041 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3280/6599] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:20:45 2022] GET /identity/v3/projects/ff286ff020b142ee81efeb1b1859cf82 => generated 360 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:45.416263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:45.438358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:45.447134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29b32-b086-4551-b34f-61f6924aa84c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:45.461676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:45.462706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:45.463204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:45.464983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/ff286ff020b142ee81efeb1b1859cf82/users/a77d6eb74ad641e78f94ec9b70bc71db/roles/7e9befda6b3b4b28ac5ef2f31864d4c8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:45.472338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ff286ff020b142ee81efeb1b1859cf82, user_id=a77d6eb74ad641e78f94ec9b70bc71db, role_id=7e9befda6b3b4b28ac5ef2f31864d4c8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:45.480943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:45.506106 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3320/6600] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:45 2022] PUT /identity/v3/projects/ff286ff020b142ee81efeb1b1859cf82/users/a77d6eb74ad641e78f94ec9b70bc71db/roles/7e9befda6b3b4b28ac5ef2f31864d4c8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:45.510949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:45.526211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4d5e-bc1f-4327-a0d9-e169cf484a5d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:45.602575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:45.606759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:45.607728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:45.608118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:45.608507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/a77d6eb74ad641e78f94ec9b70bc71db/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:45.610356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=a77d6eb74ad641e78f94ec9b70bc71db)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:45.612820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:45.667322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3281/6601] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:20:45 2022] GET /identity/v3/users/a77d6eb74ad641e78f94ec9b70bc71db/projects => generated 842 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:45.671238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:45.684066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d97d01-e776-41cb-9cb8-31b6c7893d50 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:45.692232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:45.693243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:45.693737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:45.694216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/ff286ff020b142ee81efeb1b1859cf82` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:45.696413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff286ff020b142ee81efeb1b1859cf82)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:45.699352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:45.808545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff286ff020b142ee81efeb1b1859cf82', 'request_id': 'req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:45.818836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff286ff020b142ee81efeb1b1859cf82', 'request_id': 'req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:45.873744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff286ff020b142ee81efeb1b1859cf82', 'request_id': 'req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:45.901895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] The token cache is being invalidate because project ff286ff020b142ee81efeb1b1859cf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:45.902276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:45.903109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:45.905484 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3321/6602] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:45 2022] DELETE /identity/v3/projects/ff286ff020b142ee81efeb1b1859cf82 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:45.909465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:45.911484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:45.938214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb4b8-4722-42f3-84bb-fa0c27846e2d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:46.018795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:46.019455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:46.019791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:46.020092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/d6c3eddcc48d4f8682b25950655c9711` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:46.021629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d6c3eddcc48d4f8682b25950655c9711)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:46.023913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:46.093151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c3eddcc48d4f8682b25950655c9711', 'request_id': 'req-754d5826-8d1d-4c95-8696-79572ccea798'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.099449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c3eddcc48d4f8682b25950655c9711', 'request_id': 'req-754d5826-8d1d-4c95-8696-79572ccea798'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.110980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c3eddcc48d4f8682b25950655c9711', 'request_id': 'req-754d5826-8d1d-4c95-8696-79572ccea798'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.134304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] The token cache is being invalidate because project d6c3eddcc48d4f8682b25950655c9711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:46.134600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.137327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.145120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3282/6603] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:45 2022] DELETE /identity/v3/projects/d6c3eddcc48d4f8682b25950655c9711 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:46.145476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:46.160351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462ed1-3267-40fc-a5f8-9292abf2cbf4 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:46.285194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:46.285976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:46.286336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:46.286783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/roles/7e9befda6b3b4b28ac5ef2f31864d4c8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:46.288468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7e9befda6b3b4b28ac5ef2f31864d4c8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:46.291021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:46.389502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invalidating the token cache because role 7e9befda6b3b4b28ac5ef2f31864d4c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:46.389916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.392349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.399281 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3322/6604] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:46 2022] DELETE /identity/v3/roles/7e9befda6b3b4b28ac5ef2f31864d4c8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:46.403461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:46.405662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:46.431006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d5826-8d1d-4c95-8696-79572ccea798 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:46.561164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:46.649793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:46.650346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:46.650696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:46.650972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/a77d6eb74ad641e78f94ec9b70bc71db` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:46.652518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a77d6eb74ad641e78f94ec9b70bc71db)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:46.654358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:46.761675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77d6eb74ad641e78f94ec9b70bc71db'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.762739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77d6eb74ad641e78f94ec9b70bc71db'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.763635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77d6eb74ad641e78f94ec9b70bc71db'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.774060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77d6eb74ad641e78f94ec9b70bc71db'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.782906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77d6eb74ad641e78f94ec9b70bc71db'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.814987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3283/6605] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:46 2022] DELETE /identity/v3/users/a77d6eb74ad641e78f94ec9b70bc71db => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:46.818805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:46.821072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:46.842851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e92a80-469d-48ad-9e09-3c15a081f9f9 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:46.878957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:46.912727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:46.913513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:46.914054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:46.914197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/9e7bf263c39f4c02affa5cc622e6b3ee` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:46.915493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e7bf263c39f4c02affa5cc622e6b3ee)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:46.917786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:46.973934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7bf263c39f4c02affa5cc622e6b3ee', 'request_id': 'req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.981256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7bf263c39f4c02affa5cc622e6b3ee', 'request_id': 'req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:46.989804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7bf263c39f4c02affa5cc622e6b3ee', 'request_id': 'req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.008315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] The token cache is being invalidate because project 9e7bf263c39f4c02affa5cc622e6b3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:47.008675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.009455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0953e1b-8f22-4f0e-8d06-a0e5ba2479d6 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.016766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3323/6606] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:46 2022] DELETE /identity/v3/projects/9e7bf263c39f4c02affa5cc622e6b3ee => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:47.018075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:47.021593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:47.042848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26f2ff-7c23-4425-95d4-699f80bad99d tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:47.152576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:47.153981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.153981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.153981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/31d0c1d49b574464a5c866aff432b4f3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.155004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:update_user(user_id=31d0c1d49b574464a5c866aff432b4f3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:47.156016 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:47.156016 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:20:47.156016 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:20:47.157255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:47.202021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.212821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invalidating the token cache because user 31d0c1d49b574464a5c866aff432b4f3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:47.213507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.214431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.222946 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3284/6607] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 10:20:47 2022] PATCH /identity/v3/users/31d0c1d49b574464a5c866aff432b4f3 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:47.223491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.224456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.224984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.280549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] MFA Rules not processed for user `31d0c1d49b574464a5c866aff432b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:47.282669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:47.290867 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3324/6608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:20:47.291636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:47.293496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:47.308516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882030d6-e0ec-45ad-917a-578e856aeeb3 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:47.319431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:47.319731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.322586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.322773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/31d0c1d49b574464a5c866aff432b4f3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.324063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:update_user(user_id=31d0c1d49b574464a5c866aff432b4f3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:47.332659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:47.408132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.422884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invalidating the token cache because user 31d0c1d49b574464a5c866aff432b4f3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:47.423186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.423964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-badc0daa-ce7d-40eb-a4fa-51430db4c829 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.429356 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3285/6609] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 10:20:47 2022] PATCH /identity/v3/users/31d0c1d49b574464a5c866aff432b4f3 => generated 297 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:47.432539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:47.452396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8b60a-c57e-4db6-bccc-87ebc71b4c0e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:47.458729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:47.458921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.459168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.459420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/31d0c1d49b574464a5c866aff432b4f3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.532291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:update_user(user_id=31d0c1d49b574464a5c866aff432b4f3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:47.533465 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:20:47.533465 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:20:47.533465 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:20:47.537716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:47.644103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.663013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invalidating the token cache because user 31d0c1d49b574464a5c866aff432b4f3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:47.663013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.668141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.672595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3325/6610] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 10:20:47 2022] PATCH /identity/v3/users/31d0c1d49b574464a5c866aff432b4f3 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:47.676044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.676518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.676859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.727212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=12,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:47.753478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] MFA Rules not processed for user `31d0c1d49b574464a5c866aff432b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:47.755065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:47.760713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3286/6611] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:47 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 10:20:47.765234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:47.766921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:47.781097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e3a6-d2a6-4813-8028-35bd1c222b41 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:47.797328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:47.801780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.803151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.805290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/31d0c1d49b574464a5c866aff432b4f3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.806808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:update_user(user_id=31d0c1d49b574464a5c866aff432b4f3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:47.814814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:47.911311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.935010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invalidating the token cache because user 31d0c1d49b574464a5c866aff432b4f3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:47.935724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.936602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:47.944011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3326/6612] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 10:20:47 2022] PATCH /identity/v3/users/31d0c1d49b574464a5c866aff432b4f3 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:47.945949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:47.968638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad02857-52ee-427d-a603-dea8f21211ad None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:47.978698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:47.979431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:47.981386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:47.981679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:47.982337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:47.986079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242543d-0586-4465-b3dc-b9d27d55135c tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:48.055084 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3287/6613] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:20:47 2022] POST /identity/v3/users => generated 265 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:48.058704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:48.060391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:48.075889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19df00-fbae-48ed-bee0-5284e309726a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:48.081474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:48.082132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:48.082567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:48.082833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/4bc166ca43794ceaa0e2d057242f3f2e/password` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:48.140409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:48.188642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:48.215274 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3327/6614] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:20:48 2022] POST /identity/v3/users/4bc166ca43794ceaa0e2d057242f3f2e/password => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:49.220210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:49.220769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:49.220769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:49.263390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] MFA Rules not processed for user `4bc166ca43794ceaa0e2d057242f3f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:49.265039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:49.269292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3288/6615] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:49 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 10:20:49.273044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:49.286638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cd3-f918-4dc8-b372-0f0a497b08fa tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:49.293427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:49.294467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:49.295340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:49.296868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:49.305954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:49.309437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:49.319799 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3328/6616] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Oct 28 10:20:49 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:49.322666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:49.347864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c34d9-522f-46d2-90a7-29e5e4880173 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:49.360247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:49.360603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:49.360889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:49.361190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/4bc166ca43794ceaa0e2d057242f3f2e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:49.364960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4bc166ca43794ceaa0e2d057242f3f2e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:49.367699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:49.432886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:49.433878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:49.434622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:49.446737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:49.458292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc166ca43794ceaa0e2d057242f3f2e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:49.522566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3289/6617] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:49 2022] DELETE /identity/v3/users/4bc166ca43794ceaa0e2d057242f3f2e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:49.524372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:49.552534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf6bf9-c7bf-426c-a41a-8d1498f55bbd tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:49.688776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:49.689840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:49.690558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:49.690999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:49.691803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:49.694329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:49.735464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3329/6618] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:49 2022] POST /identity/v3/users => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:49.739766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:49.744311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:49.771196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f67b0-48ca-4812-bdf8-44ffd52a1f0b tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:49.784937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:49.785599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:49.785972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:49.786251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:49.786943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:49.807615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:49.899406 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3290/6619] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:49 2022] POST /identity/v3/projects => generated 360 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:49.900511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:49.922831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3740fb-a9ef-460c-9f40-fb53faadccd2 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:50.053941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:50.054806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:50.055191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:50.055570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/d51740b9724a461b908c425e91608fdf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:50.084587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:update_user(user_id=d51740b9724a461b908c425e91608fdf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:50.087468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:50.153646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3330/6620] 10.222.0.16 () {60 vars in 1244 bytes} [Fri Oct 28 10:20:49 2022] PATCH /identity/v3/users/d51740b9724a461b908c425e91608fdf => generated 521 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:50.158097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:50.179799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac520-6526-4d59-b092-3b6770a4caea tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:50.189392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:50.190346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:50.191638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:50.192231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/d51740b9724a461b908c425e91608fdf` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:50.219024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:get_user(user_id=d51740b9724a461b908c425e91608fdf)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:50.231312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:50.233503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3291/6621] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:20:50 2022] GET /identity/v3/users/d51740b9724a461b908c425e91608fdf => generated 388 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:50.237947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:50.254820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67c1f-c089-4501-929e-9f7ff94b406a tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:50.265859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:50.266643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:50.266996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:50.267353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/projects/3849d27276b546868722fca668001597` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:50.272611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3849d27276b546868722fca668001597)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:50.275265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:50.353547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:50.382954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3849d27276b546868722fca668001597', 'request_id': 'req-f9e3316d-00da-4296-8120-58fbf6b38c6e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.405801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3849d27276b546868722fca668001597', 'request_id': 'req-f9e3316d-00da-4296-8120-58fbf6b38c6e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.417128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3849d27276b546868722fca668001597', 'request_id': 'req-f9e3316d-00da-4296-8120-58fbf6b38c6e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.438232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] The token cache is being invalidate because project 3849d27276b546868722fca668001597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:50.438603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.439620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.445811 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3331/6622] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:50 2022] DELETE /identity/v3/projects/3849d27276b546868722fca668001597 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:50.447047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:50.449448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:50.465417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafb8f-0b65-4997-a1d7-fbfbee90d0a0 tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:50.568480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '549780d133da4e7cb5a0ff1208e58f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86b62ca6ef47bab0aae5a85567daeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:50.569212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:50.569494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:50.571546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] PATH_INFO: `/v3/users/d51740b9724a461b908c425e91608fdf` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:50.574814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d51740b9724a461b908c425e91608fdf)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:50.576749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:50.602207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:50.704089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51740b9724a461b908c425e91608fdf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.705107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51740b9724a461b908c425e91608fdf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.706935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51740b9724a461b908c425e91608fdf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.725893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51740b9724a461b908c425e91608fdf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.756183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e0afae19-0cf0-480f-aa94-caf1d67b318e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51740b9724a461b908c425e91608fdf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:50.821055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3292/6623] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:50 2022] DELETE /identity/v3/users/d51740b9724a461b908c425e91608fdf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:50.823116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:50.825135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:51.006568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3316d-00da-4296-8120-58fbf6b38c6e tempest-UsersV3TestJSON-974574902 tempest-UsersV3TestJSON-974574902-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:51.141563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:51.142384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:51.142750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:51.142926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] PATH_INFO: `/v3/users/31d0c1d49b574464a5c866aff432b4f3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:51.176398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d0c1d49b574464a5c866aff432b4f3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:51.178540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:51.295019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:51.299784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:51.307312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:51.327893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:51.356771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:51.360274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d0c1d49b574464a5c866aff432b4f3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:51.401496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3332/6624] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:50 2022] DELETE /identity/v3/users/31d0c1d49b574464a5c866aff432b4f3 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:51.406205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:51.407137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:51.407677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:51.439740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:51.441116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:51.609632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3293/6625] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:51.620141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:51.621875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:51.793506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a87e21-a14f-4328-8a5c-e79eb0b361f2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:51.806392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:51.807867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:51.808176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:51.808442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:51.837761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:51.845087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:51.899658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3333/6626] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:20:53.474514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:53.476786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:53.496679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57afc6e-b253-4a39-94ee-59faa8346570 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:53.503008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:53.504059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:53.504677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:53.505237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] PATH_INFO: `/v3/projects/cc1ae3212f16452abaadecce2daee2b1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:53.507991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1ae3212f16452abaadecce2daee2b1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:53.510465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:53.613957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1ae3212f16452abaadecce2daee2b1', 'request_id': 'req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.641199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1ae3212f16452abaadecce2daee2b1', 'request_id': 'req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.660434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1ae3212f16452abaadecce2daee2b1', 'request_id': 'req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.683995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] The token cache is being invalidate because project cc1ae3212f16452abaadecce2daee2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:53.684280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.685263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.691330 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3294/6627] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:53 2022] DELETE /identity/v3/projects/cc1ae3212f16452abaadecce2daee2b1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:53.693265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:53.718422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52115b-bff3-4c91-9e18-c87833c45e55 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:53.808728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:53.809419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:53.809696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:53.810227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] PATH_INFO: `/v3/users/549780d133da4e7cb5a0ff1208e58f5c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:53.811377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=549780d133da4e7cb5a0ff1208e58f5c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:53.813440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:53.874735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549780d133da4e7cb5a0ff1208e58f5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.875412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549780d133da4e7cb5a0ff1208e58f5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.886270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549780d133da4e7cb5a0ff1208e58f5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.896937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549780d133da4e7cb5a0ff1208e58f5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.897772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-508dae71-1b7b-4e93-bd0d-183b567f6e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549780d133da4e7cb5a0ff1208e58f5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:53.906922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:53.935248 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3334/6628] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:53 2022] DELETE /identity/v3/users/549780d133da4e7cb5a0ff1208e58f5c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:55.264729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:55.266870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:55.295928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae56b4-6666-4dbf-9af5-873dad4e84f4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:55.309596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:55.437378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:55.438048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:55.438330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:55.438605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] PATH_INFO: `/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:55.441728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd86b62ca6ef47bab0aae5a85567daeb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:55.443678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:55.634411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd86b62ca6ef47bab0aae5a85567daeb', 'request_id': 'req-90a2ad5a-2fe5-49b3-8278-19262ff3b232'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:55.651069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd86b62ca6ef47bab0aae5a85567daeb', 'request_id': 'req-90a2ad5a-2fe5-49b3-8278-19262ff3b232'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:55.681216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd86b62ca6ef47bab0aae5a85567daeb', 'request_id': 'req-90a2ad5a-2fe5-49b3-8278-19262ff3b232'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:55.702401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] The token cache is being invalidate because project cd86b62ca6ef47bab0aae5a85567daeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:20:55.702985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:55.705307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90a2ad5a-2fe5-49b3-8278-19262ff3b232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:55.716335 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3295/6629] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:20:55 2022] DELETE /identity/v3/projects/cd86b62ca6ef47bab0aae5a85567daeb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:55.721899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:55.722454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:55.722454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:55.808118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:55.814201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:55.984260 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3335/6630] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:55.992572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:55.993485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:55.993485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.033930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:56.035197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:56.060193 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3296/6631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:56.061215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.075921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619daa8-1017-4c1d-b498-08d1ab502977 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.081505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.082342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.082488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.082816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.083545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:56.083917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.085923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.112618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3336/6632] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:56.117426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.128451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8bca-3149-4957-b677-bca7ae34f18f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.144782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.145419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.145705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.145977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.146771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.148895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.223416 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3297/6633] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:20:56 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:56.226963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.240768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4027-cfe0-4d5d-a120-98a2d963e036 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.437093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.437726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.438003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.438276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.438909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.440854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.482766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3337/6634] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:20:56 2022] POST /identity/v3/users => generated 296 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:56.486694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.498833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b3d7f-2b9b-4019-ac25-64ebeb4f6007 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.506355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.507431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.507983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.508438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.510010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.512108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.537663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.548075 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3298/6635] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:56.562797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64edb-ede1-4acf-97ce-8b249742636b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.570376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.571160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.571534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.572744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.573688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.575590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9c7b6-95bb-410d-bca5-bdcc0ff535cd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.601671 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3338/6636] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:56.602942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.629976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464349e-ec0f-4962-a3f2-389c2786663f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.635367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.636206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.636487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.636757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] PATH_INFO: `/v3/projects/ccf8f5de174c4e518dbd0226785875a8/users/ce9dd76664fd4676a2ddb34705cf6c37/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.663157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf8f5de174c4e518dbd0226785875a8, user_id=ce9dd76664fd4676a2ddb34705cf6c37, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.668090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.699762 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3299/6637] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:20:56 2022] PUT /identity/v3/projects/ccf8f5de174c4e518dbd0226785875a8/users/ce9dd76664fd4676a2ddb34705cf6c37/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:56.702017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.702297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.702570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.747378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] MFA Rules not processed for user `ce9dd76664fd4676a2ddb34705cf6c37`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:56.749828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:56.824066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:56.848665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3339/6638] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:56.854717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:56.867774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696fc9-a5cc-4df6-9f31-e6be8a71da59 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:56.874627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:56.875420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:56.875705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:56.876269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:56.877143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:56.878536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e98a3-8c59-4fcf-b258-0924e1c227f2 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:56.941046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:56.987618 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3300/6639] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Oct 28 10:20:56 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 788 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:56.992067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.001456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5db6b-57c2-456e-a5ae-5f0df68db330 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.006996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.008218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.008702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.009216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/f818c0a6155445d48c1874c2f5d8ffd4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.032434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:get_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=f818c0a6155445d48c1874c2f5d8ffd4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.035744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.039348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3340/6640] 10.222.0.16 () {58 vars in 1392 bytes} [Fri Oct 28 10:20:56 2022] GET /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/f818c0a6155445d48c1874c2f5d8ffd4 => generated 688 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:20:57.043691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.044294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.044634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.066050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] MFA Rules not processed for user `ce9dd76664fd4676a2ddb34705cf6c37`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:57.067641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:57.297647 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3301/6641] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 28 10:20:57.301770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.320719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16e9e-3117-45a7-8336-7d87c91bc4de tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.326721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.327766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.328469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.329095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/f818c0a6155445d48c1874c2f5d8ffd4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.330852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=f818c0a6155445d48c1874c2f5d8ffd4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.333012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.378730 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3341/6642] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:57 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/f818c0a6155445d48c1874c2f5d8ffd4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:20:57.384888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.419525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963f09-f595-4427-9e4f-ec39edae5274 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.429482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.430363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.431610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.436593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.437452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.439323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.598954 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3302/6643] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:20:57 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 921 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:57.604415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.622517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ad608-c6dc-4119-baf8-770244bc9026 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.635475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.637350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.637672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.637959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/b722b0c720124ede94fcf16f16a6d819` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.665037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=b722b0c720124ede94fcf16f16a6d819)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.666809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.719937 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3342/6644] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:57 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/b722b0c720124ede94fcf16f16a6d819 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:57.721055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.731515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2b6b-25a1-4101-8384-f49d02f09769 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.740816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.741919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.742949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.743423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.745652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.749647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.786627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:57.872381 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3303/6645] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:20:57 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 812 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:57.876663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.889971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3b82a-8891-4bb5-bec6-0d8b32ddb82d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.901303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.902058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.902412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.902779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/9a19d8209ef44bf793d870477c9f3596` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.916170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=9a19d8209ef44bf793d870477c9f3596)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.918247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:57.950846 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3343/6646] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:57 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/9a19d8209ef44bf793d870477c9f3596 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:57.956233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:57.971396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a6524-2b67-481c-bca2-483f9bd748d3 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:57.977307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:57.978262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:57.978917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:57.979406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:57.980372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:57.983429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.123731 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3304/6647] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Oct 28 10:20:57 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 789 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:20:58.125005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.136919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed02acf-3d8f-481d-8e61-dbbe06ddd2fb tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.145358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.145937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.146238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.146473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.151347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.154859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.288426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3344/6648] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Oct 28 10:20:58 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 789 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:58.292109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.303805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ad19e-2099-4306-a486-a31e0ffd877d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.315565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.316291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.316680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.317095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.317828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:list_application_credentials(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.321073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.340468 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3305/6649] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:20:58 2022] GET /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 1502 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:20:58.343481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.357804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3ee6-8e94-403e-ae02-ee64d4260a9d tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.365092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.367106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.367608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.368148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/0ec1d33cad7a4f9cb7f307f649120eaf` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.383393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=0ec1d33cad7a4f9cb7f307f649120eaf)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.386105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.410451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3345/6650] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:58 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/0ec1d33cad7a4f9cb7f307f649120eaf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:58.415009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.431226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820a0e-123d-4593-b61a-6bd55a46a233 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.438207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.439124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.439577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.440030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/201a419fb4ce44cf94f9365a582b3bcc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.453844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=201a419fb4ce44cf94f9365a582b3bcc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.456254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.486633 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3306/6651] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:58 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/201a419fb4ce44cf94f9365a582b3bcc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:58.492362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.506097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce060636-6e24-4788-8acc-7cbc998b8403 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.514821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.516843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.516843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.517556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.518897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.520152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.533530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:58.698505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3346/6652] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Oct 28 10:20:58 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 789 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:58.702704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:58.716481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98c5c-fc12-4b41-bea6-a13dc32a3b63 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:58.729268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:58.730240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:58.730684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:58.735749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:58.736835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:create_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:58.738034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:58.955151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:59.010496 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3307/6653] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Oct 28 10:20:58 2022] POST /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials => generated 788 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:20:59.015011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:59.037805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b46c-dfe8-48ec-9be2-da81f49f718a tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:59.061783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:59.063749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.064135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.064513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.065744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Adding query filter params (name=tempest-application_credential-696095854) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:20:59.066344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:list_application_credentials(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:59.068571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:59.097016 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3347/6654] 10.222.0.16 () {58 vars in 1384 bytes} [Fri Oct 28 10:20:59 2022] GET /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials?name=tempest-application_credential-696095854 => generated 885 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:20:59.099655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:59.114005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0de04d-3b0f-4dc6-a600-ca0eea62aa34 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:59.128497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:59.129691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.130077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.130755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/954c9faca739417da3cc3375f75e7844` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.146665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=954c9faca739417da3cc3375f75e7844)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:59.149762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:59.204651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3308/6655] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:59 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/954c9faca739417da3cc3375f75e7844 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:59.208837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:59.227938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c6d1-0067-4260-ae91-8d40d6bd0823 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:59.253167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce9dd76664fd4676a2ddb34705cf6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccf8f5de174c4e518dbd0226785875a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:59.253849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.254136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.254455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/48cc59fd3df54ce58b95994e3041771f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.277733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ce9dd76664fd4676a2ddb34705cf6c37, application_credential_id=48cc59fd3df54ce58b95994e3041771f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:59.279608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e1356-ae6e-483e-9586-80cc5ebdf7b7 tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:59.331301 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3348/6656] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:20:59 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37/application_credentials/48cc59fd3df54ce58b95994e3041771f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:59.338860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:59.499646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf68d82-ed8e-404c-a602-6378f1089c2b tempest-ApplicationCredentialsV3Test-525908203 tempest-ApplicationCredentialsV3Test-525908203-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:59.506071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:59.512001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.512460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.512893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] PATH_INFO: `/v3/users/ce9dd76664fd4676a2ddb34705cf6c37` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.515688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9dd76664fd4676a2ddb34705cf6c37)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:59.518634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:59.620738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9dd76664fd4676a2ddb34705cf6c37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:59.621595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9dd76664fd4676a2ddb34705cf6c37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:59.622892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9dd76664fd4676a2ddb34705cf6c37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:59.633179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9dd76664fd4676a2ddb34705cf6c37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:59.644192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9dd76664fd4676a2ddb34705cf6c37'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:20:59.681355 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3309/6657] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:20:59 2022] DELETE /identity/v3/users/ce9dd76664fd4676a2ddb34705cf6c37 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:20:59.687091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.687459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.687806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.720796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:20:59.722188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:59.809655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3349/6658] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:20:59.847251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:20:59.849685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:20:59.910403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:SELECT=86,keystone:DELETE=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:59.935644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d1081-f83f-47e1-a027-569a9e02c540 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:20:59.940142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:20:59.940855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:20:59.941228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:20:59.941641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:20:59.954655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:20:59.956523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df095b-5052-4148-aed5-e847edb2990f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:20:59.971129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3310/6659] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:21:00.907140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:00.908581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:00.940473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb23ed-4a94-42c1-87df-96945d5370c6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:00.960003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:00.961284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:00.961652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:00.961937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] PATH_INFO: `/v3/projects/ccf8f5de174c4e518dbd0226785875a8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:00.969122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf8f5de174c4e518dbd0226785875a8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:00.971327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:01.119965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf8f5de174c4e518dbd0226785875a8', 'request_id': 'req-0225d3f1-062a-45bd-8b6c-5841d6174a5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:01.166289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf8f5de174c4e518dbd0226785875a8', 'request_id': 'req-0225d3f1-062a-45bd-8b6c-5841d6174a5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:01.172659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:01.190136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf8f5de174c4e518dbd0226785875a8', 'request_id': 'req-0225d3f1-062a-45bd-8b6c-5841d6174a5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:01.222579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] The token cache is being invalidate because project ccf8f5de174c4e518dbd0226785875a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:01.227398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:01.228610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0225d3f1-062a-45bd-8b6c-5841d6174a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:01.236661 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3350/6660] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:00 2022] DELETE /identity/v3/projects/ccf8f5de174c4e518dbd0226785875a8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:01.237455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722619d5-a981-4597-9800-227b773b7148 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:01.237932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722619d5-a981-4597-9800-227b773b7148 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:01.237932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722619d5-a981-4597-9800-227b773b7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:01.300403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-722619d5-a981-4597-9800-227b773b7148 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:01.302530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-722619d5-a981-4597-9800-227b773b7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:01.461055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3311/6661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:01.474599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:01.474882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:01.475160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:01.510867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:01.513786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:01.524023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3351/6662] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:01.528581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722619d5-a981-4597-9800-227b773b7148 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:01.567413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722619d5-a981-4597-9800-227b773b7148 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:01.583972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:01.584622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:01.584977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:01.585232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:01.585902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:01.586205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:01.587858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:01.634070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3312/6663] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:01.639759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:01.658175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0ff6-839a-4281-b0f0-81578a67556a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:01.702064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:01.704400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:01.704696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:01.705005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:01.706439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:01.710942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:01.785927 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3352/6664] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:01 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:01.786568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:01.800577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930032-d1cf-400a-9782-4a52248cf8aa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:01.923290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:01.923933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:01.924214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:01.924490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:01.925160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:01.927099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:01.974493 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3313/6665] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:01 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:01.980140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:01.997315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678240c4-fd67-4a97-87e9-04f44db96750 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.010245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.011804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.012259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.012696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.019345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.025151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:02.077223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:02.077662 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3353/6666] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:02.091942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d9321-1335-481c-a206-935b7928ad65 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.108223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.109012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.109622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.110165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.111136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.115226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cdc6-4417-4eb6-a38d-1ab65ae1fe20 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:02.154296 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3314/6667] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:21:02.158138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:02.177029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff6ef-bb61-4ff6-af17-b983b4aca384 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.202180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.205176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.205569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.205848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] PATH_INFO: `/v3/projects/53b08ea7c5c24accbdce42c34f860c29/users/a84185a3aa904ba59f960ae2fba3ea31/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.242601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b08ea7c5c24accbdce42c34f860c29, user_id=a84185a3aa904ba59f960ae2fba3ea31, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.246756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:02.287453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3354/6668] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:02 2022] PUT /identity/v3/projects/53b08ea7c5c24accbdce42c34f860c29/users/a84185a3aa904ba59f960ae2fba3ea31/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:02.298291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.298760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.299320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.432722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] MFA Rules not processed for user `a84185a3aa904ba59f960ae2fba3ea31`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:02.435646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:02.526845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:02.601871 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3315/6669] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:02.609880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:02.629896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398acf9-4147-4dce-b205-ba0b4a78bfa0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.644930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a84185a3aa904ba59f960ae2fba3ea31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53b08ea7c5c24accbdce42c34f860c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.644930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.644930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.645271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] PATH_INFO: `/v3/auth/catalog` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.645271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.645769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:02.657362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3355/6670] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 10:21:02 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:02.664975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:02.829071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba9f5-c8ba-4dc3-9930-a6f0fc4fd042 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.846125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.846754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.846981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.847256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] PATH_INFO: `/v3/users/a84185a3aa904ba59f960ae2fba3ea31` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.858855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84185a3aa904ba59f960ae2fba3ea31)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.862424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:02.944768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:02.947263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:02.974154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84185a3aa904ba59f960ae2fba3ea31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:02.977078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84185a3aa904ba59f960ae2fba3ea31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:02.978117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5683f-2f9c-40f0-a821-97864fc1621a tempest-IdentityCatalogTest-854145803 tempest-IdentityCatalogTest-854145803-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:02.979196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84185a3aa904ba59f960ae2fba3ea31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:02.987952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:02.989278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:02.989746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:02.990201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] PATH_INFO: `/v3/users/08bc01cbeeb74f1bb04b51f54f6aaded` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:02.991875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bc01cbeeb74f1bb04b51f54f6aaded)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:02.993434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84185a3aa904ba59f960ae2fba3ea31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:02.998394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:03.007409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ee302d33-3e6f-484b-a7d9-99564bae16fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84185a3aa904ba59f960ae2fba3ea31'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.033272 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3316/6671] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:02 2022] DELETE /identity/v3/users/a84185a3aa904ba59f960ae2fba3ea31 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:03.039595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:03.040150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:03.040657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:03.065716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:03.067551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:03.112015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bc01cbeeb74f1bb04b51f54f6aaded'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.113263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bc01cbeeb74f1bb04b51f54f6aaded'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.134812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bc01cbeeb74f1bb04b51f54f6aaded'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.145319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bc01cbeeb74f1bb04b51f54f6aaded'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.146252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-86f85029-e66e-4c34-a0ff-a75aeff75872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bc01cbeeb74f1bb04b51f54f6aaded'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.170777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:03.180018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3356/6672] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:02 2022] DELETE /identity/v3/users/08bc01cbeeb74f1bb04b51f54f6aaded => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:03.186652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:03.186918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:03.187294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:03.213646 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3317/6673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:03.218549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:03.220088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:03.235363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:03.237477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:03.308739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd8136-2f7b-49f4-aa90-a79c5900fe18 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:03.324709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=4,keystone:DELETE=11,keystone:SELECT=85 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:03.350158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3357/6674] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:03.359858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:03.361377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:03.412778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:03.413855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:03.414540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:03.414927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:03.431446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286bc1b-cd55-4302-b936-5d490c6f4ca5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:03.436213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:03.436641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:03.436955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:03.437215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:03.449601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:03.450149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:03.451247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:03.451759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b020292-056f-4b24-98de-686fb105518c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:03.463655 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3358/6675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:21:03.472047 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3318/6676] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:21:03.798849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:03.800558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:03.839918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f908-56c4-492a-b08e-9b0b20468e21 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:03.849494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:03.851219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:03.851602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:03.851780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] PATH_INFO: `/v3/projects/a538273ed5864777b0ebd5b1ca67e8bd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:03.853741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a538273ed5864777b0ebd5b1ca67e8bd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:03.859032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:03.975050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a538273ed5864777b0ebd5b1ca67e8bd', 'request_id': 'req-6db54b71-87c0-406c-9655-f346d8c55c8c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:03.990423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a538273ed5864777b0ebd5b1ca67e8bd', 'request_id': 'req-6db54b71-87c0-406c-9655-f346d8c55c8c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.004972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a538273ed5864777b0ebd5b1ca67e8bd', 'request_id': 'req-6db54b71-87c0-406c-9655-f346d8c55c8c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.021223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] The token cache is being invalidate because project a538273ed5864777b0ebd5b1ca67e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:04.021812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.023414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6db54b71-87c0-406c-9655-f346d8c55c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.025895 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3359/6677] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:03 2022] DELETE /identity/v3/projects/a538273ed5864777b0ebd5b1ca67e8bd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:21:04.031283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.032670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.033771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.075535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:04.078312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.224935 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3319/6678] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:04.233239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.233614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.233828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.280577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.282225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.294502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:04.297691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.306737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e794e5-e512-4717-b2f3-a4e97d323fb5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.309242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3360/6679] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:04.313815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.322151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.322718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.322863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.323091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] PATH_INFO: `/v3/projects/53b08ea7c5c24accbdce42c34f860c29` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.325645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b08ea7c5c24accbdce42c34f860c29)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.327607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.330789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5abfc-aa22-4c15-b888-c1be14978add None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.345198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.346088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.346484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.346906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.349362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:04.349925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.355822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.393841 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3361/6680] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:04.398484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.424174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1528c-e2f5-4351-8536-5abdd9fa9394 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.437840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b08ea7c5c24accbdce42c34f860c29', 'request_id': 'req-8336f7e3-b490-451a-bf07-5980e6de6197'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.440981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:04.452606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b08ea7c5c24accbdce42c34f860c29', 'request_id': 'req-8336f7e3-b490-451a-bf07-5980e6de6197'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.466826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b08ea7c5c24accbdce42c34f860c29', 'request_id': 'req-8336f7e3-b490-451a-bf07-5980e6de6197'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.498381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] The token cache is being invalidate because project 53b08ea7c5c24accbdce42c34f860c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:04.498683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.499406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8336f7e3-b490-451a-bf07-5980e6de6197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:04.505241 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3320/6681] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:04 2022] DELETE /identity/v3/projects/53b08ea7c5c24accbdce42c34f860c29 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:21:04.507238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89173d20-8d07-4031-a42f-8fc064bb5442 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.507529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89173d20-8d07-4031-a42f-8fc064bb5442 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.507972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89173d20-8d07-4031-a42f-8fc064bb5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.513684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:04.522106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.523578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.524366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.525147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.526688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.529541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.564541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-89173d20-8d07-4031-a42f-8fc064bb5442 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:04.566185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-89173d20-8d07-4031-a42f-8fc064bb5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.569445 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3362/6682] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:04.573690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.575573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.677512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075de-a2a7-4374-ae6d-fa9c22296220 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.683747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.684377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.684661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.685287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.686660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.690318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.720945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3363/6683] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:21:04.727614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.737519 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3321/6684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:04.743919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.744480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.744942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.750729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f5607-6f30-498c-a158-0cb58e7e8e8e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.765293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.765977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.766261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.766579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.767238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.769082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.780590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:04.788176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:04.800689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3322/6685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:21:04.803145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3364/6686] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:04.807396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.808876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.827317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba9013-3508-48af-b8fa-6739354a496a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.833402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1960-dfa5-45d2-a178-67daa82086c3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.834003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.834956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.834956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.835837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.836577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:04.836744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.838512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.850556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.851215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.851498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.851770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.852415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.852549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3323/6687] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:04.854052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.856572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.869545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256acb-6bd1-4bff-841b-122b495e1bdf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.872613 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3365/6688] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:04.876027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.876674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.877188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.877688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.878159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.878981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.882991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.894610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e635c82-6421-4600-9484-c4a28fcc635e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:04.910837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:04.911477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:04.911734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:04.912427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] PATH_INFO: `/v3/projects/2abf5bf95cb647babb481456587d09b3/users/93a09849ffe6420ab04ceeed8a7f83a0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:04.923906 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3324/6689] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:04.925560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:04.948503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abf5bf95cb647babb481456587d09b3, user_id=93a09849ffe6420ab04ceeed8a7f83a0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:04.951098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab918055-f77b-4749-a785-84a0f524915b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:04.993036 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3366/6690] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:04 2022] PUT /identity/v3/projects/2abf5bf95cb647babb481456587d09b3/users/93a09849ffe6420ab04ceeed8a7f83a0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:21:05.050645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253485b2-3119-444c-8621-79e13e7f3a0d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.076680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.077041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.077271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.140192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] MFA Rules not processed for user `93a09849ffe6420ab04ceeed8a7f83a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:05.145660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:05.158900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:05.195770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.196477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.196761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.198312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.198968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.202816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:05.246129 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3325/6691] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:04 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:05.247561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:05.275950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e30-89a8-4bc1-b498-f622f258d658 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.282996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.283496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.284479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.284818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.285529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.287155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:05.297336 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3367/6692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:21:05.308151 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3326/6693] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:05.309373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:05.331166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956cf60-d091-4532-88e9-ba57bfa429c8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.338716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.339285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.339566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.339840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.340493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.343500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:05.370760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3368/6694] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:05.370957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:05.384417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ca08-dc32-4fd1-970d-e10b26c839e9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.397780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.398645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.399033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.399376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] PATH_INFO: `/v3/projects/76b53ae63a3c44aca75b9e740a81203b/users/e34721efef3c454b82f8afd9d77f25c3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.448589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b53ae63a3c44aca75b9e740a81203b, user_id=e34721efef3c454b82f8afd9d77f25c3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.451903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adf9b4-d384-447c-8c14-95c0d61577f3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:05.475350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:05.478247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:05.488962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:05.498483 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3327/6695] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:05 2022] PUT /identity/v3/projects/76b53ae63a3c44aca75b9e740a81203b/users/e34721efef3c454b82f8afd9d77f25c3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:05.510670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.511141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.511628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.581831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] MFA Rules not processed for user `e34721efef3c454b82f8afd9d77f25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:05.583075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:05.600306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72e365-7a8e-49c6-b085-41b025cad434 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.690662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.691347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.691637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.691914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.828701 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3328/6696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:21:05.833740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:05.877157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.879287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:05.919003 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3369/6697] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:05.981779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb18ae9-4f1b-4a77-861b-6b3de73f34b4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:05.988861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:05.990845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:05.991390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:05.991899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:05.993026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:05.995270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.066010 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3329/6698] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:05 2022] POST /identity/v3/projects => generated 391 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:06.069772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.085529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baa45a-9c28-4742-967e-59006779c953 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.182934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.183646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.184003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.184403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.185732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.189785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.221369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3370/6699] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:06 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:21:06.225400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.239871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e163-a348-4121-b558-b06bb9db250e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.247747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.248584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.249472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.250080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.251449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.254159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.269953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3330/6700] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:06.276277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.285606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:06.292687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293ae3-6094-4809-b127-7b983be68b0b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.299030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.299795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.300063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.300335 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] PATH_INFO: `/v3/projects/f86443e1d7164479b8ea59768f3df225/users/da54f7273216429db4da7caef4ff7b4f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.329144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86443e1d7164479b8ea59768f3df225, user_id=da54f7273216429db4da7caef4ff7b4f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.331807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.347906 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3371/6701] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:06 2022] PUT /identity/v3/projects/f86443e1d7164479b8ea59768f3df225/users/da54f7273216429db4da7caef4ff7b4f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:06.352986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.361622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:06.371893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d94-a857-4b47-812c-8591170d7bea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.461117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.462174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.462561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.462944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.463968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.466310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c2ccc-1e58-49bc-834e-0556809678a1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.481249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3331/6702] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:06.494732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.507881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c6e2-51b9-41c6-9055-8bdb1b019493 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.514146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.515492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.516631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.517183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] PATH_INFO: `/v3/projects/f86443e1d7164479b8ea59768f3df225/users/da54f7273216429db4da7caef4ff7b4f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.522114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86443e1d7164479b8ea59768f3df225, user_id=da54f7273216429db4da7caef4ff7b4f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.525840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.558609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3372/6703] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:06 2022] PUT /identity/v3/projects/f86443e1d7164479b8ea59768f3df225/users/da54f7273216429db4da7caef4ff7b4f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:21:06.570390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8473-ac56-44f9-9cc7-430b0f6bc074 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.570390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8473-ac56-44f9-9cc7-430b0f6bc074 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.570390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8473-ac56-44f9-9cc7-430b0f6bc074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.606097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fdff8473-ac56-44f9-9cc7-430b0f6bc074 None None] MFA Rules not processed for user `da54f7273216429db4da7caef4ff7b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:06.607260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fdff8473-ac56-44f9-9cc7-430b0f6bc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:06.693225 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3332/6704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:06.699943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:06.767631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f9-ff38-4b34-a657-f9c4e764681e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:06.771624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:06.773898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:06.774274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:06.774550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:06.852923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:06.855052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:06.868808 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3373/6705] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:07.893864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:07.897683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:07.898381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:07.940254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] MFA Rules not processed for user `b34b183f2b0b4a4597fb2e3b6495268a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:07.942647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:08.089983 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3333/6706] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:12.575652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:12.577286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:12.602703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8231679-a942-4d73-97eb-77ab6f7ce9e9 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:12.612463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:12.613309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:12.613802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:12.614234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:12.639911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:12.641562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:12.653717 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3374/6707] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:15.963666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:16.002250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd277c-f094-4ba2-96fe-5843b87b9773 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:16.014375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:16.016673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:16.017162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:16.017748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:16.023411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:16.050206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:16.055052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e2888-f503-4df3-8d84-2e8cce7c7ccb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:16.081449 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3334/6708] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:17.051183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:17.206857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62f72-3189-4d91-80ba-8370fde35e07 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:17.219376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:17.220189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:17.222395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:17.222716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] PATH_INFO: `/v3/users/e34721efef3c454b82f8afd9d77f25c3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:17.226812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34721efef3c454b82f8afd9d77f25c3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:17.230640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:17.273655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:17.395874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34721efef3c454b82f8afd9d77f25c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:17.396579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34721efef3c454b82f8afd9d77f25c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:17.429829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34721efef3c454b82f8afd9d77f25c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:17.440941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34721efef3c454b82f8afd9d77f25c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:17.441662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34721efef3c454b82f8afd9d77f25c3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:17.481330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3375/6709] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:17 2022] DELETE /identity/v3/users/e34721efef3c454b82f8afd9d77f25c3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:17.486468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:17.487470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:17.489558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:17.533572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:17.535366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:17.554610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:17.653833 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3335/6710] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:17.671099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:17.672512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:17.762625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50db30-792b-4d99-9fba-dfd1ac8d2f38 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:17.769214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:17.769928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:17.770455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:17.770798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:17.786172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:17.800284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:17.815214 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3376/6711] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:18.431511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:18.433299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:18.460559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff474de-4291-4691-97ed-ba4c41e1c402 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:18.473921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:18.475116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:18.476283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:18.477432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] PATH_INFO: `/v3/projects/76b53ae63a3c44aca75b9e740a81203b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:18.481164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b53ae63a3c44aca75b9e740a81203b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:18.483447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:18.605260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b53ae63a3c44aca75b9e740a81203b', 'request_id': 'req-f560c90a-8f19-49ea-8f44-6dac25a168ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.639746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b53ae63a3c44aca75b9e740a81203b', 'request_id': 'req-f560c90a-8f19-49ea-8f44-6dac25a168ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.658002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b53ae63a3c44aca75b9e740a81203b', 'request_id': 'req-f560c90a-8f19-49ea-8f44-6dac25a168ec'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.681780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] The token cache is being invalidate because project 76b53ae63a3c44aca75b9e740a81203b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:18.682079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.683893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.685767 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3336/6712] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:18 2022] DELETE /identity/v3/projects/76b53ae63a3c44aca75b9e740a81203b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:18.690006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:18.710460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f896-0a17-47e7-ace8-d1236577c069 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:18.812311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:18.813038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:18.813320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:18.813645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] PATH_INFO: `/v3/users/da54f7273216429db4da7caef4ff7b4f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:18.814854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da54f7273216429db4da7caef4ff7b4f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:18.816893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:18.870456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:18.890885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da54f7273216429db4da7caef4ff7b4f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.891596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da54f7273216429db4da7caef4ff7b4f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.903733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da54f7273216429db4da7caef4ff7b4f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.916299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da54f7273216429db4da7caef4ff7b4f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.917360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-05cab82d-ccc6-49ad-bd44-db4feca89559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da54f7273216429db4da7caef4ff7b4f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:18.945536 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3377/6713] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:18 2022] DELETE /identity/v3/users/da54f7273216429db4da7caef4ff7b4f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:19.267673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:19.271207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:19.290729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c90a-8f19-49ea-8f44-6dac25a168ec admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:19.379143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:19.380738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:19.381493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:19.382033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] PATH_INFO: `/v3/projects/f86443e1d7164479b8ea59768f3df225` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:19.384897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86443e1d7164479b8ea59768f3df225)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:19.387820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:19.449606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:19.460701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86443e1d7164479b8ea59768f3df225', 'request_id': 'req-4f05f102-7ff7-4100-a352-03ca7a5672e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:19.470341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86443e1d7164479b8ea59768f3df225', 'request_id': 'req-4f05f102-7ff7-4100-a352-03ca7a5672e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:19.480983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86443e1d7164479b8ea59768f3df225', 'request_id': 'req-4f05f102-7ff7-4100-a352-03ca7a5672e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:19.495507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] The token cache is being invalidate because project f86443e1d7164479b8ea59768f3df225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:19.495894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:19.496731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4f05f102-7ff7-4100-a352-03ca7a5672e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:19.499287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3337/6714] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:19 2022] DELETE /identity/v3/projects/f86443e1d7164479b8ea59768f3df225 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:19.504880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:19.505179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:19.505488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:19.551642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:19.553864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:19.679367 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3378/6715] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:19.681093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:19.681548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:19.681761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:19.719046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:19.724268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:19.742464 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3338/6716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:19.743971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:19.765650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbb6a5-9a45-4124-83cd-974316c16cd6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:19.779630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:19.780324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:19.781165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:19.781165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:19.781541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:19.781833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:19.786019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:19.822340 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3379/6717] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:21:19.826722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:19.843032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b5a2-88e6-4413-8c31-d4a8df3ec0c1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:19.849155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:19.849930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:19.850452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:19.851023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:19.852137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:19.854329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:19.925698 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3339/6718] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:19 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:19.926882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:19.946549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93dd2c-2878-419d-a270-9aa4f4473cf4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:20.113016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:20.113530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.113856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.114136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.115040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:20.117288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:20.169932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3380/6719] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:19 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:20.174572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:20.187628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a39798-5223-4cbc-940b-1c6046e405a4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:20.193020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:20.194015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.194762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.196780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.197743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:20.199617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:20.216161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3340/6720] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:20.223066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:20.238301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577f61-7b3a-4bbb-a04d-b45175ed0ffe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:20.250510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:20.251834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.252236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.252612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.253784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:20.259574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549bd7e-58dd-4cee-9c86-4a86361d824c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:20.276127 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3381/6721] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:20.281022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:20.298382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326c8c-15c1-4ced-83b3-22fd9a8206c3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:20.349014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:20.349718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.350002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.350274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] PATH_INFO: `/v3/projects/4fca8faf033845b3adc3cc1e973f4cc5/users/7c7f26ae4ec34579b03910bc17a1003a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.401334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fca8faf033845b3adc3cc1e973f4cc5, user_id=7c7f26ae4ec34579b03910bc17a1003a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:20.406329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:20.431783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3341/6722] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:20 2022] PUT /identity/v3/projects/4fca8faf033845b3adc3cc1e973f4cc5/users/7c7f26ae4ec34579b03910bc17a1003a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:20.442669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.442959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.443220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.510141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] MFA Rules not processed for user `7c7f26ae4ec34579b03910bc17a1003a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:20.511404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:20.520446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:20.678281 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3382/6723] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:20.682623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:20.836498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703ceda-03b4-48b6-87d0-9834e78d74fe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:20.841963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:20.844062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:20.844542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:20.845171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:20.846006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:20.848847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:20.906884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3342/6724] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:20 2022] POST /identity/v3/projects => generated 399 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:20.907558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:20.925437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fccc9-b77d-4c6f-a010-5dea82199ba6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:21.061452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:21.062088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.062368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.062643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.063295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:21.065294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:21.128338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3383/6725] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:20 2022] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:21:21.134143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:21.149563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825b69-5aaa-4225-91c0-ab1f07684010 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:21.155622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:21.156449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.157073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.157502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.158335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:21.165800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:21.190907 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3343/6726] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:21.192526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:21.213686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2daad-b0d5-4e31-a053-1afa1cb3d5b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:21.223802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:21.224621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.225059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.225951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] PATH_INFO: `/v3/projects/b8975b50d6244a459df7d9fe7518de02/users/c283e228da60403189745bb8b6516aa3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.250768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8975b50d6244a459df7d9fe7518de02, user_id=c283e228da60403189745bb8b6516aa3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:21.256522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:21.291598 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3384/6727] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:21 2022] PUT /identity/v3/projects/b8975b50d6244a459df7d9fe7518de02/users/c283e228da60403189745bb8b6516aa3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:21.295600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:21.315725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ab31-1c0a-475d-a5e3-a52dbbbb4f63 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:21.426620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:21.536335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:21.536996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.537290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.537563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.538773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:21.540726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be2440-04a5-44ef-b5b1-16fbdac6e9b0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:21.570003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3344/6728] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:21.575178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:21.611272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984628-1897-46e1-b317-1222fce99d0b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:21.616791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:21.617516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.617857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.618139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] PATH_INFO: `/v3/projects/b8975b50d6244a459df7d9fe7518de02/users/c283e228da60403189745bb8b6516aa3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.622988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8975b50d6244a459df7d9fe7518de02, user_id=c283e228da60403189745bb8b6516aa3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:21.626119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:21.646871 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3385/6729] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:21 2022] PUT /identity/v3/projects/b8975b50d6244a459df7d9fe7518de02/users/c283e228da60403189745bb8b6516aa3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:21.661885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:21.662289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:21.662669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:21.752260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] MFA Rules not processed for user `c283e228da60403189745bb8b6516aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:21.753571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:21.909924 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3345/6730] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:21.938142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:21.940174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:22.138090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e259-d098-432b-a14b-2d6741071ac7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:22.166402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:22.166593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:22.166879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:22.167157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:22.202279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:22.205829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:22.207895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:22.308440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:22.319394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:22.345964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3386/6731] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:22.425798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd1ae-254d-4a2d-a4d1-71b4b49bb235 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:22.441452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:22.442334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:22.442994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:22.443422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:22.453376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:22.479864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:22.482621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:22.512863 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3346/6732] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:22.882289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:22.883551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:22.926942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39739888-1ba0-4af7-9d39-0386a4abed8a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:22.937098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:22.938824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:22.939417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:22.940370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:22.943801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:22.985520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:22.987542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:23.014239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3387/6733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:23.082029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:23.084643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.182090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:23.214969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf797-05d3-4cfd-bc9a-22c7947e08d7 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:23.222719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:23.224080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:23.224436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:23.224783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:23.234544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:23.236484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:23.248608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3347/6734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:23.363600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:23.365293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.408268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761b262-77b4-4666-b006-812e368af3ea service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:23.421481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:23.424016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:23.425020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:23.425383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:23.433407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.468104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:23.472247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:23.512479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3388/6735] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:23.889727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:23.913872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915f3e-1366-4660-89fa-b3fcc53d9a44 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:23.925469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:23.926507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:23.927170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:23.927927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:23.933268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.979442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:23.981525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:24.001682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3348/6736] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:26.240723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:26.262961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584e9b-c4ad-45d1-be0c-23a0d513f69a service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:26.274343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:26.275642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:26.276089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:26.276520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:26.278532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:26.312629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:26.314150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:26.334731 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3389/6737] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:28.143900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:28.146811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:28.179663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867748c3-4e9e-4489-9431-9a41760b639b service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:28.198897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:28.199541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:28.204480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:28.204935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:28.207830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:28.261419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:28.263284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:28.297125 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3349/6738] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:29.511701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:29.542709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6bcb-9760-49ba-b669-d53e92682fdb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:29.565565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:29.566389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:29.566867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:29.567129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:29.569367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:29.662378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:29.664652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c3525-36b2-4f6c-8c72-e2a738ac707c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:29.688715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3390/6739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:33.344717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:33.369142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c893-7d21-4d21-90ec-865918191a4e service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:33.386053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:33.386914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:33.387356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:33.387789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:33.393724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:33.426036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:33.432725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:33.467414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3350/6740] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:35.698815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a89a-79cb-42eb-9b7d-55d55fe6181a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:35.699304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a89a-79cb-42eb-9b7d-55d55fe6181a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:35.699388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a89a-79cb-42eb-9b7d-55d55fe6181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:35.750439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7774a89a-79cb-42eb-9b7d-55d55fe6181a None None] MFA Rules not processed for user `839e2104bc0d4b1fb55d69966eedd998`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:35.752585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7774a89a-79cb-42eb-9b7d-55d55fe6181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:35.873679 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3391/6741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:37.070129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:37.243291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7f0d-0682-462a-90d7-89a3eed42e53 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:37.253559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:37.254416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:37.254799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:37.255225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] PATH_INFO: `/v3/users/7c7f26ae4ec34579b03910bc17a1003a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:37.257383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7f26ae4ec34579b03910bc17a1003a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:37.259456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:37.325670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7f26ae4ec34579b03910bc17a1003a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:37.326442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7f26ae4ec34579b03910bc17a1003a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:37.327153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7f26ae4ec34579b03910bc17a1003a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:37.352876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7f26ae4ec34579b03910bc17a1003a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:37.365209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7f26ae4ec34579b03910bc17a1003a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:37.394682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3351/6742] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:37 2022] DELETE /identity/v3/users/7c7f26ae4ec34579b03910bc17a1003a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:37.399344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:37.399922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:37.399922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:37.425257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:37.427408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:37.441180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:37.514157 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3392/6743] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:37.525833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:37.527565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:37.573200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:37.669724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b5f63-de17-47a0-b3b8-d5f60eaffe84 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:37.680761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:37.681512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:37.682452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:37.682775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:37.700080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:37.701650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:37.726966 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3352/6744] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:38.183490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:38.184961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:38.208814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2761b-636f-43b9-bcbc-f5fc889553c6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:38.217888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:38.219679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:38.220122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:38.220575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] PATH_INFO: `/v3/projects/4fca8faf033845b3adc3cc1e973f4cc5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:38.222322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fca8faf033845b3adc3cc1e973f4cc5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:38.226314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:38.315974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fca8faf033845b3adc3cc1e973f4cc5', 'request_id': 'req-04880cdb-082a-4111-836e-43fc236a4aeb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.324373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fca8faf033845b3adc3cc1e973f4cc5', 'request_id': 'req-04880cdb-082a-4111-836e-43fc236a4aeb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.353154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fca8faf033845b3adc3cc1e973f4cc5', 'request_id': 'req-04880cdb-082a-4111-836e-43fc236a4aeb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.372316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] The token cache is being invalidate because project 4fca8faf033845b3adc3cc1e973f4cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:38.372850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.373713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.375839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3393/6745] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:38 2022] DELETE /identity/v3/projects/4fca8faf033845b3adc3cc1e973f4cc5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:21:38.379676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:38.397087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d6e65-9113-4157-89a9-7630d15c87b4 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:38.486987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:38.488078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:38.488532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:38.488998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] PATH_INFO: `/v3/users/c283e228da60403189745bb8b6516aa3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:38.490475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c283e228da60403189745bb8b6516aa3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:38.494720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:38.670916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c283e228da60403189745bb8b6516aa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.671667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c283e228da60403189745bb8b6516aa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.672335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c283e228da60403189745bb8b6516aa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.684294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c283e228da60403189745bb8b6516aa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.692421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3da9633b-15ca-4912-b10b-f089b5dfc263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c283e228da60403189745bb8b6516aa3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:38.732774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3353/6746] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:21:38 2022] DELETE /identity/v3/users/c283e228da60403189745bb8b6516aa3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:39.076643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.078188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:39.097410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880cdb-082a-4111-836e-43fc236a4aeb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.197156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.198014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.198305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.198764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] PATH_INFO: `/v3/projects/b8975b50d6244a459df7d9fe7518de02` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.199973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8975b50d6244a459df7d9fe7518de02)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.202114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.262634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:39.270011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8975b50d6244a459df7d9fe7518de02', 'request_id': 'req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:39.278222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8975b50d6244a459df7d9fe7518de02', 'request_id': 'req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:39.287412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8975b50d6244a459df7d9fe7518de02', 'request_id': 'req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:39.301427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] The token cache is being invalidate because project b8975b50d6244a459df7d9fe7518de02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:39.301819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:39.302706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-229305ed-b7cb-4c37-bd7a-f2c57fad9aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:39.304430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3394/6747] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:39 2022] DELETE /identity/v3/projects/b8975b50d6244a459df7d9fe7518de02 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:39.309626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.310158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.310862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.341690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:39.343246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:39.385290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:39.418098 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3354/6748] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:39.425933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.426316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.426666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.447881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:39.449188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:39.457411 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3395/6749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:39.462441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.472625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679ce4d-9398-4132-a25c-e7d82b0021cd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.477597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.478217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.478498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.478913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.479569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:39.479873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.481603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.495362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3355/6750] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:39.499773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.510768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e5c7-35e4-4447-aa0a-e444480572b4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.515490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.516108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.516387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.516657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.517339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.519284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.554461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3396/6751] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:39 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:21:39.555989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.566546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df0af-e0bb-4043-ab0d-4c3c5f9261b4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.648178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.649052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.649409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.649749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.651194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.653978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.698060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3356/6752] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:39 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:39.699338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.712860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396665d-110c-4928-9638-eb76b7fa1efd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.720539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.721216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.721500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.721770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.722454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.724072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.758580 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3397/6753] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:39.765827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.787383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669eef76-d0d2-4206-8033-8342cd415e1f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.812104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.813850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.815954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.816835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.820748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.824972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac98d5-8935-44af-be40-239e28a8e5df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.853099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3357/6754] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:39.857301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:39.895209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c140c7-9b22-434d-8835-79c3072bf128 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:39.909469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:39.910422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.910883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.911618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] PATH_INFO: `/v3/projects/779009bde50c42e099cc43fddc851496/users/448054f8b5464c218f0cad815cafac65/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:39.952246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779009bde50c42e099cc43fddc851496, user_id=448054f8b5464c218f0cad815cafac65, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:39.955909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:39.974140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3398/6755] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:39 2022] PUT /identity/v3/projects/779009bde50c42e099cc43fddc851496/users/448054f8b5464c218f0cad815cafac65/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:39.985555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:39.986561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:39.987007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.024751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] MFA Rules not processed for user `448054f8b5464c218f0cad815cafac65`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:40.026096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:40.122492 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3358/6756] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:40.126747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.264065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397e59-eb54-4191-b0df-3683f535dcd4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.275738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.276477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.276888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.277252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.278020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.287252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:40.354045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3399/6757] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:40 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:21:40.358151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.374423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dcb26-b1a4-48b3-932a-7a3adfd1c135 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.478389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:40.525541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.526651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.529219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.529861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.531212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.533526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:40.602432 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3359/6758] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:21:40 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:40.603018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.620710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2205a41-53dc-4bd4-9ee7-a7e4d3bb609c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.632613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.634147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.634672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.635158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.637011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.639764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:40.659705 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3400/6759] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:40.664216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.678650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba8bb6-0fad-4c2b-b0c2-7467f2a1dd4d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.683375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.684421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.684703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.685488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] PATH_INFO: `/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc/users/de9cc9af164249979e1924f88f83bde9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.706644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e46a49bd055417d9cfcd2bb563c96fc, user_id=de9cc9af164249979e1924f88f83bde9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.711278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:40.743632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3360/6760] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:40 2022] PUT /identity/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc/users/de9cc9af164249979e1924f88f83bde9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:40.744997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.756145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46f20-c82d-44e8-8911-3080a73028b4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.867978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:40.914950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.915852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.917415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.917864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.918947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.920813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262bd96-788f-4e5e-96f9-2fcea36b7491 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:40.934858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3401/6761] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:21:40.939278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:40.951234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31581154-cf08-450b-96bd-d2b1982b0c1d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:40.957198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:40.957802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:40.958078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:40.958417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] PATH_INFO: `/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc/users/de9cc9af164249979e1924f88f83bde9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:40.978329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e46a49bd055417d9cfcd2bb563c96fc, user_id=de9cc9af164249979e1924f88f83bde9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:40.982890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:41.029523 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3361/6762] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:21:40 2022] PUT /identity/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc/users/de9cc9af164249979e1924f88f83bde9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:41.043176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:41.043874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:41.044328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:41.105499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] MFA Rules not processed for user `de9cc9af164249979e1924f88f83bde9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:41.106952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:41.210726 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3402/6763] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:41.248265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:41.250512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:41.442289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d090-14d6-4599-bf82-ceb30586322d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:41.446785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:41.447593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:41.448234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:41.448665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:41.462594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:41.467397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:41.487478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3362/6764] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:51.205035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=45 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:51.480047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=55,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:54.882171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:54.903988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945aaee-031e-45b9-8409-8e20b84d4ba2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:54.919400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9cc9af164249979e1924f88f83bde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e46a49bd055417d9cfcd2bb563c96fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:54.921646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:54.922185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:54.922637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:54.924044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:54.925231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:54.931376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:54.948842 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3403/6765] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:54.952947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:54.973209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ffa5e-e674-410b-b70b-54d48f929b79 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:54.985343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9cc9af164249979e1924f88f83bde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e46a49bd055417d9cfcd2bb563c96fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:54.986509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:54.987006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:54.987590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:54.988645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:54.992857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:55.042984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3363/6766] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:21:54 2022] POST /identity/v3/projects => generated 347 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:21:55.047196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:55.059103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3923-1289-4768-ab08-39449fb89101 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:55.183492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9cc9af164249979e1924f88f83bde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e46a49bd055417d9cfcd2bb563c96fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:55.185270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:55.186030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:55.188930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:55.190001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:21:55.190588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:55.197284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:55.247328 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3404/6767] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:21:56.253905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:56.272001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a6132-8ab8-4529-b704-3a0b5001a50a tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:56.279477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de9cc9af164249979e1924f88f83bde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e46a49bd055417d9cfcd2bb563c96fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:56.280152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:56.280437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:56.280760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] PATH_INFO: `/v3/projects/c22c0f91568b431ca461819cf91d2a9d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:56.283192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c22c0f91568b431ca461819cf91d2a9d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:56.285441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:56.389990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22c0f91568b431ca461819cf91d2a9d', 'request_id': 'req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:56.397332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22c0f91568b431ca461819cf91d2a9d', 'request_id': 'req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:56.407596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22c0f91568b431ca461819cf91d2a9d', 'request_id': 'req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:56.438621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] The token cache is being invalidate because project c22c0f91568b431ca461819cf91d2a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:21:56.439141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:56.440035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:21:56.443034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3364/6768] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:21:56 2022] DELETE /identity/v3/projects/c22c0f91568b431ca461819cf91d2a9d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:21:56.456813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:56.459306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:56.561662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c473d-7936-4025-98f9-91bd37fb817e tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:56.715555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:56.717562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:56.718045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:56.718615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:56.725961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:56.832650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:56.853711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:56.855154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a1c2b-4e51-44dd-8340-046c27fc45b1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:56.870120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3405/6769] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:01.173358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:01.174819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:01.276007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd9fed-1a48-48b6-b0f3-a1de68fab804 tempest-RoutersAdminTest-1370708869 tempest-RoutersAdminTest-1370708869-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:01.281994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:01.283929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:01.284402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:01.284864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] PATH_INFO: `/v3/users/93a09849ffe6420ab04ceeed8a7f83a0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:01.286283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a09849ffe6420ab04ceeed8a7f83a0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:01.301528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:01.380059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a09849ffe6420ab04ceeed8a7f83a0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.381811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a09849ffe6420ab04ceeed8a7f83a0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.382733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a09849ffe6420ab04ceeed8a7f83a0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.390509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a09849ffe6420ab04ceeed8a7f83a0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.399583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a09849ffe6420ab04ceeed8a7f83a0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.400248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:01.424131 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3365/6770] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:01 2022] DELETE /identity/v3/users/93a09849ffe6420ab04ceeed8a7f83a0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:01.429551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:01.430093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:01.430254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:01.451234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:01.452549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:01.515269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3406/6771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:01.525328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:01.526746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:01.614720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46328-6f43-451c-aebd-54aa21cc179b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:01.618929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:01.619544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:01.619824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:01.620098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:01.629779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:01.631278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1045eb-3a65-46bb-bba4-7fcf56370d42 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:01.641632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3366/6772] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:01.832634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:01.834251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:01.854201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54e2b2-c688-4e4c-a290-c083fcd86cff None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:01.860546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:01.861323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:01.861656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:01.862005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] PATH_INFO: `/v3/projects/2abf5bf95cb647babb481456587d09b3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:01.863428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abf5bf95cb647babb481456587d09b3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:01.866171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:01.920805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abf5bf95cb647babb481456587d09b3', 'request_id': 'req-8998751e-0b04-4025-a1fa-5278dd01632a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.926386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abf5bf95cb647babb481456587d09b3', 'request_id': 'req-8998751e-0b04-4025-a1fa-5278dd01632a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.935240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abf5bf95cb647babb481456587d09b3', 'request_id': 'req-8998751e-0b04-4025-a1fa-5278dd01632a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.950270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] The token cache is being invalidate because project 2abf5bf95cb647babb481456587d09b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:01.950634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.951247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:01.954160 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3407/6773] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:01 2022] DELETE /identity/v3/projects/2abf5bf95cb647babb481456587d09b3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:01.959421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef797-88fe-4707-9745-07385d10cdd9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:01.959931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef797-88fe-4707-9745-07385d10cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:01.960216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef797-88fe-4707-9745-07385d10cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:01.970025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:01.972249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:01.987196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e37ef797-88fe-4707-9745-07385d10cdd9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:01.988368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e37ef797-88fe-4707-9745-07385d10cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.047291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998751e-0b04-4025-a1fa-5278dd01632a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.052819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.053489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.053763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.054028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] PATH_INFO: `/v3/users/9147c678369e4587b01511fe7c9fceca` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.055332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9147c678369e4587b01511fe7c9fceca)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.057336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.062651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3367/6774] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:22:02.070532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.070809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.071072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.076072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:02.095430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:02.097130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.106150 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3368/6775] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:22:02.110306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.120398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fce8ee-abdb-4bff-b5e0-7521478d9108 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.123050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9147c678369e4587b01511fe7c9fceca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.123725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9147c678369e4587b01511fe7c9fceca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.125451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.126252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.126392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.126595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.127310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:22:02.127591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.129369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.135353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9147c678369e4587b01511fe7c9fceca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.151747 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3369/6776] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:22:02.154930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.156097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9147c678369e4587b01511fe7c9fceca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.156833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-939f6a20-8dce-4196-ba14-3a60be371dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9147c678369e4587b01511fe7c9fceca'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.167261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fa24a-cbc6-4a4e-9524-aa79e642f88b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.174797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.175525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.175808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.176078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.176705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.178735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.183225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3408/6777] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:01 2022] DELETE /identity/v3/users/9147c678369e4587b01511fe7c9fceca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:02.187793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.188076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.188721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.208413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:02.210226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.216960 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3370/6778] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:22:02.218649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.220649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.277442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:02.292755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3409/6779] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:22:02.305982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.307727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.311514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7f9cd-4190-4e1a-8617-f94349f895cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.316844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.317744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.317980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.318254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.318959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.321133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.348935 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3371/6780] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:02.352417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.373262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cf92d-4f83-4c78-9587-bdbda1ad8873 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.381818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.384458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.384592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.384849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.385550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.387183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.397720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6435d-5b1f-4afa-b20f-1d7ee62671ff None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.406476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3372/6781] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:02.410043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.420292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3e26-3aa5-4967-b579-b41fcdec66cd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.425123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.425726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.426006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.426284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.426912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.428564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.441736 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3373/6782] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:02.446181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.457600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9cc34-34d4-4f8c-92cc-62b9e8f0f019 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.460491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.461123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.461403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.461666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.464634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.465395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.465675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.465946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] PATH_INFO: `/v3/projects/8a6eff18260e48029200f4005c1d7c80/users/b025fa9b873848c48887369e733d4672/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.469867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:02.472303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.474061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dac3a-90c7-42fe-bf6b-bc2d8fde569f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.482213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6eff18260e48029200f4005c1d7c80, user_id=b025fa9b873848c48887369e733d4672, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.485120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.488455 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3410/6783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:02.513031 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3374/6784] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:02 2022] PUT /identity/v3/projects/8a6eff18260e48029200f4005c1d7c80/users/b025fa9b873848c48887369e733d4672/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:02.516051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.516344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.516616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.549400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] MFA Rules not processed for user `b025fa9b873848c48887369e733d4672`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:02.551174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.663017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3411/6785] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:02.674038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.692569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:02.697465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:02.761017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203655da-1b63-464d-9e42-26f5ccbc9757 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.764984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.765546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.765943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.766218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.776162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.777644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667f7f7-2d4d-47a1-9739-1ac0e28aa6bb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.785946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956b0f-ce35-4c65-8a51-b6d7e5961f17 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:02.789544 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3375/6786] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:02.790722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:02.791356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.791630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.791923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] PATH_INFO: `/v3/projects/bae9031cc8a247f0862a7c7576211ea4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.793597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae9031cc8a247f0862a7c7576211ea4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:02.795953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:02.858303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae9031cc8a247f0862a7c7576211ea4', 'request_id': 'req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.864762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae9031cc8a247f0862a7c7576211ea4', 'request_id': 'req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.875046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae9031cc8a247f0862a7c7576211ea4', 'request_id': 'req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.893678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] The token cache is being invalidate because project bae9031cc8a247f0862a7c7576211ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:02.894316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.894841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-63726cd0-e72e-4ca4-8ef0-2dd5bcd17532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:02.899680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3412/6787] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:02 2022] DELETE /identity/v3/projects/bae9031cc8a247f0862a7c7576211ea4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:02.902167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:02.902802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:02.903822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:02.929851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:02.931386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:03.017062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3376/6788] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:03.021468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.021813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.022486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.043710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:03.044985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:03.058817 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3413/6789] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:22:03.059838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.071548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597888-9f74-4c46-8f7a-c0e12b97f616 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.077442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.078219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.078604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.078999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.080069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:22:03.080069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.081914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.098486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3377/6790] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:22:03.100315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.110491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cbcdc-0af7-4197-9487-5d08f5c1418e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.117700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.118497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.118888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.119259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.120095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.122246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.127544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:03.159331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3414/6791] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:03 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:03.160711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.172118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e4a78-ed56-4b71-8e81-678d99a18db8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.186742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:03.263657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.264418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.264716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.265265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.266525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.270694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.314529 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3378/6792] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:03 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:03.315954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.328388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd5e8-fad8-41ee-8d7f-ea96a9b88bc3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.335427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.336190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.336580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.336975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.337758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.339559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.352634 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3415/6793] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:03.356484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.370463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe65ff-5f56-4a2e-b491-440d8dcf811e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.375492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.376295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.377179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.377179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.378003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.380675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d9a6-3c96-46e0-99e0-da591964bcb7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.392698 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3379/6794] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:03.397307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.408239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99619df-8c4a-467a-a249-579fabf86bc3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.415347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.416034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.416316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.416588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] PATH_INFO: `/v3/projects/1d20b76bb3444d56929a5a82270974ff/users/2d5e9045146a4e2582f2c2cb0e693e74/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.434933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d20b76bb3444d56929a5a82270974ff, user_id=2d5e9045146a4e2582f2c2cb0e693e74, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.437966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:03.454187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3416/6795] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:03 2022] PUT /identity/v3/projects/1d20b76bb3444d56929a5a82270974ff/users/2d5e9045146a4e2582f2c2cb0e693e74/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:03.467316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a422c-1088-40c5-832b-7dc4d6fb63ea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.468023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a422c-1088-40c5-832b-7dc4d6fb63ea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.469237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a422c-1088-40c5-832b-7dc4d6fb63ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.509852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bb5a422c-1088-40c5-832b-7dc4d6fb63ea None None] MFA Rules not processed for user `2d5e9045146a4e2582f2c2cb0e693e74`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:03.511452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb5a422c-1088-40c5-832b-7dc4d6fb63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:03.630989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3380/6796] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:03.648840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:03.651411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:03.969991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92d32-d041-4feb-9bba-6da24e7fa257 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:03.975823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:03.976459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:03.976919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:03.977330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:03.988407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:03.990159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:04.002621 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3417/6797] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:08.684067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:08.685030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:08.685788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:08.720633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:08.722153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:08.806645 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3381/6798] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:10.600981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:10.603373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:10.790290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d7ad-0c9b-4b7e-b6fc-861806529150 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:10.797009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:10.798001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:10.798556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:10.799114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:10.801575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:10.823816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:10.825622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:10.854193 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3418/6799] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:16.976347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:17.023224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:17.075548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4aaf1-f911-411c-8026-7b544be1233d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:17.080201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:17.080852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:17.081153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:17.081427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] PATH_INFO: `/v3/users/2d5e9045146a4e2582f2c2cb0e693e74` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:17.082706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5e9045146a4e2582f2c2cb0e693e74)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:17.084987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:17.167500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5e9045146a4e2582f2c2cb0e693e74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:17.168251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5e9045146a4e2582f2c2cb0e693e74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:17.169006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5e9045146a4e2582f2c2cb0e693e74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:17.181304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5e9045146a4e2582f2c2cb0e693e74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:17.197418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cbd931f2-21ab-4bcb-b83a-ed8f0b6b99cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5e9045146a4e2582f2c2cb0e693e74'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:17.219474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:17.247079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b92d1-0271-4e4d-9d90-43a77bbef8cb service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:17.247253 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3382/6800] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:16 2022] DELETE /identity/v3/users/2d5e9045146a4e2582f2c2cb0e693e74 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:17.253809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:17.254144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:17.254463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:17.294080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:17.295502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:17.314980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:17.356246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:17.356872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:17.357173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:17.357438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:17.363795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:17.393500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:17.396476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:17.423059 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3419/6801] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:17.438528 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3383/6802] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:17.458759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:17.465732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:17.588025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22315d-4e69-4f1a-84e7-19989a8ccd82 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:17.602964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:17.603599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:17.603877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:17.604148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:17.615720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:17.618257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33323eb-50e2-4daf-ae32-8099423a2bdb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:17.635431 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3420/6803] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:18.265567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.267707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:18.282380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286109-8241-4bcc-9062-ae556f9d64bd None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.287265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.287909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.288183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.288646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] PATH_INFO: `/v3/projects/1d20b76bb3444d56929a5a82270974ff` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.289852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d20b76bb3444d56929a5a82270974ff)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.291963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.349521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:18.362451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d20b76bb3444d56929a5a82270974ff', 'request_id': 'req-e111afd2-f076-489f-82f2-95c1c4725703'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:18.374160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d20b76bb3444d56929a5a82270974ff', 'request_id': 'req-e111afd2-f076-489f-82f2-95c1c4725703'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:18.384888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d20b76bb3444d56929a5a82270974ff', 'request_id': 'req-e111afd2-f076-489f-82f2-95c1c4725703'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:18.403149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] The token cache is being invalidate because project 1d20b76bb3444d56929a5a82270974ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:18.403590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:18.404397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e111afd2-f076-489f-82f2-95c1c4725703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:18.406538 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3384/6804] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:18 2022] DELETE /identity/v3/projects/1d20b76bb3444d56929a5a82270974ff => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:18.412705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.413402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.413402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.442477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:18.445723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:18.556653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.556839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3421/6805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:18.556963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.557228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.597517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:18.598841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:18.611436 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3385/6806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:18.612686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.626020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d9d4d-83d5-4e24-88b8-c582aa26db3a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.632655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.633951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.634377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.634720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.635576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:22:18.635953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.638140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.655148 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3422/6807] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:22:18.657041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.669680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cea15-02f0-435e-b7ab-f666ff1b4bfc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.675140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.675884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.676259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.676648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.677926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.680744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.718815 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3386/6808] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:18 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:18.720228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.731257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb191fb-3d4e-445c-9e40-4ea6ba28598a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.845244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.847866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.848165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.848442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.849197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.851736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.861787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:18.879276 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3423/6809] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:18 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:18.885556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.903259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735de7-2fb7-4e62-9be1-56330a639b71 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.911000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.912632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.913143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.913841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.914648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.916686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.931877 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3387/6810] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:18.934586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.948461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231a4e8-1be3-4576-81c2-33b9aa020cdf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.953880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.954789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.955433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.955918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:18.957133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:18.959739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f903bd-34ad-4eee-a2dc-b70285d851a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:18.977204 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3424/6811] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:18.979870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:18.997965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63baa7a-acab-4285-965c-071309c015ff admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:18.997965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:18.997965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:18.997965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:18.998370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] PATH_INFO: `/v3/projects/73c33864b86748d2bf7fb0cf732b8bf9/users/98fe2b6e1312441a90466a3d71e82e7a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.015785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c33864b86748d2bf7fb0cf732b8bf9, user_id=98fe2b6e1312441a90466a3d71e82e7a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.018629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.032869 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3388/6812] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:18 2022] PUT /identity/v3/projects/73c33864b86748d2bf7fb0cf732b8bf9/users/98fe2b6e1312441a90466a3d71e82e7a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:19.045235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.045577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.045957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.081038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] MFA Rules not processed for user `98fe2b6e1312441a90466a3d71e82e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:19.082438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:19.158967 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3425/6813] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:19.161590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.238543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9dfe9-3348-4422-a0dc-299fa0424ee8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.245580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.246199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.246482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.246800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.247477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.249599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.284081 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3389/6814] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:19 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:19.288212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.301817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ca31-98f6-40f7-b364-bc181368c22e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.371899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.372852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.372852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.373398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.374095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.376430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.404612 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3426/6815] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:19 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:22:19.405892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.417210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0d42-e213-4c87-9563-ab4eaac68318 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.422643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.423269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.423550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.423822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.424468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.426113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.442133 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3390/6816] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:19.443878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.455191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456744-748b-4a0a-9f02-e5c59b6b6903 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.460236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.460946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.461235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.461518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] PATH_INFO: `/v3/projects/fc148fca21b74c95a93d45af2c75e646/users/4062f2cf402b4f3fbfa85d269483a47c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.480281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc148fca21b74c95a93d45af2c75e646, user_id=4062f2cf402b4f3fbfa85d269483a47c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.482985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.498963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3427/6817] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:19 2022] PUT /identity/v3/projects/fc148fca21b74c95a93d45af2c75e646/users/4062f2cf402b4f3fbfa85d269483a47c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:19.504131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.516438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b82b5-06dd-4860-84a1-daf3c32aa424 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.565334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:19.586499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.587133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.587499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.587780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.588428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.590074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeca8cf-0149-4eb6-9a4c-182c7c9a71d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.601748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3391/6818] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:19.605706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.617664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefa48-da84-41c2-99a3-aa820a613b5e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.622895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.623863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.624248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.624616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] PATH_INFO: `/v3/projects/fc148fca21b74c95a93d45af2c75e646/users/4062f2cf402b4f3fbfa85d269483a47c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.626916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc148fca21b74c95a93d45af2c75e646, user_id=4062f2cf402b4f3fbfa85d269483a47c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.629784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:19.642551 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3428/6819] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:19 2022] PUT /identity/v3/projects/fc148fca21b74c95a93d45af2c75e646/users/4062f2cf402b4f3fbfa85d269483a47c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:19.652292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.652593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.652843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.683633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] MFA Rules not processed for user `4062f2cf402b4f3fbfa85d269483a47c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:19.684822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:19.773262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3392/6820] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:19.793402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:19.795707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:19.862333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:19.910559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7d43-714b-4996-9c87-e382efdfcd01 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:19.914887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:19.915498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:19.915774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:19.916099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:19.992876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:19.994181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383c21e-f08c-4e23-becc-d8d9b089a37d service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:20.010766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3429/6821] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:24.910635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:24.937476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b633d09-2d77-4697-9eb1-c19ee899d229 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:24.941723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:24.942538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:24.943017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:24.943460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:24.970090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:24.972047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:24.991365 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3393/6822] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:30.000800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=38 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:32.529314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ce4d-3607-4f7c-8b85-9a4247ea2213 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:32.529956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ce4d-3607-4f7c-8b85-9a4247ea2213 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:32.529956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ce4d-3607-4f7c-8b85-9a4247ea2213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:32.563328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a795ce4d-3607-4f7c-8b85-9a4247ea2213 None None] MFA Rules not processed for user `1b327af221c94695bc5b82fa49e3c448`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:32.565618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a795ce4d-3607-4f7c-8b85-9a4247ea2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:32.671362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3430/6823] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:34.982880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=50 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:37.975676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:38.147107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c934f-7268-4951-9a32-02c5b57fc9b7 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:38.159492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:38.160167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:38.160446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:38.165382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] PATH_INFO: `/v3/users/98fe2b6e1312441a90466a3d71e82e7a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:38.166829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fe2b6e1312441a90466a3d71e82e7a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:38.168798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:38.276275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fe2b6e1312441a90466a3d71e82e7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:38.277002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fe2b6e1312441a90466a3d71e82e7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:38.277875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fe2b6e1312441a90466a3d71e82e7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:38.293336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fe2b6e1312441a90466a3d71e82e7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:38.309261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fe2b6e1312441a90466a3d71e82e7a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:38.348616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3394/6824] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:37 2022] DELETE /identity/v3/users/98fe2b6e1312441a90466a3d71e82e7a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:38.354044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:38.356130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:38.356690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:38.398413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:38.406610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:38.611719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3431/6825] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:38.629568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:38.631484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:38.864277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf274-749b-4e1a-9b62-cbcb58a86647 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:38.869985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:38.870668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:38.870960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:38.871233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:38.892565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:38.894217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:38.906658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3395/6826] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:40.247995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:40.252160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:40.282471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d607-4f6e-4cb1-aa60-43efc3915feb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:40.294000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:40.295078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:40.295437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:40.295666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] PATH_INFO: `/v3/projects/73c33864b86748d2bf7fb0cf732b8bf9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:40.297906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c33864b86748d2bf7fb0cf732b8bf9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:40.301447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:40.413478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c33864b86748d2bf7fb0cf732b8bf9', 'request_id': 'req-b6748051-2652-475a-b24c-620f29922be5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.420381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c33864b86748d2bf7fb0cf732b8bf9', 'request_id': 'req-b6748051-2652-475a-b24c-620f29922be5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.438632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c33864b86748d2bf7fb0cf732b8bf9', 'request_id': 'req-b6748051-2652-475a-b24c-620f29922be5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.457106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] The token cache is being invalidate because project 73c33864b86748d2bf7fb0cf732b8bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:40.457541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.459017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.464483 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3432/6827] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:40 2022] DELETE /identity/v3/projects/73c33864b86748d2bf7fb0cf732b8bf9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:40.465465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:40.482626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1997c-bd8b-49f7-b3d5-33f6c7222bc2 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:40.513174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:40.577350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:40.578603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:40.578948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:40.579236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] PATH_INFO: `/v3/users/4062f2cf402b4f3fbfa85d269483a47c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:40.591423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4062f2cf402b4f3fbfa85d269483a47c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:40.605402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:40.678433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4062f2cf402b4f3fbfa85d269483a47c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.679121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4062f2cf402b4f3fbfa85d269483a47c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.679747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4062f2cf402b4f3fbfa85d269483a47c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.690553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4062f2cf402b4f3fbfa85d269483a47c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.700610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9ea16b59-3e2e-4544-9b1a-a908e4387923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4062f2cf402b4f3fbfa85d269483a47c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:40.722398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3396/6828] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:40 2022] DELETE /identity/v3/users/4062f2cf402b4f3fbfa85d269483a47c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:41.781623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:41.784001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:41.809146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6748051-2652-475a-b24c-620f29922be5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:41.867108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:41.949149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:41.949997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:41.950386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:41.950763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] PATH_INFO: `/v3/projects/fc148fca21b74c95a93d45af2c75e646` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:41.952040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc148fca21b74c95a93d45af2c75e646)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:41.954364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.086705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc148fca21b74c95a93d45af2c75e646', 'request_id': 'req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:42.110166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc148fca21b74c95a93d45af2c75e646', 'request_id': 'req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:42.127950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc148fca21b74c95a93d45af2c75e646', 'request_id': 'req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:42.147981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] The token cache is being invalidate because project fc148fca21b74c95a93d45af2c75e646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:42.151206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:42.152788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5c191c3b-1d2b-42fc-b1c9-97afa39727c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:42.158225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3433/6829] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:41 2022] DELETE /identity/v3/projects/fc148fca21b74c95a93d45af2c75e646 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:42.163683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.164830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.165282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.210393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:42.212832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:42.385887 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3397/6830] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:42.390108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.390108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.393081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.420472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:42.421835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:42.439227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3434/6831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:42.441063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.454665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095068c6-6469-4400-bf57-a8d3155d9866 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.460694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.461598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.461961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.462302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.463029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:22:42.463412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.465105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.484988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3398/6832] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:22:42.486247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.500893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39b90a-b2b6-4082-a30e-b715ec7048cc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.506785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.507490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.507840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.508178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.509142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.511872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.556457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3435/6833] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:42 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:42.557708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.575086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f02c-b750-4cbb-9ebc-207cee16f2b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.627472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:42.682014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.683132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.683522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.684107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.684979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.689013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.722543 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3399/6834] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:42 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:42.727170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.742737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acea3-e4f0-4d86-b15e-f47bc558f0ca admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.751819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.753105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.753597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.755024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.756391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.759867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.785261 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3436/6835] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:42.790584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.808200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056019d-0f9d-4dcc-bc06-620e2e7bcfde admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.818398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.819775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.820352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.821921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.823334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.826290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bfa8b-a7c3-4dd2-867e-23874ea1ed1f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.842876 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3400/6836] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:42.844383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:42.859161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ab360-f62a-4a44-8dc9-f88ccd450756 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:42.864836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:42.865665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.865942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.866205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] PATH_INFO: `/v3/projects/3de647ee948740aab435cadcd76de570/users/f5e430f9ec8349e9bf20b6a20deb2814/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.886099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de647ee948740aab435cadcd76de570, user_id=f5e430f9ec8349e9bf20b6a20deb2814, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:42.890642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:42.918766 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3437/6837] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:42 2022] PUT /identity/v3/projects/3de647ee948740aab435cadcd76de570/users/f5e430f9ec8349e9bf20b6a20deb2814/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:42.921176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188189-79a4-458c-8096-3e96f040a864 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:42.921625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188189-79a4-458c-8096-3e96f040a864 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:42.922082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188189-79a4-458c-8096-3e96f040a864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:42.957685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-be188189-79a4-458c-8096-3e96f040a864 None None] MFA Rules not processed for user `f5e430f9ec8349e9bf20b6a20deb2814`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:42.960137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be188189-79a4-458c-8096-3e96f040a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.026874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.029475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.109105 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3401/6838] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:43.113259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188189-79a4-458c-8096-3e96f040a864 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.137991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:43.144765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e7a37-0f49-4699-87de-e8622caeae1b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.153513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.154764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.155408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.155998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] PATH_INFO: `/v3/users/448054f8b5464c218f0cad815cafac65` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.160783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448054f8b5464c218f0cad815cafac65)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.160783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.209004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188189-79a4-458c-8096-3e96f040a864 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.214843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.215517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.216159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.216512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.217232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.219503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.247081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448054f8b5464c218f0cad815cafac65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:43.248074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448054f8b5464c218f0cad815cafac65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:43.259319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448054f8b5464c218f0cad815cafac65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:43.266013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3402/6839] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:43.274013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.300297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448054f8b5464c218f0cad815cafac65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:43.301120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3fdb1087-625e-4ba7-83bb-f6a4191be582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448054f8b5464c218f0cad815cafac65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:43.321006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:43.344868 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3438/6840] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:43 2022] DELETE /identity/v3/users/448054f8b5464c218f0cad815cafac65 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:43.349070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.349338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.349614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.369665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b684515-df13-494d-a947-a34144742fcc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.396673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:43.399019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.488896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.490138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.490421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.490692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.491388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.493438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.506128 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3439/6841] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:43.519745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.521295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.538682 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3403/6842] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:43 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:43.539752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.541545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.556947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01709c63-5336-46ca-bce0-0e5a9b316330 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.563924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.564744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.565106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.565387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.566223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.568732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.582274 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3404/6843] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:43.587150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.602665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e9a7-f166-4abe-b9bf-7a7c9c756b3b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.606675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeae15-9cba-4d62-a999-781a0ffb7b6a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.609393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.610681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.611081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.611407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] PATH_INFO: `/v3/projects/56fb477b414d4c6b9f79042fb920de97/users/f9ff830c3972467ba0ab4c7e8cafec33/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.612460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.613428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.613932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.614505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.628255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.631250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.632232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fb477b414d4c6b9f79042fb920de97, user_id=f9ff830c3972467ba0ab4c7e8cafec33, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.635109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.658635 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3405/6845] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:43 2022] PUT /identity/v3/projects/56fb477b414d4c6b9f79042fb920de97/users/f9ff830c3972467ba0ab4c7e8cafec33/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:43.659064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3440/6845] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:43.659700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.784287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d6c1b-0bf3-43f6-a292-a87f12071737 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.793513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.794403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.795005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.795544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.796615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.798843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d58f40-0e47-4486-a979-f53a6e86ee4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.819589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3406/6846] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:43.824209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:43.846983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03c2d-4310-4c90-9c63-a90cabca84be service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:43.854024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:43.855311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.855600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.855882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] PATH_INFO: `/v3/projects/56fb477b414d4c6b9f79042fb920de97/users/f9ff830c3972467ba0ab4c7e8cafec33/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.858215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fb477b414d4c6b9f79042fb920de97, user_id=f9ff830c3972467ba0ab4c7e8cafec33, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:43.862362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:43.878479 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3441/6847] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:43 2022] PUT /identity/v3/projects/56fb477b414d4c6b9f79042fb920de97/users/f9ff830c3972467ba0ab4c7e8cafec33/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:43.889629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:43.889979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:43.890283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:43.930186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] MFA Rules not processed for user `f9ff830c3972467ba0ab4c7e8cafec33`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:43.931542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:43.944264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:44.031969 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3407/6848] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:44.065214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:44.067633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:44.079380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:44.260439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21709-ca0f-4bfe-9953-ebea6df09cfe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:44.262721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:44.264082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:44.271932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:44.273041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:44.273775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:44.274249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:44.286133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:44.412750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846db33-bbf3-4479-93cd-029630e9d837 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:44.426115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:44.426854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:44.428126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:44.428416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] PATH_INFO: `/v3/projects/779009bde50c42e099cc43fddc851496` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:44.430238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779009bde50c42e099cc43fddc851496)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:44.433424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:44.530802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:44.538570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:44.562814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3442/6849] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:44.644297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779009bde50c42e099cc43fddc851496', 'request_id': 'req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.662140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779009bde50c42e099cc43fddc851496', 'request_id': 'req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.675609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779009bde50c42e099cc43fddc851496', 'request_id': 'req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.727548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] The token cache is being invalidate because project 779009bde50c42e099cc43fddc851496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:44.739654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.739654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.739971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3408/6850] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:44 2022] DELETE /identity/v3/projects/779009bde50c42e099cc43fddc851496 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:44.743444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:44.765757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45c3e-451a-4c6c-a627-b7bf92b5a7a4 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:44.853704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:44.855418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:44.855757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:44.859553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] PATH_INFO: `/v3/users/de9cc9af164249979e1924f88f83bde9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:44.861008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9cc9af164249979e1924f88f83bde9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:44.870667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:44.990004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9cc9af164249979e1924f88f83bde9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:44.991149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9cc9af164249979e1924f88f83bde9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:45.007745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9cc9af164249979e1924f88f83bde9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:45.055258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:45.057547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9cc9af164249979e1924f88f83bde9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:45.061275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b07ae31-c0f1-47f5-ba4a-2914f2800c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9cc9af164249979e1924f88f83bde9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:45.149642 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3443/6851] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:44 2022] DELETE /identity/v3/users/de9cc9af164249979e1924f88f83bde9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:22:45.683301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:45.684818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:45.726960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a4c-7e0d-4767-8b21-7aa0455c33b2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:45.903106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:45.964696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:45.966129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:45.966129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:45.966129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] PATH_INFO: `/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:45.967509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e46a49bd055417d9cfcd2bb563c96fc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:45.969544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:46.122727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e46a49bd055417d9cfcd2bb563c96fc', 'request_id': 'req-fb21abf1-ae83-44c2-9230-7064612b9f6e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:46.133782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e46a49bd055417d9cfcd2bb563c96fc', 'request_id': 'req-fb21abf1-ae83-44c2-9230-7064612b9f6e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:46.147765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e46a49bd055417d9cfcd2bb563c96fc', 'request_id': 'req-fb21abf1-ae83-44c2-9230-7064612b9f6e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:46.170830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] The token cache is being invalidate because project 0e46a49bd055417d9cfcd2bb563c96fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:22:46.171200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:46.172295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fb21abf1-ae83-44c2-9230-7064612b9f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:46.175167 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3409/6852] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:22:45 2022] DELETE /identity/v3/projects/0e46a49bd055417d9cfcd2bb563c96fc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:46.180608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:46.184453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:46.184453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:46.210114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:46.212010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:46.395360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3444/6853] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:46.407149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:46.407707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:46.408779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:46.475104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:46.476507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:46.506091 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3410/6854] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:46.515154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:46.541260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373086a-389d-4a6b-aa52-31563ed2eeb9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:46.546649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:46.547395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:46.547793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:46.548170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:46.549181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:22:46.549619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:46.552695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:46.598475 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3445/6855] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:22:46.612601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:46.643899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7d1b-8202-4f72-ac86-a0fc53484949 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:46.653211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:46.653769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:46.654047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:46.654315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:46.659892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:46.661942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:46.852099 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3411/6856] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:46 2022] POST /identity/v3/projects => generated 363 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:46.856386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:46.874184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80dd83-7472-4710-84a3-d63caaa49a3b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:47.033311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:47.034264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.034640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.035232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.035973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:47.038767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:47.083049 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3446/6857] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:46 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:47.086629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:47.104671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3437-19e5-45a8-994d-691499f133c3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:47.110983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:47.111611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.111937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.112256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.113042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:47.117394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:47.133578 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3412/6858] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:22:47.137571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:47.162118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26038f-9724-416c-9f90-512a596a5048 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:47.179225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:47.179858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.180522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.180946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.181588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:47.183456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a339b-a26d-43be-8e75-f0f86a7968b8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:47.202094 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3447/6859] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:47.203372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:47.217520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581999e-4fb2-45d3-b0b7-0b2b8ab11efe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:47.235700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:47.236677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.240985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.241962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] PATH_INFO: `/v3/projects/ed447088ff0642b8a4e99b86e66f0327/users/298ea45a6338408a8086ce9a026735b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.276617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed447088ff0642b8a4e99b86e66f0327, user_id=298ea45a6338408a8086ce9a026735b5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:47.283918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:47.375214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3413/6860] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:47 2022] PUT /identity/v3/projects/ed447088ff0642b8a4e99b86e66f0327/users/298ea45a6338408a8086ce9a026735b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:47.387351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.387883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.388347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.466468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] MFA Rules not processed for user `298ea45a6338408a8086ce9a026735b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:47.471873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:47.580255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:47.633155 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3448/6861] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:47.635131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:47.873112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d4b0-bc6b-49b2-8fe3-0dfe08be7b18 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:47.905746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:47.908699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:47.915159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:47.916539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:47.919655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:47.924856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:47.940386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:48.029816 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3414/6862] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:48.034003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:48.053741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8d285-e7b3-4c5b-9e47-95b462ca0684 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:48.197692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:48.198369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.198641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.199093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.199879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:48.202023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:48.245600 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3449/6863] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:22:48 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:22:48.246986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:48.262713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54356-c87f-4d03-8c9c-8f42f6872767 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:48.277297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:48.278193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.278471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.278827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.279629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:48.281284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:48.340614 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3415/6864] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:48.344415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:48.363127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e9d7d-b9aa-4c14-aea9-280a7aec0557 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:48.378987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:48.380479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.381078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.381597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] PATH_INFO: `/v3/projects/b9fa37a4febb478d99843b1f3838abb9/users/99c516059178457cb667b4cfa2124470/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.445955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fa37a4febb478d99843b1f3838abb9, user_id=99c516059178457cb667b4cfa2124470, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:48.451556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:48.496820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:48.501760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3450/6865] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:48 2022] PUT /identity/v3/projects/b9fa37a4febb478d99843b1f3838abb9/users/99c516059178457cb667b4cfa2124470/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:48.512533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea317-ce82-48bd-a882-1419f194838a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:48.683930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:48.684854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.685345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.685900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.687669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:48.694129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9df306-3786-422d-a0cc-35ab3c62d9a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:48.732064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3416/6866] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:22:48.733398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:48.767110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42acac8-e4d3-4198-b569-e17419571a20 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:48.779574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:48.783947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.784580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.787701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] PATH_INFO: `/v3/projects/b9fa37a4febb478d99843b1f3838abb9/users/99c516059178457cb667b4cfa2124470/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.795032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fa37a4febb478d99843b1f3838abb9, user_id=99c516059178457cb667b4cfa2124470, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:48.805832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:48.865152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:48.865482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:48.865694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:48.867565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3451/6867] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:22:48 2022] PUT /identity/v3/projects/b9fa37a4febb478d99843b1f3838abb9/users/99c516059178457cb667b4cfa2124470/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:48.929050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] MFA Rules not processed for user `99c516059178457cb667b4cfa2124470`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:48.930546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:49.235252 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3417/6868] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:49.253804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:49.265536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:49.458688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd445d-d7b2-4c7f-b616-ee7e09f9df59 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:49.469539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:49.471230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:49.471882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:49.472127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:49.496740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:49.498340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:49.545100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3452/6869] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:50.185394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:50.185394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:50.388747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da67d0-2502-48d9-9b5e-9cc9a4da2a93 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:50.409410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:50.410441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:50.410882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:50.411990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:50.421965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:50.462333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:50.599293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:50.601687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:50.637774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3418/6870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:51.518556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:51.520309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:51.674400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:51.842221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d804-08b3-4607-912f-521d9dbcea64 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:51.857878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:51.864262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:51.864898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:51.865706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:51.873174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:51.946684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:51.950934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:52.018680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3453/6871] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:52.179518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:52.181003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:52.202955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4030-cf84-4527-af25-a5cb347307aa service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:52.220423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:52.221035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:52.221756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:52.221756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:52.227048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:52.373706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:52.375583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:52.400474 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3419/6872] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:55.667506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:55.669441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:55.702812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cdd34-1575-4fdd-a752-155cb584713c service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:55.716424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:55.720538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:55.722236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:55.722700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:55.834653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:55.836391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34328def-50ad-44d8-84df-11df6ed036c9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:55.852642 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3454/6873] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:58.116190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:58.231704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b5f-ac45-4c4c-a2ea-0d3e11ae6b88 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:58.238429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:58.239908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:58.240298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:58.240826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] PATH_INFO: `/v3/users/298ea45a6338408a8086ce9a026735b5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:58.242184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=298ea45a6338408a8086ce9a026735b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:58.244607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:58.376831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298ea45a6338408a8086ce9a026735b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:58.380889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298ea45a6338408a8086ce9a026735b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:58.382060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298ea45a6338408a8086ce9a026735b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:58.384437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:58.401675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298ea45a6338408a8086ce9a026735b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:58.430317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-597cb145-b9db-4136-9a62-4f18f072b9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298ea45a6338408a8086ce9a026735b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:22:58.481981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3420/6874] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:22:58 2022] DELETE /identity/v3/users/298ea45a6338408a8086ce9a026735b5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:22:58.487361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:58.487909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:58.488016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:58.545814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:58.547286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:58.775220 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3455/6875] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:58.877432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:58.877654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:58.877916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:58.911981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:58.913514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:59.026944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:59.031294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:59.138847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed0d0a-cc7b-45eb-93e5-30bf4ca9ca1a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:59.158257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:59.158902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:59.159178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:59.159444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:59.184881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:59.188761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:59.196024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:59.230582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3456/6876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:22:59.284711 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3421/6877] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:59.375636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:59.377121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:59.528161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfadbb-7620-4f96-ba44-5dfd6cc93314 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:59.548560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:59.551442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:59.551753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:59.552030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:59.580662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:59.585883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:59.623168 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3457/6878] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:22:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:00.777025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:00.781235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:00.823166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68099aa8-5c80-4d3e-af62-5c97bfbdad23 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:00.845513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:00.846788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:00.849094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:00.850586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] PATH_INFO: `/v3/projects/ed447088ff0642b8a4e99b86e66f0327` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:00.853550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed447088ff0642b8a4e99b86e66f0327)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:00.856477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:01.026854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed447088ff0642b8a4e99b86e66f0327', 'request_id': 'req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.046848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed447088ff0642b8a4e99b86e66f0327', 'request_id': 'req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.066502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed447088ff0642b8a4e99b86e66f0327', 'request_id': 'req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.096196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] The token cache is being invalidate because project ed447088ff0642b8a4e99b86e66f0327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:01.098923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.099871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.104333 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3422/6879] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:00 2022] DELETE /identity/v3/projects/ed447088ff0642b8a4e99b86e66f0327 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:01.108226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:01.135300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e457a3-32f7-42a4-8ede-a698aa49db03 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:01.304881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:01.307650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:01.308102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:01.308547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] PATH_INFO: `/v3/users/99c516059178457cb667b4cfa2124470` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:01.315152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c516059178457cb667b4cfa2124470)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:01.325408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:01.493617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c516059178457cb667b4cfa2124470'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.495332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c516059178457cb667b4cfa2124470'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.517086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c516059178457cb667b4cfa2124470'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.539069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c516059178457cb667b4cfa2124470'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.540093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12740f3d-2ef1-4078-b7d5-40c85d2e5860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c516059178457cb667b4cfa2124470'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:01.606432 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3458/6880] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:01 2022] DELETE /identity/v3/users/99c516059178457cb667b4cfa2124470 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:03.414272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:03.416512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:03.451934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce3df0-c43a-4c25-b8cb-ac9d22a55d1d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:03.570385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:03.604142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:03.608704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:03.609316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:03.609813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] PATH_INFO: `/v3/projects/b9fa37a4febb478d99843b1f3838abb9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:03.611356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fa37a4febb478d99843b1f3838abb9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:03.615794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:03.763242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fa37a4febb478d99843b1f3838abb9', 'request_id': 'req-216e1702-6056-4dca-af58-9e92b50c1207'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:03.790977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fa37a4febb478d99843b1f3838abb9', 'request_id': 'req-216e1702-6056-4dca-af58-9e92b50c1207'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:03.809956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fa37a4febb478d99843b1f3838abb9', 'request_id': 'req-216e1702-6056-4dca-af58-9e92b50c1207'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:03.827744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] The token cache is being invalidate because project b9fa37a4febb478d99843b1f3838abb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:03.832421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:03.834036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-216e1702-6056-4dca-af58-9e92b50c1207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:03.835728 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3423/6881] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:03 2022] DELETE /identity/v3/projects/b9fa37a4febb478d99843b1f3838abb9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:03.840714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:03.841295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:03.841531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:03.859257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:03.881943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:03.883369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:03.975840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3459/6882] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:23:03.983512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:03.983942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:03.984318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.038423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:04.047526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:04.103987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.105267 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3424/6883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:04.115276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5974-4ee0-490c-a014-df8a9eaf818a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.135190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.135861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.136149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.136425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.143414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:04.143786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:04.149004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:04.204104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.204307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3460/6884] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:23:04.218760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ad28-bbd3-4f1c-b859-c20d9b559472 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.245578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.246273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.246560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.246835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.247484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:04.256185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:04.399222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3425/6885] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:04 2022] POST /identity/v3/projects => generated 395 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:04.403385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.420155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f32b-b227-4d19-8114-9ea4b4a9ea84 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.746078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.747021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.747977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.748431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.749313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:04.752196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:04.822646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3461/6886] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:04 2022] POST /identity/v3/users => generated 298 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:04.825929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.851206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e2d5-73e3-423f-b202-04bdce19beef admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.874828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.877632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.878316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.878883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.880956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:04.883253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:04.897089 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3426/6887] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:04.900810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.915676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3cc9-9756-4e3a-8ac6-41c631a131c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.922200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.923166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.923655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.924106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.924954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:04.927648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb05e4-356a-4a14-8c0b-3decd54817a7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:04.945307 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3462/6888] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:23:04.949195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:04.964225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92eb68-d5f9-4006-8a29-7c42ce05ceba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:04.971854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:04.975791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:04.976150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:04.976435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] PATH_INFO: `/v3/projects/658b89f3a0c040c5964954539c2a6a5c/users/6803adf953ab493eb530c22957c1c8c6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:04.997974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] RBAC: Authorizing `identity:create_grant(project_id=658b89f3a0c040c5964954539c2a6a5c, user_id=6803adf953ab493eb530c22957c1c8c6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:05.001977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:05.030024 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3427/6889] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:04 2022] PUT /identity/v3/projects/658b89f3a0c040c5964954539c2a6a5c/users/6803adf953ab493eb530c22957c1c8c6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:05.042702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:05.043221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:05.043778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:05.147736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] MFA Rules not processed for user `6803adf953ab493eb530c22957c1c8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:05.153170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:05.339011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:05.353077 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3463/6890] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:05.407985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:05.413517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:05.549732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95baa2d-e381-48ec-8c1b-a04aa508831e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:05.561642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:05.562281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:05.562565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:05.562839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:05.590377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:05.591844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7ca8-b306-4f3e-9f08-469f712ab923 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:05.621291 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3428/6891] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:05 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:10.066205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:10.068632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:10.293725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1b6f-bf5d-4a09-b852-3a7128aca563 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:10.311551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:10.313733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:10.314040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:10.314302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:10.317373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:10.352322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:10.354616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:10.387659 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3464/6892] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:15.607311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:20.365933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=32 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:38.503739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:38.505016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:38.505306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:38.571979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] MFA Rules not processed for user `608b9dc1a00d489a94524f99820022f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:38.575985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:38.727689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3429/6893] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:39.237128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:39.239229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:39.435772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec016a-6b5e-4c4f-b9f5-d3bd3cc45a4d service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:39.446865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:39.447902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:39.448184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:39.448459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] PATH_INFO: `/v3/users/f5e430f9ec8349e9bf20b6a20deb2814` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:39.454073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e430f9ec8349e9bf20b6a20deb2814)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:39.456059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:39.473867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:39.519324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2bcb0-d747-4491-8733-d1ce08bd834f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:39.524382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:39.525356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:39.527666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:39.528243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:39.530360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:39.544726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:39.546784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4723c2-f334-4778-9e96-8ae345eeb8b5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:39.560882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e430f9ec8349e9bf20b6a20deb2814'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:39.561943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3430/6894] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:39.563407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e430f9ec8349e9bf20b6a20deb2814'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:39.591826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e430f9ec8349e9bf20b6a20deb2814'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:39.618868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e430f9ec8349e9bf20b6a20deb2814'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:39.619866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e430f9ec8349e9bf20b6a20deb2814'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:39.668464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3465/6895] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:39 2022] DELETE /identity/v3/users/f5e430f9ec8349e9bf20b6a20deb2814 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:39.672830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:39.673457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:39.673958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:39.718215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:39.719870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:39.868664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3431/6896] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:39.887483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:39.889295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:40.073543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c58c2-ebaa-43f3-9b4d-f05e4e6cc81b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:40.090100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:40.098917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:40.099168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:40.099446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:40.167909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:40.175359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:40.221978 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3466/6897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:40.985084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:40.987174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:41.014771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9a77-3fb2-46d5-983e-b46c73086d1e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:41.033227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:41.033900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:41.034179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:41.037334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] PATH_INFO: `/v3/projects/3de647ee948740aab435cadcd76de570` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:41.041727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de647ee948740aab435cadcd76de570)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:41.049047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:41.188193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de647ee948740aab435cadcd76de570', 'request_id': 'req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.202528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de647ee948740aab435cadcd76de570', 'request_id': 'req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.214397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de647ee948740aab435cadcd76de570', 'request_id': 'req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.231709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] The token cache is being invalidate because project 3de647ee948740aab435cadcd76de570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:41.232009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.232697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.234549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3432/6898] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:40 2022] DELETE /identity/v3/projects/3de647ee948740aab435cadcd76de570 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:41.239442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:41.254640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4714e2-543e-4e77-a734-5a0e91b46c26 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:41.286020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:41.402314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:41.403167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:41.404269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:41.404556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] PATH_INFO: `/v3/users/f9ff830c3972467ba0ab4c7e8cafec33` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:41.406914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ff830c3972467ba0ab4c7e8cafec33)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:41.409850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:41.481354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ff830c3972467ba0ab4c7e8cafec33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.482280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ff830c3972467ba0ab4c7e8cafec33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.531516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ff830c3972467ba0ab4c7e8cafec33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.576939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ff830c3972467ba0ab4c7e8cafec33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.579467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da4534c3-79f6-4b3b-af10-2bf7b0d935b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ff830c3972467ba0ab4c7e8cafec33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:41.640106 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3467/6899] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:41 2022] DELETE /identity/v3/users/f9ff830c3972467ba0ab4c7e8cafec33 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:43.259521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:43.261215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:43.305869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2242e8-6ffa-4f56-8b8b-f4f11aa2ddd2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:43.317650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:43.463213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:43.464210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:43.465198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:43.465722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] PATH_INFO: `/v3/projects/56fb477b414d4c6b9f79042fb920de97` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:43.468338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fb477b414d4c6b9f79042fb920de97)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:43.475267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:43.635367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fb477b414d4c6b9f79042fb920de97', 'request_id': 'req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:43.674001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fb477b414d4c6b9f79042fb920de97', 'request_id': 'req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:43.705145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fb477b414d4c6b9f79042fb920de97', 'request_id': 'req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:43.745776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] The token cache is being invalidate because project 56fb477b414d4c6b9f79042fb920de97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:43.745776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:43.750987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63f988cc-a7b7-4f40-8ba8-b0950665e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:43.753438 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3433/6900] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:43 2022] DELETE /identity/v3/projects/56fb477b414d4c6b9f79042fb920de97 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:43.758795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:43.759340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:43.759340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:43.808286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:43.809562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:44.005647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.006308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.006836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.010660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3468/6901] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:44.041374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:44.055909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:44.089388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.096581 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3434/6902] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:44.103256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb88d2-5f1a-49be-a4d5-1d52eda75a29 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.119236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.120263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.125195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.125725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.129945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:44.130524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.132430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.178293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3469/6903] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:23:44.179542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.197647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505521-dbab-4093-8cb1-6bf54c641322 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.211466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.212453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.213026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.213593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.215196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.218522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.291848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.292154 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3435/6904] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:44 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:44.312080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4996da-cb57-497b-8367-f01d4a9bbf65 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.363500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:44.490644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.491554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.491940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.492316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.495797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.498154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.574605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3470/6905] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:44 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:44.576383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.607887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311bfa1-832a-4704-91b8-07cfa50e3cd4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.622764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.623742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.624191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.624632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.625573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.628685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.653999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3436/6906] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:44.657754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.725146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7eac-0cfb-4d47-b80f-ae3a749efd44 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.755788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.756607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.757019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.757387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.758248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.759989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2438-098c-4651-9e20-9768f65f6ccf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.811963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3471/6907] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:44.817061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:44.853892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94442f-2fb1-4d2c-b385-c366dbc40eb2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:44.866032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:44.866726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.867009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.867286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] PATH_INFO: `/v3/projects/faeab86a7dbe4897a950ecb2b1acfdc3/users/a3e12a16f5364989adcc1861e0c0d09e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:44.919107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeab86a7dbe4897a950ecb2b1acfdc3, user_id=a3e12a16f5364989adcc1861e0c0d09e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:44.940094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:44.984186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3437/6908] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:44 2022] PUT /identity/v3/projects/faeab86a7dbe4897a950ecb2b1acfdc3/users/a3e12a16f5364989adcc1861e0c0d09e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:44.994071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:44.994356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:44.994629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:45.073978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] MFA Rules not processed for user `a3e12a16f5364989adcc1861e0c0d09e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:45.075132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:45.207827 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3472/6909] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:45.212704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:45.335774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:45.391876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7120-2ea3-424e-8289-7d119ec2501d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:45.407837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:45.408464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:45.408741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:45.409038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:45.409677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:45.412166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:45.466515 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3438/6910] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:45 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:45.470656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:45.491401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e05283-9872-4be7-af94-36c591dfb291 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:45.606544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:45.607446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:45.607913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:45.608343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:45.609208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:45.612587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:45.641968 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3473/6911] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:45 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:45.646235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:45.662754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed55ff-80f0-4fa6-ad0a-ece2cb7d7d62 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:45.676388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:45.677412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:45.677851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:45.678306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:45.679234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:45.683421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:45.713673 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3439/6912] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:45.718097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:45.734783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2483ad0-8ee1-4ab7-bd82-38a8f47b0323 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:45.762659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:45.765689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:45.765975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:45.771168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] PATH_INFO: `/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c/users/6f9867ccabc4482c91d1b6daad542f99/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:45.850139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0dbec6b3314388b2bf36e1f4f9638c, user_id=6f9867ccabc4482c91d1b6daad542f99, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:45.862431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:45.867614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:45.900316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3474/6913] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:45 2022] PUT /identity/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c/users/6f9867ccabc4482c91d1b6daad542f99/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:45.914123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:45.931128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b18b4-e7cf-4b74-b71a-4b475a832ee5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:46.101087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:46.104010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:46.104290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:46.106377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:46.107955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:46.112023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867953d-c4b0-4615-b4b1-9a45db867a3f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:46.139625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3440/6914] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:46.142430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:46.157889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0c49-eed2-4eae-83b8-6e666c3695fb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:46.183192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:46.184705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:46.185176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:46.185628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] PATH_INFO: `/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c/users/6f9867ccabc4482c91d1b6daad542f99/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:46.191034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0dbec6b3314388b2bf36e1f4f9638c, user_id=6f9867ccabc4482c91d1b6daad542f99, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:46.194167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:46.232653 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3475/6915] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:46 2022] PUT /identity/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c/users/6f9867ccabc4482c91d1b6daad542f99/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:46.243863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:46.244151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:46.244559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:46.329356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] MFA Rules not processed for user `6f9867ccabc4482c91d1b6daad542f99`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:46.330763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:46.565791 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3441/6916] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:46.580367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:46.583079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:46.701659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371aeaa-7de3-4d81-b01f-964ef4a0d054 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:46.709400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:46.710917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:46.711546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:46.712016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:46.750355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:46.752196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:46.807892 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3476/6917] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:47.222985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:47.301996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:47.384367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:47.385531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:47.417756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d54e3-877c-4931-a865-0deac893c44d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:47.444595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:47.445425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:47.445641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:47.445926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] PATH_INFO: `/v3/users/a3e12a16f5364989adcc1861e0c0d09e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:47.449742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e12a16f5364989adcc1861e0c0d09e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:47.453919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:47.613123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e12a16f5364989adcc1861e0c0d09e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:47.613864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e12a16f5364989adcc1861e0c0d09e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:47.614743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e12a16f5364989adcc1861e0c0d09e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:47.637695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e12a16f5364989adcc1861e0c0d09e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:47.678299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8330-eb70-4288-91f8-cc9cb5f5ab3b service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:47.682925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2333937d-fcc9-4846-aa8e-6147fc97d0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e12a16f5364989adcc1861e0c0d09e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:47.715081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:47.717571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:47.720065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:47.722416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:47.728173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:47.761556 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3442/6918] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:47 2022] DELETE /identity/v3/users/a3e12a16f5364989adcc1861e0c0d09e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:47.762867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:47.764745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:47.766449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:47.766740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:47.767306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:47.791992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3477/6919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:47.825808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:47.828623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:48.006549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3443/6920] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:48.054882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:48.058055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:48.250430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ac76d-3f60-445b-b60a-1807f633555e service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:48.291251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:48.481279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:48.490266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:48.490597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:48.490828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:48.547436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:48.552684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e89de-be10-49fc-930b-4816a27b283f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:48.598430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3478/6921] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:49.186526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:49.189137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:49.217035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc1246-bb8d-4028-a06c-b1e0e9f41cc8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:49.252067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:49.253045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:49.253580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:49.254674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] PATH_INFO: `/v3/users/6803adf953ab493eb530c22957c1c8c6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:49.266209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6803adf953ab493eb530c22957c1c8c6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:49.268689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:49.366510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:49.376116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6803adf953ab493eb530c22957c1c8c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:49.379315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6803adf953ab493eb530c22957c1c8c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:49.380243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6803adf953ab493eb530c22957c1c8c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:49.396673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6803adf953ab493eb530c22957c1c8c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:49.414904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6803adf953ab493eb530c22957c1c8c6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:49.435302 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3444/6922] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:49 2022] DELETE /identity/v3/users/6803adf953ab493eb530c22957c1c8c6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:49.440013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:49.441192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:49.441754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:49.480491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:49.487524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:49.608708 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3479/6923] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:49.619221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:49.620880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:49.791707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf4bb-51e7-4b62-ab46-f7c1f203be58 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:49.803425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:49.804408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:49.817573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:49.817573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:49.844032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:49.848183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f4111-d886-43bd-980a-c82c3e2c0176 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:49.871799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3445/6924] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:50.214653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:50.216275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:50.230852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8b484-ae60-4f79-a0c1-a11e49c9d321 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:50.236824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:50.238955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:50.239521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:50.240041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] PATH_INFO: `/v3/projects/658b89f3a0c040c5964954539c2a6a5c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:50.241507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=658b89f3a0c040c5964954539c2a6a5c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:50.244199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:50.342414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658b89f3a0c040c5964954539c2a6a5c', 'request_id': 'req-7c99042c-e8c2-49b7-806c-bac9073032fd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:50.351021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658b89f3a0c040c5964954539c2a6a5c', 'request_id': 'req-7c99042c-e8c2-49b7-806c-bac9073032fd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:50.378025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658b89f3a0c040c5964954539c2a6a5c', 'request_id': 'req-7c99042c-e8c2-49b7-806c-bac9073032fd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:50.395057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] The token cache is being invalidate because project 658b89f3a0c040c5964954539c2a6a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:50.395793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:50.396782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7c99042c-e8c2-49b7-806c-bac9073032fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:50.398657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3480/6925] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:50 2022] DELETE /identity/v3/projects/658b89f3a0c040c5964954539c2a6a5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:50.404060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:50.405246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:50.405823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:50.438381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:50.440047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:50.564937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3446/6926] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:50.572660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:50.573176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:50.573561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:50.625179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:50.627763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:50.652956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3481/6927] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:50.656868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:50.674165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853088-40b0-4028-9ed1-cc1f3133903c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:50.684307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:50.685071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:50.685449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:50.685822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:50.688872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:50.688872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:50.693488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:50.730100 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3447/6928] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:23:50.735739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:50.756658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adba16-c3b2-4215-8f17-3e7900d29d98 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:50.780540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:50.781467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:50.783186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:50.783652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:50.784467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:50.789004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:50.881436 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3482/6929] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:50 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:23:50.885767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:50.900888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298706-8003-4ca0-acd2-28f41b4d8787 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.028230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:51.050383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.051832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.052206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.052568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.053329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.055371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.060744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.062949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:51.110960 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3448/6930] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:50 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:51.112969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.130336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ca9b2-1a25-4770-947a-b0f5c0a71816 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.156272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888794-338b-4d40-8f7d-3546ffa964c4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.160627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.161954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.163467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.163938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] PATH_INFO: `/v3/projects/faeab86a7dbe4897a950ecb2b1acfdc3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.167561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeab86a7dbe4897a950ecb2b1acfdc3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.169207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.171741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.172362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.172886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.173330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.177002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.178495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:51.185265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.224190 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3449/6931] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:51.228136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.261832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb051-b66a-4b57-a7f3-e60ab6d277c8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.265860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeab86a7dbe4897a950ecb2b1acfdc3', 'request_id': 'req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.274111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeab86a7dbe4897a950ecb2b1acfdc3', 'request_id': 'req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.288713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeab86a7dbe4897a950ecb2b1acfdc3', 'request_id': 'req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.314962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] The token cache is being invalidate because project faeab86a7dbe4897a950ecb2b1acfdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:51.315216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.316545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.323121 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3483/6932] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:51 2022] DELETE /identity/v3/projects/faeab86a7dbe4897a950ecb2b1acfdc3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:51.324303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.325847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:51.385473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.386572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.387077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.387582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.388750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.390845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.409033 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3450/6933] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:51.411388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.414615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:51.446988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084ced-2806-404c-877a-95a7ca087616 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.472168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.474509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.476568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.477133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] PATH_INFO: `/v3/projects/29f811fd0e7f414493d04397200a7e4b/users/867a104361a04d7483c02cb109ebad84/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.538776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf423b-dcb5-4be7-8a48-8f9083c1ca5f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:51.546529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f811fd0e7f414493d04397200a7e4b, user_id=867a104361a04d7483c02cb109ebad84, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.558488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51fdd0-2068-4126-9502-a01382112618 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.567269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:51.568218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.568601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.569738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] PATH_INFO: `/v3/users/6f9867ccabc4482c91d1b6daad542f99` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.573648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9867ccabc4482c91d1b6daad542f99)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:51.591658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:51.618916 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3451/6934] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:51 2022] PUT /identity/v3/projects/29f811fd0e7f414493d04397200a7e4b/users/867a104361a04d7483c02cb109ebad84/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:51.621899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:51.627277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:51.629878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:51.727094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] MFA Rules not processed for user `867a104361a04d7483c02cb109ebad84`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:51.728438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:51.747404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9867ccabc4482c91d1b6daad542f99'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.749312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9867ccabc4482c91d1b6daad542f99'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.772238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9867ccabc4482c91d1b6daad542f99'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.786816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9867ccabc4482c91d1b6daad542f99'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.788637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9867ccabc4482c91d1b6daad542f99'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:51.839218 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3484/6935] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:51 2022] DELETE /identity/v3/users/6f9867ccabc4482c91d1b6daad542f99 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:51.877431 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3452/6936] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:51.897650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:51.899180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:51.933641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:52.060226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d8d0e-c0d8-4871-b236-d9399932001d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:52.068632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:52.072860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:52.073214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:52.073498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:52.209961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:52.216015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542c20-d18a-4401-b71b-bccd6c76e588 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:52.238960 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3485/6937] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:52.329714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:52.331336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:52.406572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:52.449810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989464b-c20d-4ec1-873c-4967ac78ee97 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:52.528892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:52.529711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:52.530052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:52.531022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] PATH_INFO: `/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:52.532371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0dbec6b3314388b2bf36e1f4f9638c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:52.534901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:52.627047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0dbec6b3314388b2bf36e1f4f9638c', 'request_id': 'req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:52.642535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0dbec6b3314388b2bf36e1f4f9638c', 'request_id': 'req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:52.672711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0dbec6b3314388b2bf36e1f4f9638c', 'request_id': 'req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:52.702215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] The token cache is being invalidate because project 0a0dbec6b3314388b2bf36e1f4f9638c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:52.702512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:52.703958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74d3e5aa-487b-4ee8-aba0-34bca75f3ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:52.714382 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3453/6938] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:52 2022] DELETE /identity/v3/projects/0a0dbec6b3314388b2bf36e1f4f9638c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:52.720615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:52.722109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:52.722589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:52.751946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:52.756993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:52.842377 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3486/6939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:52.850654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:52.850964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:52.851272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:52.893476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:52.895260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:52.914729 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3454/6940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:52.918907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:52.936399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc87d9c-ef4b-46c1-bd39-cf596ff67f00 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:52.956102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:52.956739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:52.957602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:52.957879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:52.958797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:52.959107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:52.960715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:52.987758 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3487/6941] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:23:52.989545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.000704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe168a-a27b-4b89-bc71-18566eae492a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:53.023773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:53.024613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.025129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.025553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.026368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:53.029444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:53.103672 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3455/6942] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:52 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:53.108354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.126709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c57b-9c26-4e7c-9879-e75d33c99c54 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:53.261139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:53.277825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:53.278453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.278732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.279006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.279646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:53.281756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:53.334481 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3488/6943] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:53 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:53.338463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.359599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c9dce-ccca-4c20-a839-2ebd7eb8eb13 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:53.380490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:53.381398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.381836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.382263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.383068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:53.384831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:53.428801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3456/6944] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:53.432616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.449083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831fa82-acb2-4702-b209-d56e348ce894 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:53.465626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:53.466255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.466535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.466807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.467456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:53.469216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffece8a-7a53-4481-bfb6-3b7dc5702e2c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:53.491805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3489/6945] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:53.495729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.512842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cead1-fb95-49f8-bef7-4e043cddc43e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:53.527444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:53.528129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.528411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.528683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] PATH_INFO: `/v3/projects/fc19bd85390e497da21f65d7490ba178/users/1037aa1b415a4cfd9cca94f56d5bd894/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.560281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc19bd85390e497da21f65d7490ba178, user_id=1037aa1b415a4cfd9cca94f56d5bd894, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:53.571177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:53.607897 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3457/6946] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:53 2022] PUT /identity/v3/projects/fc19bd85390e497da21f65d7490ba178/users/1037aa1b415a4cfd9cca94f56d5bd894/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:53.619074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:53.619455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:53.619724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:53.691099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] MFA Rules not processed for user `1037aa1b415a4cfd9cca94f56d5bd894`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:53.692393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:53.889698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:53.891715 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3490/6947] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:53.903512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:54.059578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ed176-45d4-4d52-b881-168f09902c07 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:54.074267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:54.076214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:54.076495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:54.076771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:54.088965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:54.099767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:54.222217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:54.234981 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3458/6948] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:53 2022] POST /identity/v3/projects => generated 379 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:23:54.239327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260b9f6-fd84-4aff-9f49-5a2ba06d23a0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:54.447640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:54.450132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:54.450132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:54.452496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:54.453206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:54.464571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:54.525963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:54.526584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3491/6949] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:23:54 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:54.562457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998a9e-6fcd-4064-9ac5-c2db66c538e4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:54.576683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:54.579276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:54.579556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:54.581139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:54.581746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:54.583448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:54.629895 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3459/6950] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:54.633886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:54.652188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77648515-626f-4e06-a7d2-d32fa6452d19 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:54.668566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:54.672386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:54.672691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:54.675418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] PATH_INFO: `/v3/projects/81a13d8f978144e68f3e135ab9f2994f/users/f0dfd0dbad4f424684e7b7ce0007f0bc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:54.741063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a13d8f978144e68f3e135ab9f2994f, user_id=f0dfd0dbad4f424684e7b7ce0007f0bc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:54.750676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:54.788040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3492/6951] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:54 2022] PUT /identity/v3/projects/81a13d8f978144e68f3e135ab9f2994f/users/f0dfd0dbad4f424684e7b7ce0007f0bc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:54.789241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:54.815735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65981-11f0-48b7-aafe-fa671929117b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:55.021733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:55.022367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:55.022987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:55.023281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:55.023929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:55.025587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67272aa-48a9-46ea-a28c-99b88ccd06f8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:55.051795 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3460/6952] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:23:55.055274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:55.066895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691560b0-ad28-4197-8d25-bbc87c65445c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:55.096670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:55.098127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:55.098587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:55.099014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] PATH_INFO: `/v3/projects/81a13d8f978144e68f3e135ab9f2994f/users/f0dfd0dbad4f424684e7b7ce0007f0bc/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:55.106499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a13d8f978144e68f3e135ab9f2994f, user_id=f0dfd0dbad4f424684e7b7ce0007f0bc, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:55.109516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:55.164253 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3493/6953] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:23:55 2022] PUT /identity/v3/projects/81a13d8f978144e68f3e135ab9f2994f/users/f0dfd0dbad4f424684e7b7ce0007f0bc/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:23:55.176862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:55.177249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:55.177453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:55.235982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] MFA Rules not processed for user `f0dfd0dbad4f424684e7b7ce0007f0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:55.237418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:55.413676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:55.456580 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3461/6954] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:55.464613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:55.466460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:55.507208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:55.602044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6a9f-374a-418e-b7b1-958e46650364 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:55.612452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:55.613383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:55.614029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:55.614614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:55.643906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:55.646511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:55.676686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3494/6955] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:56.412124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:56.423566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe2e1-61a6-41fc-ac04-c41d515b9b0a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:56.440638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfd0dbad4f424684e7b7ce0007f0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81a13d8f978144e68f3e135ab9f2994f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:56.441624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:56.441914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:56.442195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:56.442865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:56.443174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:56.451972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:56.500021 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3462/6956] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:23:56.503407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:56.517882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd9e8-14b8-4951-895f-49c3f19207ff service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:56.533839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfd0dbad4f424684e7b7ce0007f0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81a13d8f978144e68f3e135ab9f2994f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:56.534031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:56.538306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:56.538306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:56.538306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:56.545303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:56.635964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3495/6957] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:23:56 2022] POST /identity/v3/projects => generated 353 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:23:56.637075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:56.679702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d73ba-6066-494f-a398-92e9316397b5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:56.823391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfd0dbad4f424684e7b7ce0007f0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81a13d8f978144e68f3e135ab9f2994f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:56.824795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:56.838658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:56.839058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:56.839855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:23:56.841987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:56.847838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:56.876013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3463/6958] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:23:57.038126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:57.055258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6283272-6204-4831-ad41-ea6768015564 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:57.094738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dfd0dbad4f424684e7b7ce0007f0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81a13d8f978144e68f3e135ab9f2994f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:57.097234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:57.100724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:57.102484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] PATH_INFO: `/v3/projects/095917d705be4abd97830fa4eca92b88` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:57.107308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorizing `identity:delete_project(project_id=095917d705be4abd97830fa4eca92b88)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:57.134849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:57.291813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095917d705be4abd97830fa4eca92b88', 'request_id': 'req-98aec0cc-af81-4420-8019-ec10188e8ca5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:57.318162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095917d705be4abd97830fa4eca92b88', 'request_id': 'req-98aec0cc-af81-4420-8019-ec10188e8ca5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:57.330726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095917d705be4abd97830fa4eca92b88', 'request_id': 'req-98aec0cc-af81-4420-8019-ec10188e8ca5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:57.344613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] The token cache is being invalidate because project 095917d705be4abd97830fa4eca92b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:57.345105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:57.345840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-98aec0cc-af81-4420-8019-ec10188e8ca5 tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:57.347503 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3496/6959] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:57 2022] DELETE /identity/v3/projects/095917d705be4abd97830fa4eca92b88 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:57.787203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:57.790519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:57.975467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92073-25f0-4ab6-abe7-65d1e14e2e0b tempest-VolumeQuotaClassesTest-167565774 tempest-VolumeQuotaClassesTest-167565774-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:58.041511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:58.042747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:58.043194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:58.043632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] PATH_INFO: `/v3/users/1037aa1b415a4cfd9cca94f56d5bd894` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:58.045702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1037aa1b415a4cfd9cca94f56d5bd894)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:58.052602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:58.118138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:58.162968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1037aa1b415a4cfd9cca94f56d5bd894'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:58.165504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1037aa1b415a4cfd9cca94f56d5bd894'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:58.168290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1037aa1b415a4cfd9cca94f56d5bd894'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:58.187814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1037aa1b415a4cfd9cca94f56d5bd894'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:58.209111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1037aa1b415a4cfd9cca94f56d5bd894'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:58.239466 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3464/6960] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:57 2022] DELETE /identity/v3/users/1037aa1b415a4cfd9cca94f56d5bd894 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:58.243898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:58.244396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:58.244752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:58.290100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:58.291755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:58.413719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3497/6961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:58.428671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:58.433775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:58.586849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f452-7322-4c4a-8b63-a345e430f0c4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:58.596117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:58.598172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:58.598998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:58.599313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:58.675674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:58.679660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:58.729746 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3465/6962] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:59.135564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:59.138491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:59.176241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81327c-56fd-42ff-9128-5e21675b10c8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:59.190898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:59.192107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:59.192580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:59.193043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] PATH_INFO: `/v3/projects/fc19bd85390e497da21f65d7490ba178` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:59.194416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc19bd85390e497da21f65d7490ba178)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:59.196540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:59.230764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:59.309666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc19bd85390e497da21f65d7490ba178', 'request_id': 'req-20767fde-5815-4995-93b6-fbedf4333cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.325937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc19bd85390e497da21f65d7490ba178', 'request_id': 'req-20767fde-5815-4995-93b6-fbedf4333cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.341861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc19bd85390e497da21f65d7490ba178', 'request_id': 'req-20767fde-5815-4995-93b6-fbedf4333cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.363531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] The token cache is being invalidate because project fc19bd85390e497da21f65d7490ba178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:23:59.364018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.365462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.372193 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3498/6963] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:23:59 2022] DELETE /identity/v3/projects/fc19bd85390e497da21f65d7490ba178 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:59.376095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:59.388843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4f029-f79a-4f77-a401-bc311192a688 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:59.513352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:59.514459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:59.515047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:59.515486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] PATH_INFO: `/v3/users/f0dfd0dbad4f424684e7b7ce0007f0bc` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:59.517772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0dfd0dbad4f424684e7b7ce0007f0bc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:59.519982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:59.624412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0dfd0dbad4f424684e7b7ce0007f0bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.626567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0dfd0dbad4f424684e7b7ce0007f0bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.628778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0dfd0dbad4f424684e7b7ce0007f0bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.638529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:59.644573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0dfd0dbad4f424684e7b7ce0007f0bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.660660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cbc83a2-3cc4-472f-8468-a2e8dbd91697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0dfd0dbad4f424684e7b7ce0007f0bc'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:23:59.696416 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3466/6964] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:59 2022] DELETE /identity/v3/users/f0dfd0dbad4f424684e7b7ce0007f0bc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:23:59.968722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:59.970264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:59.998607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767fde-5815-4995-93b6-fbedf4333cd0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:00.080704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:00.082409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:00.082854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:00.083594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] PATH_INFO: `/v3/users/b025fa9b873848c48887369e733d4672` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:00.101549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b025fa9b873848c48887369e733d4672)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:00.108864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:00.193836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b025fa9b873848c48887369e733d4672'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:00.194849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b025fa9b873848c48887369e733d4672'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:00.206485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b025fa9b873848c48887369e733d4672'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:00.218453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b025fa9b873848c48887369e733d4672'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:00.219344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b025fa9b873848c48887369e733d4672'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:00.242304 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3499/6965] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:23:59 2022] DELETE /identity/v3/users/b025fa9b873848c48887369e733d4672 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:00.246490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:00.246919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:00.247306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:00.274665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:00.277438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:00.361449 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3467/6966] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:00.380614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:00.382100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:00.411655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:00.475551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d8b5-aed3-4896-914a-cfd11803b561 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:00.479882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:00.480509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:00.480788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:00.481138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:00.512877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:00.514597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:00.545388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3500/6967] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:01.043459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.045145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.065452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a251b-4792-4bc5-8b03-765111526a5d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.082429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.082429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.082429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.082429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] PATH_INFO: `/v3/projects/8a6eff18260e48029200f4005c1d7c80` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.083755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.083907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6eff18260e48029200f4005c1d7c80)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.085195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.086039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.106971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052498-ed2a-4bf9-9af4-a3832eca4814 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.123150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.124026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.124528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.124885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] PATH_INFO: `/v3/projects/81a13d8f978144e68f3e135ab9f2994f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.126094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a13d8f978144e68f3e135ab9f2994f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.128035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.174585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6eff18260e48029200f4005c1d7c80', 'request_id': 'req-0190db2c-394e-43d9-b8ea-fe0c16f07aad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.211279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6eff18260e48029200f4005c1d7c80', 'request_id': 'req-0190db2c-394e-43d9-b8ea-fe0c16f07aad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.227507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6eff18260e48029200f4005c1d7c80', 'request_id': 'req-0190db2c-394e-43d9-b8ea-fe0c16f07aad'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.235664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a13d8f978144e68f3e135ab9f2994f', 'request_id': 'req-783a6902-cac8-4e54-a2cc-703ee0c3ce57'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.244296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] The token cache is being invalidate because project 8a6eff18260e48029200f4005c1d7c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:01.244754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.245871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0190db2c-394e-43d9-b8ea-fe0c16f07aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.247888 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3468/6968] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:01 2022] DELETE /identity/v3/projects/8a6eff18260e48029200f4005c1d7c80 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:01.252517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d93af-e3a6-4549-8690-f931ff85ba8c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.253126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d93af-e3a6-4549-8690-f931ff85ba8c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.253512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d93af-e3a6-4549-8690-f931ff85ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.254407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a13d8f978144e68f3e135ab9f2994f', 'request_id': 'req-783a6902-cac8-4e54-a2cc-703ee0c3ce57'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.266667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a13d8f978144e68f3e135ab9f2994f', 'request_id': 'req-783a6902-cac8-4e54-a2cc-703ee0c3ce57'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.291625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] The token cache is being invalidate because project 81a13d8f978144e68f3e135ab9f2994f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:01.291916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.292600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-783a6902-cac8-4e54-a2cc-703ee0c3ce57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:01.294460 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3501/6969] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:01 2022] DELETE /identity/v3/projects/81a13d8f978144e68f3e135ab9f2994f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:01.299194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b8d41-6326-47a8-9886-a7d34d0858ea None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.299481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b8d41-6326-47a8-9886-a7d34d0858ea None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.299762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b8d41-6326-47a8-9886-a7d34d0858ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.307188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-036d93af-e3a6-4549-8690-f931ff85ba8c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:01.310909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-036d93af-e3a6-4549-8690-f931ff85ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.346125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a01b8d41-6326-47a8-9886-a7d34d0858ea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:01.347431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a01b8d41-6326-47a8-9886-a7d34d0858ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.445970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:01.462605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3502/6970] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:01.470625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.471369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.471794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.480651 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3469/6971] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:01.482790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.483057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.483330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.522168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:01.523411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.535670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:01.539800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:01.546063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3470/6972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:01.547210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.567380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cab68-5eb3-4872-93d9-a2c9d07b01db None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.568666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3503/6973] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:01.573378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.574010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.574307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.574562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.575216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:01.575518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.577161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.586374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.608584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3471/6974] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:01.609683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.617022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e5fca-a19e-4fc8-a2e0-8184c16bfa78 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.623759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.624504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.625155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.626026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.626828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:01.627412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.630640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.646483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c285-76ac-4f59-9a68-1648bbf05bf3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.652310 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3504/6975] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:01.656854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.667062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.693822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.697259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.697753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.701069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.717292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.784002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a4179-aaa6-4cba-bcc5-404e951d8df9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.798478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3472/6976] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:01.799488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.801778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:01.802671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:01.803965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:01.804488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:01.805687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:01.818161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:01.898729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d2409-9c02-4127-a609-3072a198a8f2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:01.902885 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3505/6977] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/projects => generated 389 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:01.906899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:01.916411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:02.029619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.030253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.030537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.030862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.031572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.033657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.057144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b99ed9-d6cb-4b2c-943b-b8bab77c740c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.063292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3473/6978] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:02.065540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.067301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.067692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.068069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.068800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.073119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.073396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.084830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606df22-4ec5-4829-84d4-fdcd6da36cc8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.091260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.092051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.092825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.093279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.094270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.097009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.116878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3474/6979] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:02.118638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.131618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3506/6980] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:01 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:02.132432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576f76-256d-493c-8715-d9a65f3e3774 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.133461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.138561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.139468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.140023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.140449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.141352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.143942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.155425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b35391-ced8-485b-8701-3450a073da06 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.161992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3475/6981] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:02.163052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.177460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6dfe4-3067-4cf6-9e2a-cd49ab8cb31a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.178283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.179185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.179583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.179955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.180707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.182968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.183637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.183914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.184369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] PATH_INFO: `/v3/projects/c078c94ad4534775a4cf63490629a2c2/users/f07c79f23b434d2fb03e1502242ec2c9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.192289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.202737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c078c94ad4534775a4cf63490629a2c2, user_id=f07c79f23b434d2fb03e1502242ec2c9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.206497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c130c2-f6a2-43b1-b134-5b85a7b4e3b5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.243503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3476/6982] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:02 2022] PUT /identity/v3/projects/c078c94ad4534775a4cf63490629a2c2/users/f07c79f23b434d2fb03e1502242ec2c9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:02.245216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.245502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.245829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.251935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3507/6983] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:02.253368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.257183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:02.276569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72116933-7bdc-48b3-8095-cb7ab542538e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.303422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] MFA Rules not processed for user `f07c79f23b434d2fb03e1502242ec2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:02.305117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:02.461759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.462382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.462657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.463251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.463548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.469061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.495639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3477/6984] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:02.499698 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3508/6985] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:02.500623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.510857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.512436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093565c-32a5-4dc4-83d8-0c0fe8d325f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.513566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:02.517797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.518550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.518912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.519274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] PATH_INFO: `/v3/projects/ba7488d59626490485137752c94754b4/users/8e350e5a610143faa4ef157417bbdb94/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.537807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7488d59626490485137752c94754b4, user_id=8e350e5a610143faa4ef157417bbdb94, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.540813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73b5ea-dfe9-4cd6-b53d-44a6cc2fac96 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.560957 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3478/6986] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:02 2022] PUT /identity/v3/projects/ba7488d59626490485137752c94754b4/users/8e350e5a610143faa4ef157417bbdb94/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:02.574243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.574802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.575282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.634328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] MFA Rules not processed for user `8e350e5a610143faa4ef157417bbdb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:02.637412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:02.696781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d1c7-1161-4d0d-bf51-ada9be879de9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.789340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:02.811425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3479/6987] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:02.816747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:02.834766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.837325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.837986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.838505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.940288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.943229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:02.958422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3509/6988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:02.974658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:02.979359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3691eb4-be00-4e49-97b4-ce15f9e198c1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:02.994158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:02.994865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:02.995140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:02.995408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:02.996046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:02.998510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.012117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.014435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:03.037174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852a31-b319-4678-a416-203acfec158c service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.051261 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3480/6989] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:02 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:03.052276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.054372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.054923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.056044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.056687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.061158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:03.095361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.096999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.120310 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3510/6990] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:03.203871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f58f9-f61c-4efb-8a28-334328583976 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.220626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.221310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.221580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.222152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.222507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.226228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.260115 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3481/6991] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:03 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:03.263863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.276053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9a35-64cd-424a-9b33-2ac6b1be9dc4 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.283173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.283861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.284212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.284551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.285347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.287054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.328040 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3511/6992] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:03.329598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.358332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35cdb-0c16-4fdd-9515-5ee853198e7b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.377417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.379249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.392982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.393378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] PATH_INFO: `/v3/projects/06e7ffd21f9347198e89688ca3657c2d/users/806f8bf893dc4312acf9e45dbdc5265b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.440561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e7ffd21f9347198e89688ca3657c2d, user_id=806f8bf893dc4312acf9e45dbdc5265b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.449724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.495262 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3482/6993] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:03 2022] PUT /identity/v3/projects/06e7ffd21f9347198e89688ca3657c2d/users/806f8bf893dc4312acf9e45dbdc5265b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:03.499423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.514535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104f8ed-f119-4733-beb1-eb5804b2bf26 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.615138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.618012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.618300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.618579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.619444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.626774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4341d-427f-41d1-99d6-6bbdddd745fe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.654430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3512/6994] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:03.658611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.670694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e057b9-87ab-4256-8de9-4744094cc9b9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:03.677567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:03.678695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.679059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.679442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] PATH_INFO: `/v3/projects/06e7ffd21f9347198e89688ca3657c2d/users/806f8bf893dc4312acf9e45dbdc5265b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.681812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e7ffd21f9347198e89688ca3657c2d, user_id=806f8bf893dc4312acf9e45dbdc5265b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:03.685151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:03.699430 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3483/6995] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:03 2022] PUT /identity/v3/projects/06e7ffd21f9347198e89688ca3657c2d/users/806f8bf893dc4312acf9e45dbdc5265b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:03.711396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:03.711691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:03.711967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:03.768996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] MFA Rules not processed for user `806f8bf893dc4312acf9e45dbdc5265b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:03.770639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:03.871193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:03.899661 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3513/6996] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:03.910083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:03.911898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:03.996236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343e96-a46e-409f-b913-a720d91413cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:04.000826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:04.002273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:04.002574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:04.002928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:04.017696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:04.020020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:04.046537 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3484/6997] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:04.255173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:04.261989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:04.348517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:04.366437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5494328-9eb2-4f52-837d-af32cc583fe3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:04.373874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:04.374900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:04.375226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:04.376732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:04.382596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:04.393479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9ddc-f702-42a1-830a-ce5833d19be8 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:04.400481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:04.402260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:04.402844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:04.404220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] PATH_INFO: `/v3/users/8e350e5a610143faa4ef157417bbdb94` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:04.407009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e350e5a610143faa4ef157417bbdb94)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:04.409510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:04.428025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:04.429591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15c3e7-995c-4580-ab5e-19c477ce668b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:04.449238 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3514/6998] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:04.494647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e350e5a610143faa4ef157417bbdb94'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:04.495458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e350e5a610143faa4ef157417bbdb94'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:04.496781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e350e5a610143faa4ef157417bbdb94'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:04.513110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e350e5a610143faa4ef157417bbdb94'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:04.541982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e350e5a610143faa4ef157417bbdb94'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:04.608490 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3485/6999] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:04 2022] DELETE /identity/v3/users/8e350e5a610143faa4ef157417bbdb94 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:04.610309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:04.610772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:04.610868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:04.637151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:04.638537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:04.733395 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3515/7000] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:04.744650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:04.746169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:04.878211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81242-a115-4a62-b47f-32764f1e9657 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:04.888550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:04.889998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:04.891812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:04.892299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:04.920489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:04.922307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:04.945802 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3486/7001] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:05.529359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:05.530811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:05.544006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bfb6c-c0cb-444f-8ff4-2f4abd888c26 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:05.549898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:05.550635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:05.550918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:05.551196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] PATH_INFO: `/v3/projects/ba7488d59626490485137752c94754b4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:05.552952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7488d59626490485137752c94754b4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:05.554654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:05.652100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7488d59626490485137752c94754b4', 'request_id': 'req-d090935d-21c7-4816-a3d0-b35bea314cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.660257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7488d59626490485137752c94754b4', 'request_id': 'req-d090935d-21c7-4816-a3d0-b35bea314cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.670638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7488d59626490485137752c94754b4', 'request_id': 'req-d090935d-21c7-4816-a3d0-b35bea314cd0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.687188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] The token cache is being invalidate because project ba7488d59626490485137752c94754b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:05.688235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.689368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.692144 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3516/7002] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:05 2022] DELETE /identity/v3/projects/ba7488d59626490485137752c94754b4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:05.696154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:05.707282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e21a4-69bf-4a70-8e44-3f07132c486f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:05.785550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:05.786626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:05.787102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:05.787717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] PATH_INFO: `/v3/users/806f8bf893dc4312acf9e45dbdc5265b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:05.789581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806f8bf893dc4312acf9e45dbdc5265b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:05.792131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:05.794791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:05.880333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806f8bf893dc4312acf9e45dbdc5265b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.881061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806f8bf893dc4312acf9e45dbdc5265b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.881871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806f8bf893dc4312acf9e45dbdc5265b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.893031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806f8bf893dc4312acf9e45dbdc5265b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.906146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806f8bf893dc4312acf9e45dbdc5265b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:05.941368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3487/7003] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:05 2022] DELETE /identity/v3/users/806f8bf893dc4312acf9e45dbdc5265b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:07.720609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:07.724765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:07.743652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090935d-21c7-4816-a3d0-b35bea314cd0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:07.760718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:07.785951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:07.793001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:07.856621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:07.857330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:07.857609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:07.857882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] PATH_INFO: `/v3/users/839e2104bc0d4b1fb55d69966eedd998` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:07.859406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839e2104bc0d4b1fb55d69966eedd998)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:07.862442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:07.968675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839e2104bc0d4b1fb55d69966eedd998'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:07.969391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839e2104bc0d4b1fb55d69966eedd998'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:07.984338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839e2104bc0d4b1fb55d69966eedd998'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:07.986808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f30c0-6c41-4c77-9b19-0e0250b1c2e1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:07.996166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839e2104bc0d4b1fb55d69966eedd998'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:07.997145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-03fdc6dc-c0d3-496e-8e72-ffba7061f876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839e2104bc0d4b1fb55d69966eedd998'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.001473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:08.002149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.002431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.002703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] PATH_INFO: `/v3/projects/06e7ffd21f9347198e89688ca3657c2d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.005642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e7ffd21f9347198e89688ca3657c2d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:08.016207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:08.041022 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3517/7004] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:07 2022] DELETE /identity/v3/users/839e2104bc0d4b1fb55d69966eedd998 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:08.145906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e7ffd21f9347198e89688ca3657c2d', 'request_id': 'req-a75eb04b-8cbe-4090-a02e-15636585ca6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.157359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e7ffd21f9347198e89688ca3657c2d', 'request_id': 'req-a75eb04b-8cbe-4090-a02e-15636585ca6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.174600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e7ffd21f9347198e89688ca3657c2d', 'request_id': 'req-a75eb04b-8cbe-4090-a02e-15636585ca6b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.202788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] The token cache is being invalidate because project 06e7ffd21f9347198e89688ca3657c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:08.203580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.205015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a75eb04b-8cbe-4090-a02e-15636585ca6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:08.207502 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3488/7005] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:07 2022] DELETE /identity/v3/projects/06e7ffd21f9347198e89688ca3657c2d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:08.213575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.213887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.214176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.241998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:08.243401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:08.453097 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3518/7006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:08.460708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.461514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.465906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.542201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:08.549046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:08.568064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3489/7007] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:08.572484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:08.591026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1847ca-1c2b-4561-8786-dc8b5bcc1c40 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:08.608819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:08.609496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.609929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.610208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.614582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:08.614952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:08.621969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:08.652738 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3519/7008] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:08.654327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:08.658884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:08.668704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b9873-3710-4f3c-9f7f-e33c9de15a08 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:08.689877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:08.691434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.692935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.693685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.694608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:08.709684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:08.766278 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3490/7009] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:08 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:08.771041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:08.786476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208904-e781-42ef-baf4-6164e30a4f0d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:08.812311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:08.863423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:08.866395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:08.909273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:08.910322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.910322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.910575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.911097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:08.913082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:08.967802 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3520/7010] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:08 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:08.971582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:08.985733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6dc3-36a9-41e1-82b0-b23e31b9e45a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:08.994116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:08.995334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:08.995963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:08.996491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:08.997877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.000466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.013483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adef76-2d9a-4898-be52-9c4f62c62475 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.019017 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3521/7011] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:09.023307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.025290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.025960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.026240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.026516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] PATH_INFO: `/v3/projects/e901c15dac8e49e5b0e0ead18d6cd6b5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.033090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e901c15dac8e49e5b0e0ead18d6cd6b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.037669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ed41-75fc-4a9f-8c56-31591f52c5e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.041305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.045624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.047368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.048052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.048616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.049563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.052019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.085332 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3522/7012] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:09.091338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.110878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b990-3b0d-4f8e-92ee-bf120a891182 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.132876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.133761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.134067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.134414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] PATH_INFO: `/v3/projects/4018ae4a15714d00af0fe847cf66047f/users/bf10ee31ff16414a8bc8a2ddd9017327/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.178774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'request_id': 'req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:09.179286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4018ae4a15714d00af0fe847cf66047f, user_id=bf10ee31ff16414a8bc8a2ddd9017327, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.182307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ede5-0341-46e8-babb-9f61c7b7a1fd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.200421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'request_id': 'req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:09.203524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3523/7013] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:09 2022] PUT /identity/v3/projects/4018ae4a15714d00af0fe847cf66047f/users/bf10ee31ff16414a8bc8a2ddd9017327/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:09.218053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.218381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.218669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.225725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'request_id': 'req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:09.254931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] The token cache is being invalidate because project e901c15dac8e49e5b0e0ead18d6cd6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:09.255225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:09.255928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ba7b695c-ba5b-46b4-aaf9-43b9f7103c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:09.257978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3491/7014] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:08 2022] DELETE /identity/v3/projects/e901c15dac8e49e5b0e0ead18d6cd6b5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:09.263671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221c7a-73df-4685-b1fb-6b2f9249ab50 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.263960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221c7a-73df-4685-b1fb-6b2f9249ab50 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.264235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5221c7a-73df-4685-b1fb-6b2f9249ab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.290583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] MFA Rules not processed for user `bf10ee31ff16414a8bc8a2ddd9017327`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:09.292295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:09.311855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a5221c7a-73df-4685-b1fb-6b2f9249ab50 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:09.313388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5221c7a-73df-4685-b1fb-6b2f9249ab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:09.474584 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3492/7015] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:09.482444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.482790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.483004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.501198 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3524/7016] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:09.507430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.510466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:09.538933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:09.540214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:09.562525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412c09-a07e-4f03-83bd-80291ee9e9cc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.571937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3493/7017] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:09.573298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.573850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.574124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.574393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.575096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.577920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.584880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.593309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:09.603736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59228fd5-a5e2-4444-8d71-56bf10e1daee None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.621556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.622171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.622451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.622721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.623384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:09.623684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.625364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.649954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3525/7018] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:09.654188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.658859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3494/7019] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:09.661112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.691317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf7ce-2475-4ff0-b7c9-03a0ae0f48e2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.772884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:09.834946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e4542-4b4c-433a-b3b2-6ac5ba912676 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.849623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.850476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.851108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.851551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.852581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.854768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.897833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3526/7020] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:09.901902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.916269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.917418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.917704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.918099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.918761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.918974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cc7a7-a7ce-4ce1-943a-658f67d6ec6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:09.922181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.931337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:09.931965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:09.932241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:09.932510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:09.933460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:09.935292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:09.977892 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3527/7021] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:09.981515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:09.981708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3495/7022] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/projects => generated 399 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:09.986504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.007743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e779551-ed67-4b8b-984d-a59c2c5efed0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.109961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310949c-fdab-4f86-9748-a8dc55469889 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.120334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.121775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.122326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.123022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.124860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.127830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.131465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.132143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.132425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.132700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] PATH_INFO: `/v3/projects/b8b10fc2bf6e4afd8793f9395244180b/users/f1994efc92454d48bf2b26fc81f3f23b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.170745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b10fc2bf6e4afd8793f9395244180b, user_id=f1994efc92454d48bf2b26fc81f3f23b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.173507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.174532 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3496/7023] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:09 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:10.179674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.199057 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3528/7024] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:09 2022] PUT /identity/v3/projects/b8b10fc2bf6e4afd8793f9395244180b/users/f1994efc92454d48bf2b26fc81f3f23b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:10.202897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.212457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341fcb-1f13-4425-8102-4666a17278e7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.367598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb655-128c-4e6a-9e87-25e3752fe89e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.380817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.381543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.381825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.382094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.382775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.384417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.408615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.409319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.409598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.409948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.411488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.416750 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3529/7025] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:10.418259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.420677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.443003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36df13d-dc81-4b97-8587-7a5ed26f1c5c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.447933 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3497/7026] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:10.450729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.451417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.451548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.451770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.451976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] PATH_INFO: `/v3/projects/b8b10fc2bf6e4afd8793f9395244180b/users/f1994efc92454d48bf2b26fc81f3f23b/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.456937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b10fc2bf6e4afd8793f9395244180b, user_id=f1994efc92454d48bf2b26fc81f3f23b, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.459652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeb50d-5f4a-4717-ad19-f3ca27a4c4ef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.465286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:10.479400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111994e-2b2c-4aa0-b7e3-be0f4df3e045 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.496100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3530/7027] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:10 2022] PUT /identity/v3/projects/b8b10fc2bf6e4afd8793f9395244180b/users/f1994efc92454d48bf2b26fc81f3f23b/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:10.506514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.506758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.507203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.566749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] MFA Rules not processed for user `f1994efc92454d48bf2b26fc81f3f23b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:10.567987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:10.578182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:10.619536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.620946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.621377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.621742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.622507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.624353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.644373 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3498/7028] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:10.649968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.685005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303713-ff31-43e6-a960-483dd73ab2cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:10.704674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:10.705379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.705818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.706095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] PATH_INFO: `/v3/projects/012c9929d260430bbefa28af31acb486/users/d0ad1f9adfff479088aa1f6826f93c53/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.753176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c9929d260430bbefa28af31acb486, user_id=d0ad1f9adfff479088aa1f6826f93c53, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:10.757590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a585be-36e3-4f29-b00a-4db807d33938 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:10.765218 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3531/7029] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:10.777826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:10.779474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:10.809925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3499/7030] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:10 2022] PUT /identity/v3/projects/012c9929d260430bbefa28af31acb486/users/d0ad1f9adfff479088aa1f6826f93c53/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:10.821710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:10.821993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:10.822363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:10.925195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] MFA Rules not processed for user `d0ad1f9adfff479088aa1f6826f93c53`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:10.926389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:10.975823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e341d3-ad94-4540-9b05-3e956b56635a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:11.060231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:11.060623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:11.060938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:11.061231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:11.069171 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3500/7031] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:11.083693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:11.085437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:11.117605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b712-f73a-49a1-b019-9b9228a0a255 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:11.138347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:11.138848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:11.139130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:11.139401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:11.171553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:11.173608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:11.209249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3501/7032] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:11.221213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:11.224240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372caa3-d4d4-43e5-83e7-a92caa620289 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:11.246996 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3532/7033] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:12.101544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:12.210313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:12.235984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813c28-ff90-4e6a-883c-8f1cfbab1c57 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:12.247998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:12.248989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:12.249538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:12.250942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] PATH_INFO: `/v3/users/bf10ee31ff16414a8bc8a2ddd9017327` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:12.255649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf10ee31ff16414a8bc8a2ddd9017327)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:12.257924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:12.393985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf10ee31ff16414a8bc8a2ddd9017327'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:12.395294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf10ee31ff16414a8bc8a2ddd9017327'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:12.396493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf10ee31ff16414a8bc8a2ddd9017327'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:12.430589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf10ee31ff16414a8bc8a2ddd9017327'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:12.442225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf10ee31ff16414a8bc8a2ddd9017327'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:12.485744 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3502/7034] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:12 2022] DELETE /identity/v3/users/bf10ee31ff16414a8bc8a2ddd9017327 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:12.488394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:12.489242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:12.489715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:12.514639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:12.524633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:12.526309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:12.634269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3533/7035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:12.851076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:12.853087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:12.975449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854060de-1b96-4310-a5a5-63a61a93e657 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:12.979770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:12.980393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:12.980674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:12.981037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:13.002800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:13.005650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:13.026313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3503/7036] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:14.001826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:14.004453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:14.021928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1e8a7-828a-440f-a434-e988ba9c9b22 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:14.027888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:14.028813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:14.029317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:14.030012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] PATH_INFO: `/v3/projects/4018ae4a15714d00af0fe847cf66047f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:14.031897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4018ae4a15714d00af0fe847cf66047f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:14.034422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:14.143205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4018ae4a15714d00af0fe847cf66047f', 'request_id': 'req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.164708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4018ae4a15714d00af0fe847cf66047f', 'request_id': 'req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.181899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4018ae4a15714d00af0fe847cf66047f', 'request_id': 'req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.210591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] The token cache is being invalidate because project 4018ae4a15714d00af0fe847cf66047f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:14.211215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.212683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.220636 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3534/7037] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:14 2022] DELETE /identity/v3/projects/4018ae4a15714d00af0fe847cf66047f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:14.220748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:14.236994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27c6c1-3e7b-4a6f-a524-c8843882fb0c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:14.381491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:14.382545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:14.382839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:14.383160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] PATH_INFO: `/v3/users/f1994efc92454d48bf2b26fc81f3f23b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:14.384389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1994efc92454d48bf2b26fc81f3f23b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:14.386686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:14.407728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:14.506057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1994efc92454d48bf2b26fc81f3f23b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.506739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1994efc92454d48bf2b26fc81f3f23b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.510622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1994efc92454d48bf2b26fc81f3f23b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.530971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:14.531100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1994efc92454d48bf2b26fc81f3f23b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.531209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:14.534418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1994efc92454d48bf2b26fc81f3f23b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.543669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e98f-e8b3-49a2-8d50-020210cfbf5a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:14.572762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:14.573718 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3504/7038] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:14 2022] DELETE /identity/v3/users/f1994efc92454d48bf2b26fc81f3f23b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:14.589173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:14.589430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:14.589709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] PATH_INFO: `/v3/users/b34b183f2b0b4a4597fb2e3b6495268a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:14.602304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34b183f2b0b4a4597fb2e3b6495268a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:14.613669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:14.724100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34b183f2b0b4a4597fb2e3b6495268a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.724795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34b183f2b0b4a4597fb2e3b6495268a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.739877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34b183f2b0b4a4597fb2e3b6495268a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.750666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34b183f2b0b4a4597fb2e3b6495268a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.751497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34b183f2b0b4a4597fb2e3b6495268a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:14.797090 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3535/7039] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:14 2022] DELETE /identity/v3/users/b34b183f2b0b4a4597fb2e3b6495268a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:15.444282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:15.449619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:15.641457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7da6-5fc2-4085-94e9-7f8763f91f22 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:15.780168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:15.782089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:15.784361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:15.785476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] PATH_INFO: `/v3/projects/953dcbea116f45439fa6f2162591e611` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:15.786965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953dcbea116f45439fa6f2162591e611)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:15.789241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:15.802484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:15.805338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:15.819769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:15.832105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341d905-77f3-450b-87f3-1f3359603c49 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:15.853967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:15.854653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:15.854947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:15.855204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] PATH_INFO: `/v3/projects/b8b10fc2bf6e4afd8793f9395244180b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:15.861527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b10fc2bf6e4afd8793f9395244180b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:15.863813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:15.921295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:15.937994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953dcbea116f45439fa6f2162591e611', 'request_id': 'req-41dda821-8071-4883-a9fb-d1d50b682e70'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.946705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953dcbea116f45439fa6f2162591e611', 'request_id': 'req-41dda821-8071-4883-a9fb-d1d50b682e70'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.962237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953dcbea116f45439fa6f2162591e611', 'request_id': 'req-41dda821-8071-4883-a9fb-d1d50b682e70'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.971699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b10fc2bf6e4afd8793f9395244180b', 'request_id': 'req-bb3d8b76-f161-488b-b1a2-430d4eb70d87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.979348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b10fc2bf6e4afd8793f9395244180b', 'request_id': 'req-bb3d8b76-f161-488b-b1a2-430d4eb70d87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.990264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b10fc2bf6e4afd8793f9395244180b', 'request_id': 'req-bb3d8b76-f161-488b-b1a2-430d4eb70d87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.994432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] The token cache is being invalidate because project 953dcbea116f45439fa6f2162591e611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:15.994731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:15.997435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-41dda821-8071-4883-a9fb-d1d50b682e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:16.000941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3505/7040] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:15 2022] DELETE /identity/v3/projects/953dcbea116f45439fa6f2162591e611 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:16.009660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f6cb-e8ab-4978-947d-79836effa190 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.010067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f6cb-e8ab-4978-947d-79836effa190 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.010346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f6cb-e8ab-4978-947d-79836effa190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.013721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] The token cache is being invalidate because project b8b10fc2bf6e4afd8793f9395244180b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:16.014020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:16.016331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bb3d8b76-f161-488b-b1a2-430d4eb70d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:16.017916 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3536/7041] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:15 2022] DELETE /identity/v3/projects/b8b10fc2bf6e4afd8793f9395244180b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:16.023815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfe15e-64b2-4e08-a39a-b84c6ac572e7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.026232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfe15e-64b2-4e08-a39a-b84c6ac572e7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.026690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfe15e-64b2-4e08-a39a-b84c6ac572e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.059567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1c0f6cb-e8ab-4978-947d-79836effa190 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:16.061929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1c0f6cb-e8ab-4978-947d-79836effa190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:16.088798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-18dfe15e-64b2-4e08-a39a-b84c6ac572e7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:16.090007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-18dfe15e-64b2-4e08-a39a-b84c6ac572e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:16.198532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3537/7042] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:16.207365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.207939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.208404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.228980 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3506/7043] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:16.237164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.237490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.238328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.251261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:16.252796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:16.262429 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3538/7044] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:16.266695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.278744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:16.278744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:16.283389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a0923-2519-4d0e-8aad-de294075536c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.288655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.289924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.291016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.292547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.293818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:16.294318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.296329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.299097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3507/7045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:16.304157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.316946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a246f2-8306-4838-8e81-80bef2d7e831 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.317975 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3539/7046] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:16.319523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.330170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.330799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.331079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.331347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.333233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:16.333233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.334714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.340692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b1f6-6916-4c87-836d-d521e91a45d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.369753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3508/7047] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:16.373697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.373847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.374373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.374972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.375449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.376353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.383217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.394418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58d2d-d959-4dd2-a29f-918ccc458610 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.400517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.403712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.403998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.404276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.404955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.407541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.451962 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3540/7048] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:16.453043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.506657 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3509/7049] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:16.517930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.703244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:16.788752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce7c1f-a2c2-4dd7-a7a6-88a1efffd6cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.835076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.835781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.836043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.836231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.837908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b8ba9-3967-478d-b241-171f40d79c10 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.840032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.841190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.861961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.865792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.865900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:16.866217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:16.866876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:16.868826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:16.936321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3510/7050] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/users => generated 286 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:16.942474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.960065 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3541/7051] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:16 2022] POST /identity/v3/users => generated 292 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:16.961320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:16.972245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f2a9-3848-46a4-97ee-7c6fd2726830 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.998145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29730-00c7-4da0-a58b-fc494f3e085e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:16.999080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:16.999706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:16.999982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.000249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.000935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.006045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.022867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3511/7052] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:17.026830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.026996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.027623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.027899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.028166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.028818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.030493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.051559 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3542/7053] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:17.058093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6398b5e-d4e3-41ac-ae03-cfda763c4ec4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.061997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.064381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.065168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.065555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.066016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.067438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.069187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.081027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:17.086527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d308-153e-4c9d-9708-74470ae3b6a6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.092042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3512/7054] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:17.099159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.100676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.102270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.105038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.106172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.111222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.118130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1db77-d44a-40f5-a219-233a451877af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.153511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351809-d164-4840-8810-5ba97dcd64a5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.163603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3543/7055] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:17.170468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379fa5-af20-4be0-9190-923cc9735376 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.171994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.172771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.176191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.176549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] PATH_INFO: `/v3/projects/34282096eef64660ad8b175ca67a4c92/users/9deefb96cf62486d94827e59b2eb4b10/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.177325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379fa5-af20-4be0-9190-923cc9735376 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.177839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03379fa5-af20-4be0-9190-923cc9735376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.210694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-03379fa5-af20-4be0-9190-923cc9735376 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:17.211893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34282096eef64660ad8b175ca67a4c92, user_id=9deefb96cf62486d94827e59b2eb4b10, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.212852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03379fa5-af20-4be0-9190-923cc9735376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:17.216165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.235399 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3513/7056] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:17 2022] PUT /identity/v3/projects/34282096eef64660ad8b175ca67a4c92/users/9deefb96cf62486d94827e59b2eb4b10/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:17.236529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.372398 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3544/7057] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:17.376289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36f3d-4686-459f-bdf9-91f397e9b6bc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.376515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36f3d-4686-459f-bdf9-91f397e9b6bc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.376821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36f3d-4686-459f-bdf9-91f397e9b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.419932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9acd0-5694-45d0-9bf5-ec22527183a9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.429203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.430331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.430785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.431242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] PATH_INFO: `/v3/projects/bc79be4099ee41958f327ebd66852534/users/48cc88dc916a4a669bdd0c38d11cf4d2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.455383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b3b36f3d-4686-459f-bdf9-91f397e9b6bc None None] MFA Rules not processed for user `9deefb96cf62486d94827e59b2eb4b10`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:17.456800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b3b36f3d-4686-459f-bdf9-91f397e9b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:17.475241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc79be4099ee41958f327ebd66852534, user_id=48cc88dc916a4a669bdd0c38d11cf4d2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.479322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.500778 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3514/7058] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:17 2022] PUT /identity/v3/projects/bc79be4099ee41958f327ebd66852534/users/48cc88dc916a4a669bdd0c38d11cf4d2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:17.508650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.510847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:17.555312 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3545/7059] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:17.561299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f779-b42c-4841-a379-651a4890a974 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.561675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f779-b42c-4841-a379-651a4890a974 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.562028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f779-b42c-4841-a379-651a4890a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.620354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e362f779-b42c-4841-a379-651a4890a974 None None] MFA Rules not processed for user `48cc88dc916a4a669bdd0c38d11cf4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:17.622133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e362f779-b42c-4841-a379-651a4890a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:17.634325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c573e9-bd58-4906-ab26-e145eb211f6e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.641461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.642220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.642601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.642972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.681665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:17.714953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:17.718600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.721328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.731512 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3515/7060] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:17.732450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.740813 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3546/7061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:17.743849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362f779-b42c-4841-a379-651a4890a974 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.852067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce581f0-250c-4678-825c-e0011c4f4e72 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.857895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.858963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.859247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.859669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.861238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.862018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362f779-b42c-4841-a379-651a4890a974 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:17.863223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.868648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:17.870514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:17.870921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:17.871298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:17.872171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:17.874355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:17.899796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3516/7062] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:17.904231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:17.932625 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3547/7063] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:17.937031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.008345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a765d32-8ade-4a63-9394-69ecaeb3deaf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.063953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ad31-164c-4fa5-bad7-63f0ea4b76f3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.077568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.078485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.078946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.079381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.080181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.086434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.138603 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3548/7064] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:18.142774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.170006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0289a2-224e-405d-9246-1ef8e2cee827 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.175954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.176730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.177161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.177766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.182588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.182761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.182917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.183928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.184262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.184684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.186408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.188638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.201139 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3549/7065] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:18.202990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.223315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8bac-4aa1-4b42-b28d-90675c646cd2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.251742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.252434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.252711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.253005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] PATH_INFO: `/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a/users/fd0aa865feb84ef388eb64a6ef10eb66/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.257984 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3517/7066] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:17 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:18.261405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.280635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489590-0368-4f61-b4f2-33de71cb5641 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.291218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5688eb4d0ecf42ff829690f8f7ea389a, user_id=fd0aa865feb84ef388eb64a6ef10eb66, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.298555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.305678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.306326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.306598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.306869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.311032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.316723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.340898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3550/7067] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:18 2022] PUT /identity/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a/users/fd0aa865feb84ef388eb64a6ef10eb66/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:18.344807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.347368 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3518/7068] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:18.351363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.375463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a282-e3df-4c06-a1ed-c63c10e4c9ee admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.378117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:18.388827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:18.529159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef8d4a-8495-4110-9c74-0ffc41bf20f2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.529467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.530158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.530439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.530717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] PATH_INFO: `/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f/users/a24a9c5cdd344c9baa8c6ef3641728a3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.544780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.545467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.545751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.546025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.546677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.548476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.560946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3551/7069] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:18.566895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.573020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d5fffebb8f4d5482963ab8ad543d0f, user_id=a24a9c5cdd344c9baa8c6ef3641728a3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.577006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.589211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8a25-8cec-4191-8243-6a33c1b2bf09 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.611359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.613285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.613663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.614040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] PATH_INFO: `/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a/users/fd0aa865feb84ef388eb64a6ef10eb66/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.616487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5688eb4d0ecf42ff829690f8f7ea389a, user_id=fd0aa865feb84ef388eb64a6ef10eb66, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.617667 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3519/7070] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:18 2022] PUT /identity/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f/users/a24a9c5cdd344c9baa8c6ef3641728a3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:18.621429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.623399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b73c-0f7b-4d51-8053-0a86e565f72b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.673232 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3552/7071] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:18 2022] PUT /identity/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a/users/fd0aa865feb84ef388eb64a6ef10eb66/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:18.684814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.685118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.685395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.751748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] MFA Rules not processed for user `fd0aa865feb84ef388eb64a6ef10eb66`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:18.755082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:18.757768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73389771-67bd-48db-b7f4-433dc6343047 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.892576 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3553/7072] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:18.905579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.906221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.906415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.906543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.906758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.907564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.909196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:18.911443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:18.925186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3520/7073] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:18.928037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:18.957483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33f0a-17a2-4655-ac5a-62c99d90e330 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:18.969632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:18.971094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:18.971372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:18.971644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] PATH_INFO: `/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f/users/a24a9c5cdd344c9baa8c6ef3641728a3/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:18.981987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d5fffebb8f4d5482963ab8ad543d0f, user_id=a24a9c5cdd344c9baa8c6ef3641728a3, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:18.985534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3119f5c-064a-47e0-a7d5-52bf9bda0bd1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.003987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cad542-658c-48ce-bfd4-429c8afd8bc2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.012964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3521/7074] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:18 2022] PUT /identity/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f/users/a24a9c5cdd344c9baa8c6ef3641728a3/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:19.018018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.018298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.018568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.075625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] MFA Rules not processed for user `a24a9c5cdd344c9baa8c6ef3641728a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:19.078962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:19.079152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:19.094442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:19.095626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.096483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.097654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.098117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.208116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.209827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.219409 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3522/7075] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:19.220314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.229277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3554/7076] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:19.233724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015e4d-4221-47d1-8552-9ffa8dca7299 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.242661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.243009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.243627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.243766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.244509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.248055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.311186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.322710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3523/7077] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:19 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:19.334966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48aca1-0a69-4f27-a4ae-885b2f36a7b5 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.357575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.360179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:19.453859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297d7b3-ea38-416c-8ef0-c2fa320aea6c tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.458194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.458814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.459143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.459413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.484540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.486349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.486843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.487445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.488886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.491839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.536466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.538015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3555/7078] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:19 2022] POST /identity/v3/users => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:19.541838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.546875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.562527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8674f2a-08b2-420f-9604-b72b50f683df tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.567621 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3524/7079] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:19.574753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.575718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.576165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.576666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.577678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:19.578244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.581009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.643306 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3556/7080] 10.222.0.16 () {58 vars in 1157 bytes} [Fri Oct 28 10:24:19 2022] GET /identity/v3/users?domain_id=default => generated 8033 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:19.644841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.660827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313fa3-05e5-42ae-8b3a-4f1d4b1d6112 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.669140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.670093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.670707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.671157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/users/7c78c1bd05de446b8ba40425d180742a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.717563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:update_user(user_id=7c78c1bd05de446b8ba40425d180742a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.720966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.762234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.764830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:19.806479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:19.817888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:19.828960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invalidating the token cache because user 7c78c1bd05de446b8ba40425d180742a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:19.829434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:19.832256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8da1ad78-4e17-4f27-96aa-fa6720b1dc71 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:19.834535 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3525/7081] 10.222.0.16 () {60 vars in 1244 bytes} [Fri Oct 28 10:24:19 2022] PATCH /identity/v3/users/7c78c1bd05de446b8ba40425d180742a => generated 488 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:19.839134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.839452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.839742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.877785 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.auth.plugins.core [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] User is disabled: 7c78c1bd05de446b8ba40425d180742a: AssertionError: User is disabled: 7c78c1bd05de446b8ba40425d180742a Oct 28 10:24:19.889802 n-d-zed-1 devstack@keystone.service[88451]: WARNING keystone.server.flask.application [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:24:19.891752 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3526/7082] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 54 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:24:19.896170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:19.897953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:19.919102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfc87c-f7d9-4324-ae68-226d124bfdd0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.929495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a54cc-9107-490b-832f-9d69b4080361 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:19.932344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.934477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:19.935122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.935396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.935662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] PATH_INFO: `/v3/users/867a104361a04d7483c02cb109ebad84` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.936278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:19.936796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:19.937062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867a104361a04d7483c02cb109ebad84)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:19.938006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/users/7c78c1bd05de446b8ba40425d180742a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:19.940596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:19.956367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:20.012448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7c78c1bd05de446b8ba40425d180742a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.018022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.021341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867a104361a04d7483c02cb109ebad84'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.029520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867a104361a04d7483c02cb109ebad84'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.057350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867a104361a04d7483c02cb109ebad84'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.079712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867a104361a04d7483c02cb109ebad84'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.083262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867a104361a04d7483c02cb109ebad84'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.129654 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3557/7083] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:19 2022] DELETE /identity/v3/users/867a104361a04d7483c02cb109ebad84 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:20.132564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.136106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.184292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.187700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.189155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.202750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.211807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1c102f51-ff82-4d97-b2db-764ecccc26b5 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c78c1bd05de446b8ba40425d180742a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.238519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874de77-1b5c-428c-a30d-cbf880d04115 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.250481 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3527/7084] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:19 2022] DELETE /identity/v3/users/7c78c1bd05de446b8ba40425d180742a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:20.252280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.252763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.253314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.294138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:20.295757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.328749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.329611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.329984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.330357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] PATH_INFO: `/v3/users/48cc88dc916a4a669bdd0c38d11cf4d2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.332395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cc88dc916a4a669bdd0c38d11cf4d2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.337242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.436993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:20.437785 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3528/7085] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:20.440374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.452611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.465653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cc88dc916a4a669bdd0c38d11cf4d2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.468051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cc88dc916a4a669bdd0c38d11cf4d2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.478237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cc88dc916a4a669bdd0c38d11cf4d2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.491192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cc88dc916a4a669bdd0c38d11cf4d2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.492205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cc88dc916a4a669bdd0c38d11cf4d2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.515433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3558/7086] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:20 2022] DELETE /identity/v3/users/48cc88dc916a4a669bdd0c38d11cf4d2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:20.516455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.518732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.533150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:20.565319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6b014-b35b-4a02-8870-5f38c5f71a91 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.606821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a52af6-f417-422d-86de-489773c671e0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.612352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.612761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.613185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.613545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/projects/9348c17ae68d4864ba4d5bb6e49ff872` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.615068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9348c17ae68d4864ba4d5bb6e49ff872)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.617127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.645126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.645952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.646656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.646937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.649698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.665413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.667040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.675431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9348c17ae68d4864ba4d5bb6e49ff872', 'request_id': 'req-ab00eea5-72ef-4e6d-86a6-806bd11848c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.681710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3529/7087] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:20.682637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.684303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.685572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9348c17ae68d4864ba4d5bb6e49ff872', 'request_id': 'req-ab00eea5-72ef-4e6d-86a6-806bd11848c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.698359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9348c17ae68d4864ba4d5bb6e49ff872', 'request_id': 'req-ab00eea5-72ef-4e6d-86a6-806bd11848c4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.714745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] The token cache is being invalidate because project 9348c17ae68d4864ba4d5bb6e49ff872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:20.715123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.716023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ab00eea5-72ef-4e6d-86a6-806bd11848c4 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:20.718720 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3559/7088] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:20 2022] DELETE /identity/v3/projects/9348c17ae68d4864ba4d5bb6e49ff872 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:20.724502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.724502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.724502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.752673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:20.754665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.767643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200ced-7c6a-4f16-9864-a5f7250e89ca service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.814427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:20.843779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.845145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.845624 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3560/7089] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:20.846262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.846695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.849710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.851824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.853155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.868413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.871095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.883751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3530/7090] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:20.884614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:20.889446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:20.920308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e9f1-25d1-4b5c-9e32-2f439910322d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.930663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.933671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.935439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.935691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.959184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.962970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:20.974462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc03b-acf0-4275-8207-e0f83427d807 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:20.985404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a24a9c5cdd344c9baa8c6ef3641728a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d5fffebb8f4d5482963ab8ad543d0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:20.986345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:20.987491 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3531/7091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:20.988172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:20.988569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:20.989333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:20.995180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-2a59ae55-9c9d-4ce3-9914-30cdf46f2a53 tempest-UsersNegativeTest-915441814 tempest-UsersNegativeTest-915441814-project-admin] Could not find domain: 99cce68325584fdabecb5795a05b0271.: keystone.exception.DomainNotFound: Could not find domain: 99cce68325584fdabecb5795a05b0271. Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 99cce68325584fdabecb5795a05b0271. Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:24:21.011621 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 28 10:24:21.013022 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:24:21.014303 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:24:21.017929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:24:21.017929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 99cce68325584fdabecb5795a05b0271. Oct 28 10:24:21.017929 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:24:21.017929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3561/7092] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:20 2022] POST /identity/v3/users => generated 112 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:24:21.018494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.020156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.038625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1d08f-0aff-4181-96e9-7a489f65ef1f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:21.046336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:21.047166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.047504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.047783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] PATH_INFO: `/v3/users/9deefb96cf62486d94827e59b2eb4b10` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.049886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9deefb96cf62486d94827e59b2eb4b10)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:21.052387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:21.090649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:21.115691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9deefb96cf62486d94827e59b2eb4b10'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.116932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9deefb96cf62486d94827e59b2eb4b10'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.117833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9deefb96cf62486d94827e59b2eb4b10'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.127971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9deefb96cf62486d94827e59b2eb4b10'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.138918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9deefb96cf62486d94827e59b2eb4b10'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.164971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3532/7093] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:21 2022] DELETE /identity/v3/users/9deefb96cf62486d94827e59b2eb4b10 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:21.170464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.170681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.170950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.199195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:21.199694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.263995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.265626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.314601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3562/7094] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:21.332092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.333703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.405686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70602836-dedc-4cad-a2e3-8b82c0a232f7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:21.416138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:21.416809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.417119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.417392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] PATH_INFO: `/v3/projects/29f811fd0e7f414493d04397200a7e4b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.418720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f811fd0e7f414493d04397200a7e4b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:21.420669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:21.466094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0cfe-a782-4ab9-9924-bbe4ed88cfbb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:21.470850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:21.477334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.477334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.477334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.496293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:21.499503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:21.521051 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3563/7095] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:21.537584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.539246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.540649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f811fd0e7f414493d04397200a7e4b', 'request_id': 'req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.550484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f811fd0e7f414493d04397200a7e4b', 'request_id': 'req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.571039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f811fd0e7f414493d04397200a7e4b', 'request_id': 'req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.615741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ca849-231b-477f-b59a-caed858f16ac service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:21.626421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] The token cache is being invalidate because project 29f811fd0e7f414493d04397200a7e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:21.626727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.628158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-02cc8ef9-e2f6-426c-a1e0-d46dc00d6eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.630583 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3533/7096] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:21 2022] DELETE /identity/v3/projects/29f811fd0e7f414493d04397200a7e4b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:21.635623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1579a-9553-4030-83d0-b22aeebcda20 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.635923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1579a-9553-4030-83d0-b22aeebcda20 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.636237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1579a-9553-4030-83d0-b22aeebcda20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.665734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-67e1579a-9553-4030-83d0-b22aeebcda20 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:21.666963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-67e1579a-9553-4030-83d0-b22aeebcda20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.686698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:21.721177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:21.746538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:21.747195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.747530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.748106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] PATH_INFO: `/v3/projects/bc79be4099ee41958f327ebd66852534` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.751737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc79be4099ee41958f327ebd66852534)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:21.751737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:21.798094 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3534/7097] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:21.807445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:21.808183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:21.808633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:21.844419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc79be4099ee41958f327ebd66852534', 'request_id': 'req-fbe8275b-f45e-4fe2-878b-47cd1801dac7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.856952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc79be4099ee41958f327ebd66852534', 'request_id': 'req-fbe8275b-f45e-4fe2-878b-47cd1801dac7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.857527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:21.860045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.874509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc79be4099ee41958f327ebd66852534', 'request_id': 'req-fbe8275b-f45e-4fe2-878b-47cd1801dac7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.900525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] The token cache is being invalidate because project bc79be4099ee41958f327ebd66852534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:21.900828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.903656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:21.907709 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3564/7098] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:21 2022] DELETE /identity/v3/projects/bc79be4099ee41958f327ebd66852534 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:21.912091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.914727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.976236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3535/7099] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:21.977193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:21.979137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:21.994327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ea0e-1c78-438c-8f85-9aa4b86bcd39 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.000860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.001714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.002401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.002821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] PATH_INFO: `/v3/projects/34282096eef64660ad8b175ca67a4c92` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.004719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=34282096eef64660ad8b175ca67a4c92)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.007459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.042622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8275b-f45e-4fe2-878b-47cd1801dac7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.051399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.052360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.052748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.052873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] PATH_INFO: `/v3/users/fd0aa865feb84ef388eb64a6ef10eb66` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.054284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0aa865feb84ef388eb64a6ef10eb66)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.056370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.088834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34282096eef64660ad8b175ca67a4c92', 'request_id': 'req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.096023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34282096eef64660ad8b175ca67a4c92', 'request_id': 'req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.111739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34282096eef64660ad8b175ca67a4c92', 'request_id': 'req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.125992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0aa865feb84ef388eb64a6ef10eb66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.127450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0aa865feb84ef388eb64a6ef10eb66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.133103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] The token cache is being invalidate because project 34282096eef64660ad8b175ca67a4c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:22.133710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.137821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.139531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3536/7100] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:21 2022] DELETE /identity/v3/projects/34282096eef64660ad8b175ca67a4c92 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:22.142767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0aa865feb84ef388eb64a6ef10eb66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.145578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.149002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.149845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:22.158183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0aa865feb84ef388eb64a6ef10eb66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.158898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0aa865feb84ef388eb64a6ef10eb66'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.193932 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3565/7101] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:21 2022] DELETE /identity/v3/users/fd0aa865feb84ef388eb64a6ef10eb66 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:22.193932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.193932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.302565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:22.307521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a7a6-8050-45cf-af5a-8d89ef8e51fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.309142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd34f96-4dfc-4f5b-82b4-c342c28ec1ed admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.317601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.318304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.318587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.318908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] PATH_INFO: `/v3/users/a24a9c5cdd344c9baa8c6ef3641728a3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.320434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24a9c5cdd344c9baa8c6ef3641728a3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.322905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.324163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.325070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.325353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.325716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.326588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:22.326895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.329618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.350741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3537/7102] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:22.356654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.362089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.392660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182739-23bc-4e0f-94b5-12abbf35c13d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.401111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.402030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.402479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.402920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.404053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.406596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.409092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24a9c5cdd344c9baa8c6ef3641728a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.411375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24a9c5cdd344c9baa8c6ef3641728a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.429740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24a9c5cdd344c9baa8c6ef3641728a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.450591 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3538/7103] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:22 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:22.451907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24a9c5cdd344c9baa8c6ef3641728a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.455094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24a9c5cdd344c9baa8c6ef3641728a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.460220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.462149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.509353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3566/7104] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:22 2022] DELETE /identity/v3/users/a24a9c5cdd344c9baa8c6ef3641728a3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:22.576600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fe83-c0bc-43ac-9dda-22d2a98fa584 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.664166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.665708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.667583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.668855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.669358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.669719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.671007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.674565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.689654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b36e-4c34-4b0e-a737-4acd611f426f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.703949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.704714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.705032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.705306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] PATH_INFO: `/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.706840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5688eb4d0ecf42ff829690f8f7ea389a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.708888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.712703 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3539/7105] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:22 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:22.721191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.746077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7027979-5f81-4e76-b94e-78c7666ee03a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.762086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.762814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.763165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.763506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.765879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.767579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.788462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3540/7106] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:22.789894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.805197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0a59-8d2a-40cd-b95e-270521942c35 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:22.810572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5688eb4d0ecf42ff829690f8f7ea389a', 'request_id': 'req-bae729f6-f910-400e-88b0-740b6d09d978'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.814052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:22.829896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5688eb4d0ecf42ff829690f8f7ea389a', 'request_id': 'req-bae729f6-f910-400e-88b0-740b6d09d978'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.882181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:22.887320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5688eb4d0ecf42ff829690f8f7ea389a', 'request_id': 'req-bae729f6-f910-400e-88b0-740b6d09d978'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.895951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:22.896791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.902235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.903617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.906419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:22.914575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:22.939298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] The token cache is being invalidate because project 5688eb4d0ecf42ff829690f8f7ea389a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:22.941334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.942992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bae729f6-f910-400e-88b0-740b6d09d978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:22.945437 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3567/7107] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:22 2022] DELETE /identity/v3/projects/5688eb4d0ecf42ff829690f8f7ea389a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:22.954099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa16b7-afad-4b71-a403-f09c2c9093af None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:22.954099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa16b7-afad-4b71-a403-f09c2c9093af None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:22.954099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa16b7-afad-4b71-a403-f09c2c9093af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:22.954487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3541/7108] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:22.957844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:22.961440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:22.995298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b071f-7e12-46b5-9c84-d6c54c94f8a1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.006911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-55fa16b7-afad-4b71-a403-f09c2c9093af None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:23.008774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.011023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.011561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.012295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55fa16b7-afad-4b71-a403-f09c2c9093af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:23.012819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] PATH_INFO: `/v3/projects/17bd57af51bd4d71a3b2c6908e86462d/users/f1bf4b13cd36489189844d1654816b87/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.033510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3568/7109] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:23.042227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.042645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.043020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.049471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bd57af51bd4d71a3b2c6908e86462d, user_id=f1bf4b13cd36489189844d1654816b87, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.057339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954ce63-cec4-49dc-bf58-7659fc3008e3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.096649 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3542/7110] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:22 2022] PUT /identity/v3/projects/17bd57af51bd4d71a3b2c6908e86462d/users/f1bf4b13cd36489189844d1654816b87/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:23.096882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:23.096882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:23.098733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.099122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.099494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.141498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] MFA Rules not processed for user `f1bf4b13cd36489189844d1654816b87`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:23.143522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:23.197402 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3569/7111] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:23.256317 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3543/7112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:23.265340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.287447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87018f37-c7f4-42a3-bc9e-ebbaa01bfcd9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.298812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.305703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.306395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.306674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.306947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.307602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.310013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.318121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca7a0-4e06-47a9-9cf0-b9b8326dd8f2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.325895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.326530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.326819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.327877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.329150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:23.330039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.331861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.354844 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3544/7113] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:23.355377 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3570/7114] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:23.355847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.357645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.384264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31665-a207-4f35-8a63-883d64474204 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.460503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.461277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.461837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.462170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.462815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.465100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.483731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0426b-2053-494d-8421-d8dbc2aae3cf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.499317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.502231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.502529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.502806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.503845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.505998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.508139 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3545/7115] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:23.515694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.573049 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3571/7116] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:23.573243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:23.578915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.589459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:23.622564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6ab44-e25c-4a64-9d23-45b79d653e92 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.720558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669343-3887-459a-bcc9-72a1c146c21b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.734467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:23.735814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.736630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.737146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.737632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.755129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.762472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.789722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.790669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.790950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.791216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] PATH_INFO: `/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.793667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d5fffebb8f4d5482963ab8ad543d0f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.794809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.840923 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3546/7117] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:23 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:23.843052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.867373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7ea7-1ed3-4923-9e6c-abb004d2db2f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:23.886424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:23.887109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:23.887393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:23.887830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:23.889359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:23.900631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:23.931637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d5fffebb8f4d5482963ab8ad543d0f', 'request_id': 'req-2995ef77-8ff2-4679-b015-01720d6b8c7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:23.942042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3547/7118] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:23.945712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:23.959409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d5fffebb8f4d5482963ab8ad543d0f', 'request_id': 'req-2995ef77-8ff2-4679-b015-01720d6b8c7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:23.978379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d5fffebb8f4d5482963ab8ad543d0f', 'request_id': 'req-2995ef77-8ff2-4679-b015-01720d6b8c7f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:23.989469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cedb4-9d02-4bfb-960f-87e7a56ebad7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.005744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] The token cache is being invalidate because project 07d5fffebb8f4d5482963ab8ad543d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:24.006385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:24.007508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:24.014903 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3572/7119] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:23 2022] DELETE /identity/v3/projects/07d5fffebb8f4d5482963ab8ad543d0f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:24.016012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.017782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:24.141021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.142413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.142793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.143163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.144158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.146043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3845f0a-919d-429f-a86b-a4c9ed5f3e35 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.167624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3548/7120] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:24.169992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.172427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.172844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.214741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:24.216868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:24.235243 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3549/7121] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:24.236375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.238412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:24.298223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329e21-ad40-4720-9015-1ea3fe2ba638 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.316575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.317219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.317495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.320212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.320886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.326795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc0502-6f5f-4c55-b30e-1a9341e83805 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.331864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ef77-8ff2-4679-b015-01720d6b8c7f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.353517 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3550/7122] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:24.353517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.353517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.353517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.356557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.363938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.364239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.364630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] PATH_INFO: `/v3/projects/b032f3e8adca49e89585c633e38d5753/users/b348f62fbaa543569eab33dc5ef92678/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.398934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:24.403522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:24.431878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3551/7123] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:24.439487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.455960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b032f3e8adca49e89585c633e38d5753, user_id=b348f62fbaa543569eab33dc5ef92678, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.459412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d5a4-9ba9-4ab4-83ce-209b398dd8c4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.462890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.467005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.468831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.469140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.469411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] PATH_INFO: `/v3/projects/b2e2d4ffd2d84dbe8166fb46c52fbca9/users/b9ad52d9dbe24372ad74730b94ac9cfa/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.497212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3573/7124] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:24 2022] PUT /identity/v3/projects/b032f3e8adca49e89585c633e38d5753/users/b348f62fbaa543569eab33dc5ef92678/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:24.497861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.514290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e2d4ffd2d84dbe8166fb46c52fbca9, user_id=b9ad52d9dbe24372ad74730b94ac9cfa, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.517110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.553485 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3552/7125] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:24 2022] PUT /identity/v3/projects/b2e2d4ffd2d84dbe8166fb46c52fbca9/users/b9ad52d9dbe24372ad74730b94ac9cfa/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:24.554853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.621965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:24.634424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ab4-1183-4b9b-a9cf-599b14cb4f90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.735864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:24.745776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933edf5-8e05-4fbb-a829-9ab3a88ce2c0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.754025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.754787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.755170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.755620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.756371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.758373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1199b-68c0-40be-9706-3b78136be4cd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.761547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.763459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.764993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.767087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.768211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:24.769325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.778064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3553/7126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:24.778064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e2bc-4a4a-4462-88f5-427c36207fd6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.778064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e2bc-4a4a-4462-88f5-427c36207fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.780125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e2bc-4a4a-4462-88f5-427c36207fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.781076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.823119 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3574/7127] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:24.826426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:24.855240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a8956-c646-44e1-8da7-b57512629fa9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:24.866179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c0e0e2bc-4a4a-4462-88f5-427c36207fd6 None None] MFA Rules not processed for user `b9ad52d9dbe24372ad74730b94ac9cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:24.867634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0e0e2bc-4a4a-4462-88f5-427c36207fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:24.868681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:24.869447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:24.869722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:24.869989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] PATH_INFO: `/v3/projects/b032f3e8adca49e89585c633e38d5753/users/b348f62fbaa543569eab33dc5ef92678/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:24.874107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b032f3e8adca49e89585c633e38d5753, user_id=b348f62fbaa543569eab33dc5ef92678, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:24.880208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:24.920503 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3575/7128] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:24 2022] PUT /identity/v3/projects/b032f3e8adca49e89585c633e38d5753/users/b348f62fbaa543569eab33dc5ef92678/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:24.921597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.014060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3554/7129] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:25.016030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.016411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.016870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.056873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] MFA Rules not processed for user `b348f62fbaa543569eab33dc5ef92678`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:25.058543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:25.092407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770231a5-fc4d-48ee-a11c-aeb0daa42eef admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.100309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.101282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.101785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.102061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.103110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.105371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.145816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3576/7130] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:24 2022] POST /identity/v3/projects => generated 395 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:25.146512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.177487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3555/7131] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:25.180474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.209226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6d115-81bf-4aee-8c0b-11c37c200f33 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.248065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2d97-8a99-485b-ae3f-cf3c2f98348f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.254963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.255850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.256841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.257309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.258159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.260458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.333132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:25.334551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.335045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.335484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.335841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.336586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.338741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.363185 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3577/7132] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:25 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:25.365182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.367494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:25.368508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:25.396301 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3556/7133] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:25 2022] POST /identity/v3/users => generated 304 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:25.397518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.419195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b30b-ff1f-42f8-a5b3-02c776f09d4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.557901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd246d-3d26-4129-acc8-e2acd0dbe145 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.568378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.569950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.570606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.572643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.586028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.586028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.586028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.586028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.600715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.602964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.661165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3557/7134] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:25 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:25.665033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.691177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd28b1-7b70-46b2-8669-cd7ea37073e7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.708688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.709743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.710028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.710301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.710958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.712684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.734329 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3558/7135] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:25.735195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.753760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.756571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.776704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fef8b-0ce5-4f54-be4a-468d9e6bee08 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.791878 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3578/7136] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:25.792737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.793579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.794409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.795463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.796498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.797684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.803614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.806646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17f81-1381-486c-b369-45c7a728749e service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.813719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.814557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.814842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.815262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] PATH_INFO: `/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c/users/b8d5376f488b41fdb3e766638e3834d1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.829714 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3559/7137] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:25.830658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.857730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28bea-481d-4ce7-b21d-3155e2c49030 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:25.873062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:25.873688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:25.873963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:25.874238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:25.874872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.879517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed4abc5ecd043f4a062360ef1c1801c, user_id=b8d5376f488b41fdb3e766638e3834d1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:25.886345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.887199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:25.910861 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3560/7138] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:25.912696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.930273 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3579/7139] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:25 2022] PUT /identity/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c/users/b8d5376f488b41fdb3e766638e3834d1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:25.931631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:25.965204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d592e-63bb-4247-a856-ec21bfced19c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.025716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23494011-0f80-4e7f-bb97-769f8690b901 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.031953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.032704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.033132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.033522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.034309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.036891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.051465 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3580/7140] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:26.052129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.073635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:26.117459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.118138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.118411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.118681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] PATH_INFO: `/v3/projects/b676a3631c0e4f2a80be23ddfc0643d2/users/0d3316b60ef54e4ea5c3ecef763da05a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.143267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b676a3631c0e4f2a80be23ddfc0643d2, user_id=0d3316b60ef54e4ea5c3ecef763da05a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.147732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.153210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f759e6-9edf-4dec-a55d-bd3e08fded52 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.157551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.158180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.158442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.159040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.161114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.163986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3561/7141] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:25 2022] PUT /identity/v3/projects/b676a3631c0e4f2a80be23ddfc0643d2/users/0d3316b60ef54e4ea5c3ecef763da05a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:26.164857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.230219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:26.256921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.258453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.269115 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3581/7142] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:26.278109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.283386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.287963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d5ced-a7c3-4694-bb4e-48620ea66253 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.302173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.303049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.303332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.303694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] PATH_INFO: `/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c/users/b8d5376f488b41fdb3e766638e3834d1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.307134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed4abc5ecd043f4a062360ef1c1801c, user_id=b8d5376f488b41fdb3e766638e3834d1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.318909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423754a-6405-46e9-95f4-344902512213 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.319437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05101-bf4f-4417-8f0b-4424e9e936d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.329549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.330965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.331573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.332143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] PATH_INFO: `/v3/users/d0ad1f9adfff479088aa1f6826f93c53` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.334274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ad1f9adfff479088aa1f6826f93c53)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.338885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.355351 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3562/7143] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:26 2022] PUT /identity/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c/users/b8d5376f488b41fdb3e766638e3834d1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:26.367227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ecfa-b1a1-4262-99e6-6e9808a1bafc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.368178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ecfa-b1a1-4262-99e6-6e9808a1bafc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.374921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831ecfa-b1a1-4262-99e6-6e9808a1bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.419271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ad1f9adfff479088aa1f6826f93c53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:26.420183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ad1f9adfff479088aa1f6826f93c53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:26.437553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6831ecfa-b1a1-4262-99e6-6e9808a1bafc None None] MFA Rules not processed for user `0d3316b60ef54e4ea5c3ecef763da05a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:26.439146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6831ecfa-b1a1-4262-99e6-6e9808a1bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.439328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ad1f9adfff479088aa1f6826f93c53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:26.450996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ad1f9adfff479088aa1f6826f93c53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:26.451869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d6714a2-f47b-4f17-baaf-35a807ebfa93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ad1f9adfff479088aa1f6826f93c53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:26.481622 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3582/7144] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:26 2022] DELETE /identity/v3/users/d0ad1f9adfff479088aa1f6826f93c53 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:26.481622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.481622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.481622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.548111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] MFA Rules not processed for user `b8d5376f488b41fdb3e766638e3834d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:26.552029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.582573 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3563/7145] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:26.586379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.586665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.589810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.591684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:26.626044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:26.628131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.661777 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3583/7146] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:26.662914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.664423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.752570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3564/7147] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:26.753567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.756413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.771466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582681-5657-4e7b-a415-b822678e5dc2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.778473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.779092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.779357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.779624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.780383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.782472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.787070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ab8f-de37-458d-a266-f96eefa57d54 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.792355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.793522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.793522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.793868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.794649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.796793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.829635 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3565/7148] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:26.833222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.836489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3584/7149] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:26.837536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.837767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:26.905613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:26.916887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b7bd6-50cd-42f6-9fc2-6b20d5e4a9f4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.922138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.922756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.923045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.923450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.924119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.926782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.930131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5750f-ff39-4063-9270-bb223fa77f34 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.952162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3585/7150] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:26.953015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:26.964185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48d85-f221-4b13-a5ab-6199201de6d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:26.970991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.971837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.972750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.973050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:26.973725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:26.975691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:26.992397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:26.993036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:26.993315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:26.993644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.001016 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3586/7151] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:26 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:27.001016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.004549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.008389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.013575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683229c-0daf-44c5-b9ef-181919bea347 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.022372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.023866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.024120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.024496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.026168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.028599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.036414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3566/7152] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:27.040433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.062849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d475ce-c8c9-493d-b1ce-ac0392ce0942 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.066443 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3587/7153] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:27.067549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.077601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.078235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.078511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.078775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.079430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.081887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.089203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba03d-694e-422c-bb66-3a062d737c23 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.093408 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3567/7154] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:27.097618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.101607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.102495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.104107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.105273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.106964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.112303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.112548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780f25a-77d1-4dad-a6d3-428380cbbbf5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.120275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.121247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.121804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.123110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] PATH_INFO: `/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70/users/b079f31f171845aea8a964145d989b7c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.126210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:27.141168 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3588/7155] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:27.142694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.164279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc3b90e27f4801a7c4dd211fa13f70, user_id=b079f31f171845aea8a964145d989b7c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.165957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39317db-0335-4231-9630-8fbcf58aff61 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.168196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.175658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.176451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.176867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.177183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] PATH_INFO: `/v3/projects/c3cad12c9232438ba6e6e80923c756ef/users/00c9c8b6d1744346b86a5cf44aa6c058/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.193297 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3568/7156] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:27 2022] PUT /identity/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70/users/b079f31f171845aea8a964145d989b7c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:27.194301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.204954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cad12c9232438ba6e6e80923c756ef, user_id=00c9c8b6d1744346b86a5cf44aa6c058, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.209171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d385c-6234-42eb-a87f-464d5c2e7907 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.229621 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3589/7157] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:27 2022] PUT /identity/v3/projects/c3cad12c9232438ba6e6e80923c756ef/users/00c9c8b6d1744346b86a5cf44aa6c058/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:27.241410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.241827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.242114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.282718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cb867-7f3c-43a3-a9ec-c50a789553f9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.301595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] MFA Rules not processed for user `00c9c8b6d1744346b86a5cf44aa6c058`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:27.304138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.380691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.381570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.382089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.382563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.383326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.385256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.404258 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3569/7158] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:27.422480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.434207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:27.441340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9c8d8-c906-4f62-971e-f90c7cbd575f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.458086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.458768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.459046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.459315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] PATH_INFO: `/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70/users/b079f31f171845aea8a964145d989b7c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.462810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc3b90e27f4801a7c4dd211fa13f70, user_id=b079f31f171845aea8a964145d989b7c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.466364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e111cba-df12-465f-a7e5-9f24840a181b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.515326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3590/7159] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:27.527860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.530370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3570/7160] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:27 2022] PUT /identity/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70/users/b079f31f171845aea8a964145d989b7c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:27.531693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.531845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.532137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.532408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.567183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960434d7-0dda-42ff-9067-16e0d40c7e61 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.618866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] MFA Rules not processed for user `b079f31f171845aea8a964145d989b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:27.620112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.648519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.649584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.649976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.650345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] PATH_INFO: `/v3/projects/012c9929d260430bbefa28af31acb486` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.651642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=012c9929d260430bbefa28af31acb486)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.654254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.747865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012c9929d260430bbefa28af31acb486', 'request_id': 'req-da899649-77c1-4d51-a0f8-9a507d37991c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:27.765405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012c9929d260430bbefa28af31acb486', 'request_id': 'req-da899649-77c1-4d51-a0f8-9a507d37991c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:27.780370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3571/7161] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:27.781738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.783535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.789362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012c9929d260430bbefa28af31acb486', 'request_id': 'req-da899649-77c1-4d51-a0f8-9a507d37991c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:27.797351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:27.820343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] The token cache is being invalidate because project 012c9929d260430bbefa28af31acb486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:27.821066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:27.823297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:27.826358 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3591/7162] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:27 2022] DELETE /identity/v3/projects/012c9929d260430bbefa28af31acb486 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:27.827374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.829002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.926103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da899649-77c1-4d51-a0f8-9a507d37991c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.931195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.931940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.932675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.932931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.936154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.974455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba39dd-588c-4036-a3d2-6e82a4303005 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:28.048506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:28.050350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f897ff1-e7c4-4cf1-864a-1c91dd7929ee service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:28.070188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:28.072139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.072396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.072995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.073923 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3592/7163] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:28.077271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:28.078507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.079025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.079951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.144937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:28.149347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:28.155134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:28.268807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:28.275006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4e393-6b8e-4f73-9f82-2cc61e8d2e89 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:28.299946 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3572/7164] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:28.378772 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3593/7165] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:28.386680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.387104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.387469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.488964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:28.493860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:28.538810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:28.547396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3573/7166] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:28.559138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeccbc3-cbb8-408c-bb5a-67274498bf9f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:28.577529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:28.578381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.578735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.582282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.583009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:28.583322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:28.584998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:28.641385 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3594/7167] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:28.646118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:28.660505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce5934-f01a-4501-8220-0fce27f961eb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:28.689638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:28.694403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.694693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.694971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.695633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:28.704411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:28.781066 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3574/7168] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:28 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:28.785379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:28.831077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf21cc-50be-4dd0-8665-e745be7c96d2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:28.913281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:28.955374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:28.957542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:28.957926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:28.958301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:28.960413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:28.963309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.016560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3595/7169] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:28 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:29.017768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.037381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d92ed8-e03a-4a8d-a5a7-921b942ec153 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.054685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.056747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.057388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.059525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.060251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.065867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.095608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.107285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3575/7170] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:29.111768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70e8a0-5094-48a3-9793-00231df44e5a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.117380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.118284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.118660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.119024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.119896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.121926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.141452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.152591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3596/7171] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:29.162536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110a75-68f6-4ae4-a9a7-3503d4c7142a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.186457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.188543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.188836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.189147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] PATH_INFO: `/v3/projects/e245b515c60346589fb7b3e6a755951f/users/85514cecef26474ba893c3cf3d0d92e7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.241945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e245b515c60346589fb7b3e6a755951f, user_id=85514cecef26474ba893c3cf3d0d92e7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.249943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82718600-491f-4dfb-9207-53c2855c8a63 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.284691 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3576/7172] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:29 2022] PUT /identity/v3/projects/e245b515c60346589fb7b3e6a755951f/users/85514cecef26474ba893c3cf3d0d92e7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:29.295654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.297783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:29.309681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.310240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.311453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.328799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605813-986e-4b67-ac47-954f8558bd90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.380303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] MFA Rules not processed for user `85514cecef26474ba893c3cf3d0d92e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:29.381636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:29.449827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.450503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.457165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.457496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] PATH_INFO: `/v3/users/b8d5376f488b41fdb3e766638e3834d1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.458875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d5376f488b41fdb3e766638e3834d1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.460963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.540209 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3577/7173] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:29.544265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.549701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d5376f488b41fdb3e766638e3834d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:29.551038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d5376f488b41fdb3e766638e3834d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:29.573160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d5376f488b41fdb3e766638e3834d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:29.584600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9644ff-e418-4584-b93e-9c6c7ba92fd0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.593884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.594707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.595167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.595606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.596430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.599323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db005bf7-3982-411f-aeb0-22d318393bb3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.602937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d5376f488b41fdb3e766638e3834d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:29.607034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d5376f488b41fdb3e766638e3834d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:29.664422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3597/7174] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:29 2022] DELETE /identity/v3/users/b8d5376f488b41fdb3e766638e3834d1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:29.664422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.664797 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3578/7175] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:29 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:29.665156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:29.666334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.666695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.667044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.699904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:29.701252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:29.739123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:29.741868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:29.801508 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3579/7176] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:29.809409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70b33-6ffa-4c9e-9dc2-e456df9d0406 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.813779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.825484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:29.839930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.840797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.841596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.842344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.843196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.845421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.947068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3598/7177] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:29 2022] POST /identity/v3/users => generated 300 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:29.950991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:29.957452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032b83-aab8-4687-9389-590d4b65f92c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.961275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.961898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.962185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.962444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.972507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8f41-4e7c-46e3-9924-ffc5cf94d555 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:29.973723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:29.975156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:29.988689 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3580/7178] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:29.990527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:29.991171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:29.991457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:29.991734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:29.992392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:30.002762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e86897-f008-4647-bd50-cb54ec06f8f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:30.018061 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3599/7179] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:30.023209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:30.057924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7fd2c-38c5-4a14-8e15-c39d6e686060 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:30.077714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:30.078479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:30.078828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:30.079203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] PATH_INFO: `/v3/projects/9ba2aa43729147b8b94df5b856ebeb24/users/fbbc609c51104ca8810d30e678bf36b2/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:30.099781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2aa43729147b8b94df5b856ebeb24, user_id=fbbc609c51104ca8810d30e678bf36b2, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:30.104250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:30.134608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3581/7180] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:30 2022] PUT /identity/v3/projects/9ba2aa43729147b8b94df5b856ebeb24/users/fbbc609c51104ca8810d30e678bf36b2/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:30.153211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:30.153798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:30.154273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:30.225623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] MFA Rules not processed for user `fbbc609c51104ca8810d30e678bf36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:30.227203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:30.329909 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3600/7181] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:30 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:30.392952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:30.394940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:30.518579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf7fa-15ab-4989-b567-6dfa06148824 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:30.525483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:30.526559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:30.527159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:30.527630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:30.558026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:30.567674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:30.580495 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3582/7182] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:30.708666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:30.712506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:30.902194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f7c12-bcba-421d-97e8-d6ae5feac350 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:30.908728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:30.909556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:30.909877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:30.910191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:30.912855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:30.930455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:30.932288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:30.949719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3601/7183] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:31.490573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:31.492067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:31.621474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:31.687652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75be1-4c45-4cc8-b49d-046b9023729f service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:31.704611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:31.706034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:31.706562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:31.707051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:31.709740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:31.735876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:31.825512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:31.855300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:31.856783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:31.869733 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3583/7184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:31.870934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:31.883489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:31.913012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8624eb1-9aff-4862-ae17-19104f72aefb service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:31.925732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:31.926673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:31.927154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:31.927380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3eb9-f571-4be4-9efd-b333b23a15d7 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:31.927770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] PATH_INFO: `/v3/users/85514cecef26474ba893c3cf3d0d92e7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:31.932534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85514cecef26474ba893c3cf3d0d92e7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:31.934903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:31.941856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:31.942658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:31.943040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:31.943416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] PATH_INFO: `/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:31.945848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed4abc5ecd043f4a062360ef1c1801c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:31.948229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:32.059522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85514cecef26474ba893c3cf3d0d92e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.064127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85514cecef26474ba893c3cf3d0d92e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.078912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85514cecef26474ba893c3cf3d0d92e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.082288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed4abc5ecd043f4a062360ef1c1801c', 'request_id': 'req-6c15ec34-c5bc-4786-a05e-a14cefd1b170'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.094518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85514cecef26474ba893c3cf3d0d92e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.095426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fcb4b3ad-c868-4d1f-a3b0-a257348c792e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85514cecef26474ba893c3cf3d0d92e7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.101289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed4abc5ecd043f4a062360ef1c1801c', 'request_id': 'req-6c15ec34-c5bc-4786-a05e-a14cefd1b170'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.117861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed4abc5ecd043f4a062360ef1c1801c', 'request_id': 'req-6c15ec34-c5bc-4786-a05e-a14cefd1b170'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.132914 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3602/7185] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:31 2022] DELETE /identity/v3/users/85514cecef26474ba893c3cf3d0d92e7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:32.140634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:32.140928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:32.141445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:32.148938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] The token cache is being invalidate because project 6ed4abc5ecd043f4a062360ef1c1801c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:32.149241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.151177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.156796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3584/7186] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:31 2022] DELETE /identity/v3/projects/6ed4abc5ecd043f4a062360ef1c1801c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:32.160641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:32.162866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:32.207050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:32.208634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:32.305021 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3603/7187] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:32.316831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:32.318419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:32.358694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ec34-c5bc-4786-a05e-a14cefd1b170 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:32.373323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:32.373907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:32.374135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:32.374729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] PATH_INFO: `/v3/users/00c9c8b6d1744346b86a5cf44aa6c058` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:32.376997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c9c8b6d1744346b86a5cf44aa6c058)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:32.379008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:32.414261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:32.447906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beebc4c-9d65-4abe-8bae-b6c725e2a0fc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:32.454339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:32.455287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:32.455715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:32.456897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:32.479234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:32.484194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:32.491134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:32.495114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c9c8b6d1744346b86a5cf44aa6c058'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.499733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c9c8b6d1744346b86a5cf44aa6c058'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.502262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c9c8b6d1744346b86a5cf44aa6c058'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.521784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c9c8b6d1744346b86a5cf44aa6c058'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.529514 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3604/7188] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:32.530977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c9c8b6d1744346b86a5cf44aa6c058'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:32.559684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3585/7189] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:32 2022] DELETE /identity/v3/users/00c9c8b6d1744346b86a5cf44aa6c058 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:32.982987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:32.985019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:33.040191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f5d9f-fcde-4689-a60b-fe0bf9cca608 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:33.057002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:33.058812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:33.178851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45eada-e5e2-49f2-b379-21c43cd00814 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:33.189435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:33.190041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:33.191005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:33.191293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] PATH_INFO: `/v3/projects/e245b515c60346589fb7b3e6a755951f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:33.192518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e245b515c60346589fb7b3e6a755951f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:33.194757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:33.195898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:33.196534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:33.196803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:33.197097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:33.202255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:33.316654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e245b515c60346589fb7b3e6a755951f', 'request_id': 'req-3b2fea72-b5b8-4a01-a314-ad3b7971e178'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:33.388471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e245b515c60346589fb7b3e6a755951f', 'request_id': 'req-3b2fea72-b5b8-4a01-a314-ad3b7971e178'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:33.423594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e245b515c60346589fb7b3e6a755951f', 'request_id': 'req-3b2fea72-b5b8-4a01-a314-ad3b7971e178'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:33.513448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:33.516716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:33.543951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] The token cache is being invalidate because project e245b515c60346589fb7b3e6a755951f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:33.554478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:33.557416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:33.562656 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3605/7190] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:32 2022] DELETE /identity/v3/projects/e245b515c60346589fb7b3e6a755951f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:33.574800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:33.579770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:33.583611 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3586/7191] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:33.875931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fea72-b5b8-4a01-a314-ad3b7971e178 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:33.900664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:33.904177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:33.904567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:33.904987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] PATH_INFO: `/v3/users/fbbc609c51104ca8810d30e678bf36b2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:33.908768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbc609c51104ca8810d30e678bf36b2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:33.911034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:33.929689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:33.932601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:33.963153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc852-34e0-4ad5-a136-4be60174b2be service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:33.971933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:33.974334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:33.975315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:33.975737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:33.976128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] PATH_INFO: `/v3/projects/c3cad12c9232438ba6e6e80923c756ef` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:33.978276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cad12c9232438ba6e6e80923c756ef)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:33.985773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.004822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbc609c51104ca8810d30e678bf36b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.005997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbc609c51104ca8810d30e678bf36b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.027903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbc609c51104ca8810d30e678bf36b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.036688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbc609c51104ca8810d30e678bf36b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.045383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e943f287-1b3a-4e1a-832e-9b883751933c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbc609c51104ca8810d30e678bf36b2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.071887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:34.089405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cad12c9232438ba6e6e80923c756ef', 'request_id': 'req-f8fbb28b-1790-4e11-b714-ab87c41a21a9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.091904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3606/7192] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:33 2022] DELETE /identity/v3/users/fbbc609c51104ca8810d30e678bf36b2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:34.099528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cad12c9232438ba6e6e80923c756ef', 'request_id': 'req-f8fbb28b-1790-4e11-b714-ab87c41a21a9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.112100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cad12c9232438ba6e6e80923c756ef', 'request_id': 'req-f8fbb28b-1790-4e11-b714-ab87c41a21a9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.164947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] The token cache is being invalidate because project c3cad12c9232438ba6e6e80923c756ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:34.168713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.169742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f8fbb28b-1790-4e11-b714-ab87c41a21a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:34.194353 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3587/7193] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:33 2022] DELETE /identity/v3/projects/c3cad12c9232438ba6e6e80923c756ef => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:34.199673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.200173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.200614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.240117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:34.241645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:34.364838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3607/7194] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:34.367897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.368717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.369288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.459303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:34.464939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:34.506443 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3588/7195] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:34.511442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:34.525950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6fb3-792d-4097-8fe8-db7890c4bef8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:34.547072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:34.547716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.547997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.548269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.548952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:34.549258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:34.553320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.601639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:34.607353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3608/7196] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:34.615807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef731-6b51-439c-ad55-d93b9ad6fa46 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:34.622860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:34.623727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.624064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.624338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.625024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:34.627212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.678642 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3589/7197] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:34 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:34.682523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:34.700881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2503b3e-d73a-48c5-b293-f3e4905bb2b0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:34.743125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:34.745354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:34.821578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:34.822542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.823011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.823451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.824293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:34.829366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.875605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3609/7198] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:34 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:34.879621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:34.939871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23657c6-8841-4d60-a576-03104b0a9f6c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:34.950966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090ec9-07cb-4214-b91b-17784a3e9398 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:34.953641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:34.954274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.956966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.957375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.958048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:34.961956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.971308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:34.972994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:34.973454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:34.973726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] PATH_INFO: `/v3/projects/9ba2aa43729147b8b94df5b856ebeb24` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:34.974974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba2aa43729147b8b94df5b856ebeb24)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:34.981550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:34.996943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3610/7199] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:35.004613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.028761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920779e-01cf-4d70-9b08-cdea280c790f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.069551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.071428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.072921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.074244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] PATH_INFO: `/v3/projects/535a35778add402b98b973a27a280a55/users/37c36c41592244e19502153054bb7d5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.084959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba2aa43729147b8b94df5b856ebeb24', 'request_id': 'req-4010372a-50ea-4126-ae78-d75df3f0585f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:35.091367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba2aa43729147b8b94df5b856ebeb24', 'request_id': 'req-4010372a-50ea-4126-ae78-d75df3f0585f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:35.097913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:35.102601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba2aa43729147b8b94df5b856ebeb24', 'request_id': 'req-4010372a-50ea-4126-ae78-d75df3f0585f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:35.120142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=535a35778add402b98b973a27a280a55, user_id=37c36c41592244e19502153054bb7d5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.125756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.134659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] The token cache is being invalidate because project 9ba2aa43729147b8b94df5b856ebeb24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:35.135047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:35.136709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4010372a-50ea-4126-ae78-d75df3f0585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:35.160967 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3590/7200] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:34 2022] DELETE /identity/v3/projects/9ba2aa43729147b8b94df5b856ebeb24 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:35.166415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb263-9954-466d-9210-dab1009a6746 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.168064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb263-9954-466d-9210-dab1009a6746 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.168422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb263-9954-466d-9210-dab1009a6746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.180694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3611/7201] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:35 2022] PUT /identity/v3/projects/535a35778add402b98b973a27a280a55/users/37c36c41592244e19502153054bb7d5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:35.181922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.184050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:35.214042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f00bb263-9954-466d-9210-dab1009a6746 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:35.217363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f00bb263-9954-466d-9210-dab1009a6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:35.288239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:35.353759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06088-fcd4-49b5-a198-ad026ae6cf9f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.360782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.361766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.362216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.362721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.363491 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3591/7202] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:35.363734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.365700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.381897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.382433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.382958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.390064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3612/7203] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:35.395039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.427347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:35.429544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d937-2797-4915-993a-afc5c0608300 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.430166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:35.443111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.443798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.444079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.444430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] PATH_INFO: `/v3/projects/535a35778add402b98b973a27a280a55/users/37c36c41592244e19502153054bb7d5c/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.445207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3592/7204] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:35.446204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.448458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=535a35778add402b98b973a27a280a55, user_id=37c36c41592244e19502153054bb7d5c, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.451158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3846ad-5453-48ff-be3b-037361bef43b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.458709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7c1ef-2e5a-44db-bec3-61c04f3f5f43 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.465416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.466153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.466531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.467047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.468082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:35.468484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.470220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.490707 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3613/7205] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:35 2022] PUT /identity/v3/projects/535a35778add402b98b973a27a280a55/users/37c36c41592244e19502153054bb7d5c/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:35.492218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.492504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.492987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.493434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3593/7206] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:35.497167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.518422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04382be7-9a48-4b47-83a8-801796925992 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.582032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] MFA Rules not processed for user `37c36c41592244e19502153054bb7d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:35.589202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:35.734919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.737032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.739027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.740376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.744336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.748849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.751270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3614/7207] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:35.755198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.780296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf846fb-1ee0-48a4-9970-edca38c0e204 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:35.791480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:35.792094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:35.792408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:35.792662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:35.793352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:35.795280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:35.810547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3594/7208] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/projects => generated 371 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:35.811860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.861452 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3615/7209] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:35.865817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:35.960558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:35.973158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078aa6-3fec-4725-8e1e-001de92bc1cc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.051903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:36.074024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e517-1d66-4c35-bb71-1e3c21c82c91 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.086768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.089659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.090028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.090645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.091625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.095990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.121724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.122832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.124581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.130093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.133339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.135656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.148802 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3616/7210] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:36.155716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.176376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8d2da-d4d6-4587-aa89-bdbf1cd58146 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.191176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.191806 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3595/7211] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:35 2022] POST /identity/v3/users => generated 286 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:36.195304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.195665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.196129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.197050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.197637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.198831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.216146 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3617/7212] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:36.217652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.229360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815faee4-d44a-4a64-9a53-a09255a21c77 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.231920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2152f-30b7-49b2-8ae2-827fb40c8fc8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.239244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.240010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.240415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.240754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.241707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.243156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.248483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.248757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.249059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.249731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.251364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.255466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.279015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3618/7213] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:36.280678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.293472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3596/7214] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:36.293472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.324467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ceb38-132c-419c-9a1f-f097eb3c0024 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.333526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.335054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.335559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.336279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] PATH_INFO: `/v3/projects/6f589377334a4813957f5b951e5f3741/users/be00558fb425448b89f7286612b16c51/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.339381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d91da-85d6-452a-b08c-febb324317aa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.360556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f589377334a4813957f5b951e5f3741, user_id=be00558fb425448b89f7286612b16c51, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.361512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.362193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.362514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.362781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.363417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.365023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce55e1-1760-4d24-9cd7-c8c7f661d180 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.366128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.399995 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3597/7216] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:36.401241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.401551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.402935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3619/7216] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:36 2022] PUT /identity/v3/projects/6f589377334a4813957f5b951e5f3741/users/be00558fb425448b89f7286612b16c51/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:36.404184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.411813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.480095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] MFA Rules not processed for user `be00558fb425448b89f7286612b16c51`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:36.481492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:36.512669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4d63-6abd-4ab1-864e-f3ef56197b87 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.521045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.522195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.522723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.523331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] PATH_INFO: `/v3/projects/c2e7594ffba04a4bb687919ae7227733/users/ea05b9cbccbe4fa298503a412b287e1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.574628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e7594ffba04a4bb687919ae7227733, user_id=ea05b9cbccbe4fa298503a412b287e1b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:36.577341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773eac8-35f1-4c1e-a02b-679c1f9235c7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:36.619324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3620/7217] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:36 2022] PUT /identity/v3/projects/c2e7594ffba04a4bb687919ae7227733/users/ea05b9cbccbe4fa298503a412b287e1b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:36.624065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.624349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.624625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.653239 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3598/7218] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:36.664268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.668829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:36.676015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:36.677293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:36.828107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:36.845028 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3621/7219] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:36.862788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4530b-b35e-456b-b99b-9bac0ee98da7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:36.943417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:36.945163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:36.967310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:36.968413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:36.968947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:36.969414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:36.975244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:37.044644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8b5b-49f6-4a88-8061-e98f150d2726 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:37.055470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:37.057736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:37.058211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:37.058943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:37.081754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:37.082485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:37.083543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:37.085224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:37.107208 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3599/7220] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:37.128423 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3622/7221] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:37.546790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:37.577455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acb1bc-21dd-433c-ada8-9997d0366d29 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:37.593577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:37.594565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:37.595053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:37.595574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] PATH_INFO: `/v3/users/37c36c41592244e19502153054bb7d5c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:37.598214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c36c41592244e19502153054bb7d5c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:37.600413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:37.699801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c36c41592244e19502153054bb7d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:37.702100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c36c41592244e19502153054bb7d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:37.702876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c36c41592244e19502153054bb7d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:37.706391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:37.723019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c54cbe-0ecb-467b-9bb3-7d8947237213 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:37.741194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:37.741194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:37.741194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:37.741194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:37.743577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:37.747791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c36c41592244e19502153054bb7d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:37.757510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5d50a443-af67-4247-8810-8f29fa0a262a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c36c41592244e19502153054bb7d5c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:37.778442 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3600/7222] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:37 2022] DELETE /identity/v3/users/37c36c41592244e19502153054bb7d5c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:37.798321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:37.799782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:37.801266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:37.804736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:37.805697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:37.863727 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3623/7223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:24:37.893846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:37.898005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:38.033348 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3601/7224] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:38.090056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:38.092860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:38.117158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e63a-a7a2-4495-b06c-42a8925fafd3 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:38.265940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:38.266852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:38.267229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:38.272553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:38.303686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:38.307441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:38.348486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3624/7225] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:39.650538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:39.671160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924cd74-ff42-43fa-b112-6e82fb906435 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:39.683475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:39.684372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:39.684829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:39.685284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:39.691844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:39.714009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:39.717648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:39.745713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3602/7226] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:40.466865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:40.469765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:40.508937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5ee7-70c7-47cb-89eb-ba5a28714c1f service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:40.523811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:40.524612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:40.525085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:40.525737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] PATH_INFO: `/v3/projects/535a35778add402b98b973a27a280a55` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:40.528606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535a35778add402b98b973a27a280a55)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:40.531735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:40.651041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:40.661804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:40.687769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f902-4273-4986-8619-b58d5333863b service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:40.735532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535a35778add402b98b973a27a280a55', 'request_id': 'req-94218804-dc4e-40ae-a591-eaa2f2baae32'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:40.746381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535a35778add402b98b973a27a280a55', 'request_id': 'req-94218804-dc4e-40ae-a591-eaa2f2baae32'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:40.761435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535a35778add402b98b973a27a280a55', 'request_id': 'req-94218804-dc4e-40ae-a591-eaa2f2baae32'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:40.787990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] The token cache is being invalidate because project 535a35778add402b98b973a27a280a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:40.789410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:40.791205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:40.796854 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3625/7227] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:40 2022] DELETE /identity/v3/projects/535a35778add402b98b973a27a280a55 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:40.802668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:40.806754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:40.882776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:40.906781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:40.907814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:40.908333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:40.909430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:40.923973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:41.035639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218804-dc4e-40ae-a591-eaa2f2baae32 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:41.055777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:41.056446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:41.057275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:41.057275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] PATH_INFO: `/v3/users/be00558fb425448b89f7286612b16c51` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:41.075331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be00558fb425448b89f7286612b16c51)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:41.092718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:41.159047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:41.163268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:41.257813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3603/7228] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:41.355023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be00558fb425448b89f7286612b16c51'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:41.356507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be00558fb425448b89f7286612b16c51'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:41.390382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be00558fb425448b89f7286612b16c51'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:41.447604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be00558fb425448b89f7286612b16c51'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:41.452144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b68ad9a8-13fd-45ff-87c1-751b18bde9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be00558fb425448b89f7286612b16c51'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:41.495942 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3626/7229] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:40 2022] DELETE /identity/v3/users/be00558fb425448b89f7286612b16c51 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:42.861344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:42.883330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8272fd-f96d-46d3-933b-9d834c80a083 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:43.016213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:43.017097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:43.017557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:43.017934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] PATH_INFO: `/v3/projects/6f589377334a4813957f5b951e5f3741` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:43.019560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f589377334a4813957f5b951e5f3741)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:43.021665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:43.162279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:43.205754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f589377334a4813957f5b951e5f3741', 'request_id': 'req-60351443-fa35-40ca-a638-41f61e7d23a3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:43.232668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f589377334a4813957f5b951e5f3741', 'request_id': 'req-60351443-fa35-40ca-a638-41f61e7d23a3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:43.260830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f589377334a4813957f5b951e5f3741', 'request_id': 'req-60351443-fa35-40ca-a638-41f61e7d23a3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:43.334052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] The token cache is being invalidate because project 6f589377334a4813957f5b951e5f3741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:43.334342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:43.339449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-60351443-fa35-40ca-a638-41f61e7d23a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:43.345648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:43.346508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:43.347055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:43.348154 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3604/7230] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:42 2022] DELETE /identity/v3/projects/6f589377334a4813957f5b951e5f3741 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:43.418914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:43.422625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:43.688535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:43.688821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:43.689124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:43.689911 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3627/7231] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:43.750852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:43.758753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:43.794829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3605/7232] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:43.799169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:43.814865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef323c63-6a07-4287-8e42-4567b084063d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:43.827303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:43.828176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:43.828644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:43.829091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:43.829923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:43.830426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:43.835200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:43.874683 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3628/7233] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:43.876773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:43.896720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ed645-8f79-4652-b394-946e507a5445 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:43.912283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:43.913017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:43.913304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:43.913583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:43.914241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:43.919208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:44.049899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:44.060627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3606/7234] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:43 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:44.061973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c36c1-c4e8-45d0-a044-25b60845b668 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:44.128883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:44.222226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:44.246499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:44.247292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:44.247815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:44.248760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:44.251160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:44.326403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:44.339837 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3629/7235] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:44 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:44.351704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e449-879b-4c2c-a873-c4914a712eb1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:44.365100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:44.366033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:44.371810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:44.372756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:44.374331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:44.378592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:44.420031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:44.421638 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3607/7236] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:44.446064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d939f-820a-46af-bfbd-8dcc90814ddd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:44.464634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:44.465299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:44.465571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:44.465840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:44.469728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:44.471669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e70b0-5196-401e-a40a-e086cbb61f79 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:44.514212 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3630/7237] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:44.519388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:44.535631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5885197-e7b6-4210-ad7e-a0bad7b85cde admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:44.549374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:44.551502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:44.551897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:44.552270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] PATH_INFO: `/v3/projects/aafce2b7d5c948d9a3ebfdd6e8262c52/users/4941772159ce45f9a6851db40cee70fa/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:44.616585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafce2b7d5c948d9a3ebfdd6e8262c52, user_id=4941772159ce45f9a6851db40cee70fa, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:44.619841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:44.666377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3608/7238] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:44 2022] PUT /identity/v3/projects/aafce2b7d5c948d9a3ebfdd6e8262c52/users/4941772159ce45f9a6851db40cee70fa/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:44.787142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:44.788736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:44.789290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:44.844425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] MFA Rules not processed for user `4941772159ce45f9a6851db40cee70fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:44.846081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:45.082582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3631/7239] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:45.101989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:45.109239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:45.328657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc023c-5ebc-4c27-a3ab-1029345081f6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:45.341449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:45.345561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:45.345846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:45.346111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:45.390975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:45.392441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:45.420352 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3609/7240] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:47.683875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:47.686501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:47.876215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:47.878896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:47.988582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5421-1c05-40cc-ac73-1a0b1fce7db7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:48.012066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:48.012598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.012873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.013163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.023944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:48.070822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb799d-3634-4265-88bc-e519a4cc145e service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:48.086324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:48.087268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.087655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.088950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] PATH_INFO: `/v3/users/b9ad52d9dbe24372ad74730b94ac9cfa` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.091916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:48.092794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ad52d9dbe24372ad74730b94ac9cfa)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:48.095329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:48.102160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:48.120636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:48.164568 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3632/7241] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:48.268490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ad52d9dbe24372ad74730b94ac9cfa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.272579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ad52d9dbe24372ad74730b94ac9cfa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.274534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ad52d9dbe24372ad74730b94ac9cfa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.303013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ad52d9dbe24372ad74730b94ac9cfa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.330755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96bf1889-79d9-4360-90e1-370dc7150f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ad52d9dbe24372ad74730b94ac9cfa'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.432006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3610/7242] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:47 2022] DELETE /identity/v3/users/b9ad52d9dbe24372ad74730b94ac9cfa => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:48.434046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:48.443421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.443421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.443421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.481182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98984-dcaf-458e-b768-02e8bfed2d96 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:48.499855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:48.502220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:48.602141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:48.732624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3611/7243] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:48.737834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:48.741746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.742810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.743437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] PATH_INFO: `/v3/users/4941772159ce45f9a6851db40cee70fa` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.745085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4941772159ce45f9a6851db40cee70fa)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:48.747504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:48.755192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:48.757214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:48.926464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4941772159ce45f9a6851db40cee70fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.930152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4941772159ce45f9a6851db40cee70fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.960941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cfff6-4b4c-4b5a-bb79-9b4795cbcdf5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:48.964484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:48.965263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.965546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.966871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.976191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4941772159ce45f9a6851db40cee70fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.988356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4941772159ce45f9a6851db40cee70fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.989081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4941772159ce45f9a6851db40cee70fa'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:48.996880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:49.002259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c82c46-e821-47f7-8916-041b1c4180e2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:49.039328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3612/7244] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:49.046351 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3633/7245] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:48 2022] DELETE /identity/v3/users/4941772159ce45f9a6851db40cee70fa => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:49.051184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:49.051466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:49.051736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:49.089016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:49.092449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:49.142547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:49.243666 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3613/7246] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:49.341837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:49.343603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:49.582392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0651-db14-447c-a79c-ce97a6c1fab5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:49.586316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:49.586938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:49.587324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:49.587599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:49.601555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:49.603040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:49.639656 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3634/7247] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:50.483511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:50.487397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:50.513548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17868d1-e0b9-4911-b7ff-f225d0dfdd52 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:50.541551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:50.542776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:50.545293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:50.546563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] PATH_INFO: `/v3/projects/b2e2d4ffd2d84dbe8166fb46c52fbca9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:50.552789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e2d4ffd2d84dbe8166fb46c52fbca9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:50.560703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:50.724887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e2d4ffd2d84dbe8166fb46c52fbca9', 'request_id': 'req-312921ed-ddff-4e66-ad2f-820d53fb1dcb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:50.745454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e2d4ffd2d84dbe8166fb46c52fbca9', 'request_id': 'req-312921ed-ddff-4e66-ad2f-820d53fb1dcb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:50.755686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e2d4ffd2d84dbe8166fb46c52fbca9', 'request_id': 'req-312921ed-ddff-4e66-ad2f-820d53fb1dcb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:50.778567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] The token cache is being invalidate because project b2e2d4ffd2d84dbe8166fb46c52fbca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:50.779185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:50.780306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:50.782277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3614/7248] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:50 2022] DELETE /identity/v3/projects/b2e2d4ffd2d84dbe8166fb46c52fbca9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:50.789190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:50.801306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423640-cff7-44ff-bc75-b6ff0b5f279d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:51.027148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:51.074638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:51.075322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:51.075602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:51.075878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] PATH_INFO: `/v3/users/0d3316b60ef54e4ea5c3ecef763da05a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:51.086634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3316b60ef54e4ea5c3ecef763da05a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:51.088626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:51.232080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3316b60ef54e4ea5c3ecef763da05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:51.233288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3316b60ef54e4ea5c3ecef763da05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:51.254823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3316b60ef54e4ea5c3ecef763da05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:51.274958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3316b60ef54e4ea5c3ecef763da05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:51.276025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-75beda12-185f-48c3-a626-07587ed6b6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3316b60ef54e4ea5c3ecef763da05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:51.312218 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3635/7249] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:50 2022] DELETE /identity/v3/users/0d3316b60ef54e4ea5c3ecef763da05a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:51.840709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:51.843238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:51.873100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312921ed-ddff-4e66-ad2f-820d53fb1dcb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.030947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.031952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.032414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.032869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] PATH_INFO: `/v3/projects/aafce2b7d5c948d9a3ebfdd6e8262c52` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.040854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafce2b7d5c948d9a3ebfdd6e8262c52)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.042956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.163941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafce2b7d5c948d9a3ebfdd6e8262c52', 'request_id': 'req-9406950c-9533-4f2b-a9e1-a742acf73e60'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:52.169880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:52.182613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafce2b7d5c948d9a3ebfdd6e8262c52', 'request_id': 'req-9406950c-9533-4f2b-a9e1-a742acf73e60'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:52.196496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafce2b7d5c948d9a3ebfdd6e8262c52', 'request_id': 'req-9406950c-9533-4f2b-a9e1-a742acf73e60'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:52.219028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] The token cache is being invalidate because project aafce2b7d5c948d9a3ebfdd6e8262c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:52.219291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:52.225471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9406950c-9533-4f2b-a9e1-a742acf73e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:52.227177 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3615/7250] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:51 2022] DELETE /identity/v3/projects/aafce2b7d5c948d9a3ebfdd6e8262c52 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:52.233232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.234862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.235423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.274691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:52.276435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:52.382170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.382523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.382736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.386100 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3636/7251] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:52.420021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:52.421367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:52.445073 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3616/7252] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:52.449418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:52.465020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39cc00-b985-438b-8122-c7d32b6d5b3d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.474092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.474727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.475155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.475285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.475909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:52.476203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.477860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.538185 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3637/7253] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:52.538992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:52.557857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1350745-4cdb-40b0-a1e0-2f693d8e2a87 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.565945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.566847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.567294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.567750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.568883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.571114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.655712 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3617/7254] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:52 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:52.657454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:52.688051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b18f3-ef21-4bd0-ae05-e98c39942dd3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.818736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.820575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.821075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.821564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.822757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.825776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.850305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:52.879228 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3638/7255] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:52 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:52.881045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:52.903356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bff340-5ea2-4d75-80bf-e07b15476080 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.917901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.918807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.919251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.919746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.920702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.922791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.938934 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3618/7256] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:52.939758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:52.963645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230583b5-c48b-4b1a-b68a-220ed2aeb8cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:52.975786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:52.976423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:52.976699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:52.977411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:52.978780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:52.980492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:52.998964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3639/7257] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:53.000541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:53.012101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a06f9-54a0-4729-ac3b-ee1b4c40d159 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:53.018224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:53.018912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.019189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.019457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] PATH_INFO: `/v3/projects/2d5e0ceee7a745008bf0707d56bec91d/users/142396ec59054de59299832ac2e0f239/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.037926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:53.040229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:53.042080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5e0ceee7a745008bf0707d56bec91d, user_id=142396ec59054de59299832ac2e0f239, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:53.046635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01495-de6e-493d-834d-12808cdaae03 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:53.082315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3619/7258] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:52 2022] PUT /identity/v3/projects/2d5e0ceee7a745008bf0707d56bec91d/users/142396ec59054de59299832ac2e0f239/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:53.097705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.098155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bfb58-6d5a-4c0a-ad52-e8d8cbf959a0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:53.098288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.098729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.159086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] MFA Rules not processed for user `142396ec59054de59299832ac2e0f239`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:53.160392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:53.263810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:53.264719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.265125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.265494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] PATH_INFO: `/v3/projects/b676a3631c0e4f2a80be23ddfc0643d2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.267391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b676a3631c0e4f2a80be23ddfc0643d2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:53.269865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:53.340271 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3620/7259] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:53.347770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:53.350654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b676a3631c0e4f2a80be23ddfc0643d2', 'request_id': 'req-55261fd2-77a7-4ea4-ba69-8b09637853cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.351290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:53.367431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b676a3631c0e4f2a80be23ddfc0643d2', 'request_id': 'req-55261fd2-77a7-4ea4-ba69-8b09637853cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.385926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b676a3631c0e4f2a80be23ddfc0643d2', 'request_id': 'req-55261fd2-77a7-4ea4-ba69-8b09637853cd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.439376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] The token cache is being invalidate because project b676a3631c0e4f2a80be23ddfc0643d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:53.441382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.443702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.450226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3640/7260] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:53 2022] DELETE /identity/v3/projects/b676a3631c0e4f2a80be23ddfc0643d2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:53.452387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:53.455646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:53.569074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a51d6-fe40-49e4-a1f7-391db5d1fedc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:53.633362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:53.679253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261fd2-77a7-4ea4-ba69-8b09637853cd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:53.692431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:53.693295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.693678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.694011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] PATH_INFO: `/v3/users/b079f31f171845aea8a964145d989b7c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.696375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b079f31f171845aea8a964145d989b7c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:53.699218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:53.720780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:53.721548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.721907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.722245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.726930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:53.729430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:53.798314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b079f31f171845aea8a964145d989b7c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.801250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b079f31f171845aea8a964145d989b7c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.843631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b079f31f171845aea8a964145d989b7c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.869112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b079f31f171845aea8a964145d989b7c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.873523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b079f31f171845aea8a964145d989b7c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:53.894339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:53.895801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58aa4c7-4040-4720-b812-c1197f2e257c service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:53.933739 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3621/7261] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:53.935652 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3641/7262] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:53 2022] DELETE /identity/v3/users/b079f31f171845aea8a964145d989b7c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:53.940262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:53.941108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:53.941387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:53.997819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] MFA Rules not processed for user `ea05b9cbccbe4fa298503a412b287e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:53.999031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:54.093289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.098319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:54.124116 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3622/7263] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:54.274938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d06b-789e-4432-aafb-58bfc2c67be5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.287666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.288357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.289108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.289391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.290158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.292359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.352024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.363995 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3642/7264] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:54 2022] POST /identity/v3/projects => generated 373 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:54.366764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79c1e-de0a-4fb9-a868-704c21c53479 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.497282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.497431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.497626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.497896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.498531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.500459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.512689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:54.535030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.540853 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3623/7265] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:54 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:54.548656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d7f9-c0eb-4c8d-8dd1-ea688dc8eac5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.558470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.559145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.560626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.560789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.564002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.568721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.599748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.605992 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3643/7266] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:54.616265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853004b-c3b2-4b01-bc13-32c11a017b21 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.628648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.629498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.629774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.630041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] PATH_INFO: `/v3/projects/9150fac4c5314ca9835ef91edddc8516/users/bd7f6a57e50a43a7a397eaf20085734a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.660567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.662590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:54.690668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150fac4c5314ca9835ef91edddc8516, user_id=bd7f6a57e50a43a7a397eaf20085734a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.691124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc31c50-9f36-4849-9531-7f50898d60a0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.694584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.702781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.705662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.706518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.710012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] PATH_INFO: `/v3/users/142396ec59054de59299832ac2e0f239` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.711389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142396ec59054de59299832ac2e0f239)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.717053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.725478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3624/7267] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:54 2022] PUT /identity/v3/projects/9150fac4c5314ca9835ef91edddc8516/users/bd7f6a57e50a43a7a397eaf20085734a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:54.733270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.848406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142396ec59054de59299832ac2e0f239'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:54.851271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142396ec59054de59299832ac2e0f239'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:54.880108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142396ec59054de59299832ac2e0f239'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:54.893369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:54.897220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142396ec59054de59299832ac2e0f239'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:54.898341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5e9faf62-d5a0-4f18-96ae-4593ff045268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142396ec59054de59299832ac2e0f239'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:54.929899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc846af-cf9e-42a0-a79e-6c39daac0c16 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:54.936342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:54.937134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.937468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.938101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.938768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:54.939464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3644/7268] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:54 2022] DELETE /identity/v3/users/142396ec59054de59299832ac2e0f239 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:24:54.944841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:54.949745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:54.950386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:54.950932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:54.980186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3625/7269] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:24:54.985829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:54.991131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:54.991623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:54.993628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.022720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a07a3e-b721-4285-848d-2ae96767e1c4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:55.138256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3645/7270] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:55.141032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:55.145620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.175933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b84e-af92-43d1-b89c-104e806154e2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:55.182255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:55.183452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.184736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.185794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] PATH_INFO: `/v3/projects/9150fac4c5314ca9835ef91edddc8516/users/bd7f6a57e50a43a7a397eaf20085734a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.188776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:55.191768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.192804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150fac4c5314ca9835ef91edddc8516, user_id=bd7f6a57e50a43a7a397eaf20085734a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:55.193410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.193933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] PATH_INFO: `/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.197920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:55.198915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc3b90e27f4801a7c4dd211fa13f70)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:55.202093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:55.226601 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3626/7271] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:54 2022] PUT /identity/v3/projects/9150fac4c5314ca9835ef91edddc8516/users/bd7f6a57e50a43a7a397eaf20085734a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:55.228143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:55.234976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.318937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc3b90e27f4801a7c4dd211fa13f70', 'request_id': 'req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:55.337097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc3b90e27f4801a7c4dd211fa13f70', 'request_id': 'req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:55.352983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc3b90e27f4801a7c4dd211fa13f70', 'request_id': 'req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:55.372614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] The token cache is being invalidate because project 67cc3b90e27f4801a7c4dd211fa13f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:55.373579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:55.374663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a5a1c15-fbc8-467a-9cd9-7fdda6c628db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:55.382925 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3646/7272] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:55 2022] DELETE /identity/v3/projects/67cc3b90e27f4801a7c4dd211fa13f70 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:55.384975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a7e5-40e9-437f-8915-6ced2a27d35c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.385661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a7e5-40e9-437f-8915-6ced2a27d35c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.386180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a7e5-40e9-437f-8915-6ced2a27d35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.398713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642fa2-d51a-4e3b-b056-4b30599bc72c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:55.416679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a0e1a7e5-40e9-437f-8915-6ced2a27d35c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:55.421745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0e1a7e5-40e9-437f-8915-6ced2a27d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.438311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:55.509807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:55.510636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.511138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.512268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.513907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.559542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:55.587674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3647/7273] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:55.589408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.592386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.592545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.641606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:55.643149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:55.648601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:55.652544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:55.664788 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3648/7274] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:55.670836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:55.680752 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3627/7275] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:55.686885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae79c8e-a85a-421b-8a83-5dae3d89f967 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:55.692642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:55.693429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.693713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.693980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.694636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:55.695294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:55.696567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:55.718676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3649/7276] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:55.724563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:55.743870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257487-c81a-4d34-8eec-9eeab8d5dc5f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:55.751998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:55.753356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:55.753763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:55.754945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:55.755944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:55.758935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:55.805308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3628/7277] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:55 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:55.806361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:55.818945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc1c47-50f1-4310-966d-911b946756d8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:56.035415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:56.036440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.037038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.037479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.038307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:56.044301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:56.108027 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3650/7278] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:55 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:56.113343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:56.133011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5480f-a3f7-4501-8c09-ca55eab0b9ba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:56.147472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:56.149308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.149597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.149873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.152614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:56.158814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:56.195803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:56.197038 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3629/7279] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:56.214795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631305-0fcc-4ef6-9de0-9a49bd330025 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:56.230480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:56.231117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.231397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.231672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.232387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:56.234041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11789d-64f7-45f8-8a54-395d11ac8eb3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:56.271906 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3651/7280] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:56.276887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:56.295053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924363-5fe2-4724-8b77-670c291d1b6c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:56.308527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:56.311534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.311840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.313194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] PATH_INFO: `/v3/projects/9bbec6170ffa47c6ab74e04afe41e6f8/users/b9d1964980794cd89161a90d0d8ce64f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.363558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbec6170ffa47c6ab74e04afe41e6f8, user_id=b9d1964980794cd89161a90d0d8ce64f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:56.376799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:56.410659 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3630/7281] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:56 2022] PUT /identity/v3/projects/9bbec6170ffa47c6ab74e04afe41e6f8/users/b9d1964980794cd89161a90d0d8ce64f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:56.423352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.423877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.423877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.493147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] MFA Rules not processed for user `b9d1964980794cd89161a90d0d8ce64f`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:56.494382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:56.634857 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3652/7282] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:56.657371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:56.659376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:56.786076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d926f-1f6d-4385-99c5-4dcacfee047e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:56.796813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:56.797101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:56.797279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:56.797664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:56.819682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:56.821380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569bd4-36db-4971-b5d3-ec5dfb8b7bc1 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:56.844702 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3631/7283] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:56.884615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:56.886230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:56.978994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:57.009781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c103fb-9869-482a-bee8-5b692f81b8fe None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:57.021421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:57.022080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.022362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.022634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] PATH_INFO: `/v3/projects/2d5e0ceee7a745008bf0707d56bec91d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.026958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5e0ceee7a745008bf0707d56bec91d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:57.028963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:57.146979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5e0ceee7a745008bf0707d56bec91d', 'request_id': 'req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:57.165707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5e0ceee7a745008bf0707d56bec91d', 'request_id': 'req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:57.207438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5e0ceee7a745008bf0707d56bec91d', 'request_id': 'req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:57.226209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] The token cache is being invalidate because project 2d5e0ceee7a745008bf0707d56bec91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:24:57.226968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:57.243775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-980d3ca6-8ea5-4898-bb33-efad0ecb09c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:24:57.246158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3653/7284] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:24:56 2022] DELETE /identity/v3/projects/2d5e0ceee7a745008bf0707d56bec91d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:57.252088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.252671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.252671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.290397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:57.291262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:57.311036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:57.452388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3632/7285] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:57.454594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.455069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.455167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.488074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:57.489328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:57.500784 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3654/7286] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:24:57.505947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:57.526721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb6da-2514-4c67-be1e-41014ff9d150 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:57.536482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:57.537314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.537603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.538106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.539392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:24:57.539899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:57.541706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:57.572013 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3633/7287] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:24:57.573748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:57.592652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd06e79-a490-46a4-9e5a-7406a7abb280 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:57.610313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:57.610953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.611230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.611502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.612239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:57.615316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:57.675668 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3655/7288] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:57 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:57.680957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:57.701860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f4eb-8b73-488c-9d24-b3cdb4919b32 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:57.870841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:57.871742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.872367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.872866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.874062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:57.877136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:57.923009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3634/7289] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:57 2022] POST /identity/v3/users => generated 305 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:24:57.926857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:57.945245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f2174-a93a-4277-a449-67d4d664769b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:57.961778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:57.963787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:57.964079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:57.964349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:57.965049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:57.971530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:58.005170 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3656/7290] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:58.009441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:58.028795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907efa4-9cb4-45d8-987d-48e5c350ca68 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:58.079920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:58.081738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:58.082205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:58.084319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:58.086243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:58.091282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32323f-2ca2-4de8-baf8-c2a9f1fd035a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:58.190680 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3635/7291] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:58.194581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:58.233095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0b86f-e48f-497e-9d4d-77913a763938 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:58.252194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:58.252636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:58.254876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:58.258475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] PATH_INFO: `/v3/projects/0798ad2fe13e43f5a690a4e6ee35f538/users/307827dbc9b74963ba3dd51f64865822/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:58.323237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0798ad2fe13e43f5a690a4e6ee35f538, user_id=307827dbc9b74963ba3dd51f64865822, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:58.327152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:58.381837 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3657/7292] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:58 2022] PUT /identity/v3/projects/0798ad2fe13e43f5a690a4e6ee35f538/users/307827dbc9b74963ba3dd51f64865822/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:58.388062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:58.389706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:58.392033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:58.486250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] MFA Rules not processed for user `307827dbc9b74963ba3dd51f64865822`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:58.488467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:58.664402 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3636/7293] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:24:58.669179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:58.888598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f957-2fb1-4163-8aa3-9df248e8b823 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:58.897109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:58.897904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:58.898286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:58.898665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:58.900210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:58.904416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:58.973729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:58.984457 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3658/7294] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:24:58 2022] POST /identity/v3/projects => generated 411 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:58.985378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.000743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbb8af-4c6e-4557-8247-0b0e972bb02c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:59.014463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:59.137948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:59.138613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.138895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.139171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.139822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:59.141924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:59.194191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.204170 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3637/7295] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:24:58 2022] POST /identity/v3/users => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:24:59.214481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3998f-1ef1-45b5-b371-337a528059b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:59.229689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:59.233829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.234964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.237836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.239064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:59.243970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:59.285159 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3659/7296] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:59.290167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.305850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8e05-dbb5-4262-bc6e-99e250448883 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:59.314419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:59.316623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.317710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.318226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] PATH_INFO: `/v3/projects/38d1551053dc410697cf5c56ba8d11c6/users/ca5892b6e2834178ad99bbcd4c6622e2/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.345635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1551053dc410697cf5c56ba8d11c6, user_id=ca5892b6e2834178ad99bbcd4c6622e2, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:59.350050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:59.388276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.389113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3638/7297] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:59 2022] PUT /identity/v3/projects/38d1551053dc410697cf5c56ba8d11c6/users/ca5892b6e2834178ad99bbcd4c6622e2/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:59.406767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc477-3d6b-4a89-ae0c-81ec13bc82a9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:59.591735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:59.592380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.592661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.593407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.594018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:59.598893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477a75-0265-453e-9c60-a3a88624be3a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:59.657519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.657760 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3660/7298] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:24:59.684121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeb14a-0709-4770-9d3c-6e7080a71a91 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:59.708334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:59.710970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.713852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.716832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] PATH_INFO: `/v3/projects/38d1551053dc410697cf5c56ba8d11c6/users/ca5892b6e2834178ad99bbcd4c6622e2/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.726335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1551053dc410697cf5c56ba8d11c6, user_id=ca5892b6e2834178ad99bbcd4c6622e2, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:59.736081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:59.777549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3639/7299] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:24:59 2022] PUT /identity/v3/projects/38d1551053dc410697cf5c56ba8d11c6/users/ca5892b6e2834178ad99bbcd4c6622e2/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:24:59.790390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:59.790897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:59.791315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:59.817607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:59.822316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:59.870912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] MFA Rules not processed for user `ca5892b6e2834178ad99bbcd4c6622e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:24:59.873690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:00.052296 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3661/7300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:00.063078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7ecf-ace7-462c-be6e-6b1e5eba063b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:00.076618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:00.077315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:00.077591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:00.077864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] PATH_INFO: `/v3/users/1b327af221c94695bc5b82fa49e3c448` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:00.081352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b327af221c94695bc5b82fa49e3c448)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:00.085993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:00.225827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b327af221c94695bc5b82fa49e3c448'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:00.226827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b327af221c94695bc5b82fa49e3c448'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:00.232843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b327af221c94695bc5b82fa49e3c448'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:00.246770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b327af221c94695bc5b82fa49e3c448'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:00.267873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b327af221c94695bc5b82fa49e3c448'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:00.275013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:00.288761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:00.290263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:00.383307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3640/7301] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:24:59 2022] DELETE /identity/v3/users/1b327af221c94695bc5b82fa49e3c448 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:00.497953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d96c6-f605-43c2-ab15-ae68c53cbb94 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:00.580145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:00.662697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:00.663295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:00.663575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:00.663843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:00.666818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:00.918594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:00.927021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36eb51-06af-4b32-90c0-1d32d945e168 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:00.969103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3662/7302] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:00 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:25:01.043384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:01.046324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:01.289885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f894c-3beb-4160-b156-fbbef65f43e5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:01.319510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:01.320451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:01.321196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:01.321656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] PATH_INFO: `/v3/projects/647a75e417314ddbb20364530ad36c54` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:01.323194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647a75e417314ddbb20364530ad36c54)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:01.326048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:01.454923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647a75e417314ddbb20364530ad36c54', 'request_id': 'req-77baef89-8344-4fbc-a390-5e3c293f6635'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:01.462433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647a75e417314ddbb20364530ad36c54', 'request_id': 'req-77baef89-8344-4fbc-a390-5e3c293f6635'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:01.486837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647a75e417314ddbb20364530ad36c54', 'request_id': 'req-77baef89-8344-4fbc-a390-5e3c293f6635'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:01.506062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] The token cache is being invalidate because project 647a75e417314ddbb20364530ad36c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:01.506704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:01.507708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-77baef89-8344-4fbc-a390-5e3c293f6635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:01.513774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3641/7303] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:01 2022] DELETE /identity/v3/projects/647a75e417314ddbb20364530ad36c54 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:01.514911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:01.515670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:01.515801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:01.560061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:01.563159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:01.746172 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3663/7304] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:01.755643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:01.756008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:01.756264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:01.788145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:01.801589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:01.826378 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3642/7305] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:01.827725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:01.856111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a64d6-df25-4ef3-96fe-30181c658195 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:01.865915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:01.866980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:01.867501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:01.868374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:01.869355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:25:01.869920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:01.882538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:01.908156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3664/7306] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:25:01.913288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:01.925602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c0d2-beb5-445e-ae79-f91f208bb95a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:01.936252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:01.937179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:01.941397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:01.941798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:01.942602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:01.945074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:02.012491 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3643/7307] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:25:01 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:02.016470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:02.031099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b6d8-4b23-4967-8076-7be181bcfc11 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:02.255608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:02.256367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.256780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.260167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.261171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:02.263432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:02.292175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:02.331103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:02.341156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3665/7308] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:25:02 2022] POST /identity/v3/users => generated 286 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:02.346241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211e89-4edc-4a18-b274-25a7789b189c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:02.365950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:02.366791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.367084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.367487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.375978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:02.375978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:02.408594 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3644/7309] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:02.413305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:02.430579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf1a-82b0-49e3-a656-6cbfa787e6fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:02.441460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:02.442449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.442904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.445639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.446527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:02.451654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be756b2-9356-49a4-842f-becef76bf2ba admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:02.483265 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3666/7310] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:02.485274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:02.503991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3b54-fe46-4507-b08a-86713aaccf12 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:02.519506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:02.520198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.520473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.520739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] PATH_INFO: `/v3/projects/fafa0e8262b54463a9ce5d3d58519852/users/735cb543df9a480cb60de622526aad52/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.561863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafa0e8262b54463a9ce5d3d58519852, user_id=735cb543df9a480cb60de622526aad52, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:02.573046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056981-e76f-41cb-a384-a3d08b8f8d6e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:02.628381 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3645/7311] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:25:02 2022] PUT /identity/v3/projects/fafa0e8262b54463a9ce5d3d58519852/users/735cb543df9a480cb60de622526aad52/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:02.630761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.631051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.631329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.720883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] MFA Rules not processed for user `735cb543df9a480cb60de622526aad52`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:02.726140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:02.837505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3667/7312] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:02.849818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:02.850444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:02.850877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:02.867676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:02.878430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] MFA Rules not processed for user `735cb543df9a480cb60de622526aad52`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:02.882159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:02.911075 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3646/7313] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:02.924299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:02.925887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:03.114240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca752ba-1802-451b-b7e1-eb1229046759 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:03.125520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:03.126166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:03.126446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:03.126720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:03.155250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:03.157446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d131-8f4c-437d-ac24-0daf5fe32e9c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:03.186044 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3668/7314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:09.576197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:09.592251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:09.800762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392913-b6cd-413b-bb8f-684a8773583a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:09.827139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:09.827773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:09.829261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:09.829526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] PATH_INFO: `/v3/users/307827dbc9b74963ba3dd51f64865822` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:09.831880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307827dbc9b74963ba3dd51f64865822)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:09.837330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:10.009060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307827dbc9b74963ba3dd51f64865822'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:10.010809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307827dbc9b74963ba3dd51f64865822'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:10.012892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307827dbc9b74963ba3dd51f64865822'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:10.035278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307827dbc9b74963ba3dd51f64865822'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:10.072221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307827dbc9b74963ba3dd51f64865822'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:10.138390 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3647/7315] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:09 2022] DELETE /identity/v3/users/307827dbc9b74963ba3dd51f64865822 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:10.141158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:10.147357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:10.152380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:10.215379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:10.217780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:10.294313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:10.297277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:10.355114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:10.382904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3669/7316] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:25:10.410394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:10.412018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:10.503150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aa5d-94db-4813-8364-9905c92a1827 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:10.529986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:10.532850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:10.534474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:10.537991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:10.545759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:10.602581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:10.610013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5382-6a33-463f-871a-08be56343c22 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:10.624177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:10.624860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:10.625203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:10.625505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:10.646995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:10.651878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:10.680458 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3670/7317] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:10.744246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:10.757514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:10.803307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3648/7318] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:11.349293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:11.352218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:11.379561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:11.387341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:11.423753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4a94-2e83-4a38-89ab-a6c3c33cb15c service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:11.440126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:11.441304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:11.441924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:11.442429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] PATH_INFO: `/v3/projects/0798ad2fe13e43f5a690a4e6ee35f538` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:11.444190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0798ad2fe13e43f5a690a4e6ee35f538)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:11.446702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:11.538042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d255e-1072-4d93-a4e0-fb9749936529 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:11.556147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0798ad2fe13e43f5a690a4e6ee35f538', 'request_id': 'req-42ad0b38-544a-47b1-85c8-06f858aa345f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.563747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0798ad2fe13e43f5a690a4e6ee35f538', 'request_id': 'req-42ad0b38-544a-47b1-85c8-06f858aa345f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.577759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0798ad2fe13e43f5a690a4e6ee35f538', 'request_id': 'req-42ad0b38-544a-47b1-85c8-06f858aa345f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.631278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] The token cache is being invalidate because project 0798ad2fe13e43f5a690a4e6ee35f538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:11.632376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.633865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.636360 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3649/7319] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:11 2022] DELETE /identity/v3/projects/0798ad2fe13e43f5a690a4e6ee35f538 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:11.640479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:11.643315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:11.687442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:11.688841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:11.689371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:11.690326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:11.692662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:11.798450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0b38-544a-47b1-85c8-06f858aa345f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:11.815532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:11.816190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:11.816990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:11.817575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] PATH_INFO: `/v3/users/ca5892b6e2834178ad99bbcd4c6622e2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:11.835830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5892b6e2834178ad99bbcd4c6622e2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:11.848924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:11.885274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:11.959180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:11.964405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b0a9a-4f52-4a1a-8eaa-f88bc372332b service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:11.980738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:11.989701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5892b6e2834178ad99bbcd4c6622e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.990698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5892b6e2834178ad99bbcd4c6622e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.993662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5892b6e2834178ad99bbcd4c6622e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:11.997128 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3671/7320] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:25:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:25:12.030113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5892b6e2834178ad99bbcd4c6622e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:12.045442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5892b6e2834178ad99bbcd4c6622e2'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:12.122861 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3650/7321] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:11 2022] DELETE /identity/v3/users/ca5892b6e2834178ad99bbcd4c6622e2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:12.530239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:12.530675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:12.530841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:12.593934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] MFA Rules not processed for user `bd7f6a57e50a43a7a397eaf20085734a`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:12.596367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:12.801851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:12.803683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:12.938522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5d9b-9d4a-4e3b-9986-b73b24db8f6a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:12.945650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:12.946621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:12.947101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:12.947879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] PATH_INFO: `/v3/projects/38d1551053dc410697cf5c56ba8d11c6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:12.949288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d1551053dc410697cf5c56ba8d11c6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:12.951784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:12.981362 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3672/7322] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:12.995630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:12.997326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:13.059315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d1551053dc410697cf5c56ba8d11c6', 'request_id': 'req-d7893cbd-f2d5-4188-af36-4210e8f40644'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:13.067872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d1551053dc410697cf5c56ba8d11c6', 'request_id': 'req-d7893cbd-f2d5-4188-af36-4210e8f40644'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:13.078261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d1551053dc410697cf5c56ba8d11c6', 'request_id': 'req-d7893cbd-f2d5-4188-af36-4210e8f40644'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:13.108840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] The token cache is being invalidate because project 38d1551053dc410697cf5c56ba8d11c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:13.109359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:13.110224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d7893cbd-f2d5-4188-af36-4210e8f40644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:13.114443 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3651/7323] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:12 2022] DELETE /identity/v3/projects/38d1551053dc410697cf5c56ba8d11c6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:25:13.120206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862871-9486-4493-9fa0-43b43ea42a0b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.121255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862871-9486-4493-9fa0-43b43ea42a0b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.121793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d862871-9486-4493-9fa0-43b43ea42a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.150055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8d862871-9486-4493-9fa0-43b43ea42a0b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:13.151869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d862871-9486-4493-9fa0-43b43ea42a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:13.181926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981ba5-cd12-48b0-9b1c-4f8a51d5b362 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.233013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:13.266276 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3652/7324] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:25:13.274784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.275010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.275133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.337746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:13.339650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:13.356713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3653/7325] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:13.360878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.382495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129bfc0-c0c4-4c80-9ae7-8b035e00f59f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.395470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.396099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.396378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.396647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.397362 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:25:13.397755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.399377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.402745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.403377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.403653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.403921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.409910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:13.419201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:13.426539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3654/7326] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:25:13.427497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.462556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74a9b5-6b3a-4970-940a-195759a7f749 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.483744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.484480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.484620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.484898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.485552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.487504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.544506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.547102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.561278 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3673/7327] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:25:13.564942 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3655/7328] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:25:13 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:13.568925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.581796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e3b5-282b-4f89-83b9-edda159ae03d service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.761665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.762295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.762568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.762837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.763463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.765429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.828325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3674/7329] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:25:13 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:25:13.830579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.850844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bbc80-d587-4227-ab16-2134b607ac00 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.859622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.860660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.862136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.862637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.863783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.866455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.880323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3656/7330] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:13.884380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.900599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1241-8528-46ea-90f8-9346961acff3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:13.925281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:13.926152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:13.926364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:13.926838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:13.927483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:13.929131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62db2d1-b1bf-4fd5-a477-317fec4b2e01 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:13.970516 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3675/7331] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:13.974850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:13.988319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207b41-c786-4852-bcb9-26e468f84be4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:14.009540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:14.011877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:14.012606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:14.014865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] PATH_INFO: `/v3/projects/605db7d6183845dea35adbadb5de615e/users/34e91b50a58146f2b70464c0b9412815/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:14.055042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605db7d6183845dea35adbadb5de615e, user_id=34e91b50a58146f2b70464c0b9412815, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:14.059675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:14.094710 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3657/7332] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:25:13 2022] PUT /identity/v3/projects/605db7d6183845dea35adbadb5de615e/users/34e91b50a58146f2b70464c0b9412815/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:14.105444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:14.105795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:14.106069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:14.163092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] MFA Rules not processed for user `34e91b50a58146f2b70464c0b9412815`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:14.164319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:14.335246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3676/7333] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:14.348296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:14.350350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:14.590301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17af2-256b-4a42-8d0f-59ad81546cb8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:14.604101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:14.604784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:14.605142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:14.605414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:14.618515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:14.619983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:14.631301 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3658/7334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:14.738890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:14.741924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:14.766818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d82a-aada-4e57-ab89-fee866e451c9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:14.783971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:14.784614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:14.784890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:14.785424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:14.794605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:14.813287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:14.825899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:15.034886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13ac8-ebb8-468d-ada1-00b4be3ef5ec service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:15.038724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:15.041947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793023e2-3919-4009-b51f-6fa6f091366a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:15.053432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:15.073173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:15.074712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:15.077288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] PATH_INFO: `/v3/users/34e91b50a58146f2b70464c0b9412815` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:15.081777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e91b50a58146f2b70464c0b9412815)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:15.087928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:15.095501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3677/7335] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:15.200203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:15.257172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e91b50a58146f2b70464c0b9412815'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:15.258250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e91b50a58146f2b70464c0b9412815'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:15.259048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e91b50a58146f2b70464c0b9412815'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:15.270879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e91b50a58146f2b70464c0b9412815'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:15.302477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e91b50a58146f2b70464c0b9412815'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:15.340619 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3659/7336] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:14 2022] DELETE /identity/v3/users/34e91b50a58146f2b70464c0b9412815 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:25:15.342443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:15.342727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:15.342998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:15.381887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:15.383137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:15.500858 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3678/7337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:15.517023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:15.519852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:15.725579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3099c-af55-4600-aa72-126278ed9939 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:15.729323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:15.729942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:15.730219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:15.730491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:15.753393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:15.754846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500cd35-6f7f-4b81-ab31-e9d7fac2ca68 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:15.783206 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3660/7338] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:17.428597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:17.442586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:17.510668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878678f-54e6-47d9-b7f1-3045a57551f6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:17.538261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:17.539032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:17.542658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:17.543076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] PATH_INFO: `/v3/projects/605db7d6183845dea35adbadb5de615e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:17.547112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=605db7d6183845dea35adbadb5de615e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:17.552228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:17.710388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605db7d6183845dea35adbadb5de615e', 'request_id': 'req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:17.730628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605db7d6183845dea35adbadb5de615e', 'request_id': 'req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:17.748164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605db7d6183845dea35adbadb5de615e', 'request_id': 'req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:17.778302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] The token cache is being invalidate because project 605db7d6183845dea35adbadb5de615e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:17.778604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:17.780454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-10e5f9ee-aa4a-4f02-afa9-2d2d6b88fedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:17.785367 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3679/7339] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:17 2022] DELETE /identity/v3/projects/605db7d6183845dea35adbadb5de615e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:17.787140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752da88-1452-4fc4-ba80-2f6fb7385b19 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:17.787652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752da88-1452-4fc4-ba80-2f6fb7385b19 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:17.795395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752da88-1452-4fc4-ba80-2f6fb7385b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:17.855687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7752da88-1452-4fc4-ba80-2f6fb7385b19 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:17.857134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7752da88-1452-4fc4-ba80-2f6fb7385b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:18.028966 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3661/7340] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:18.035034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746121-25da-44e9-a723-2d93484c64ee None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.035336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746121-25da-44e9-a723-2d93484c64ee None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.035579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746121-25da-44e9-a723-2d93484c64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.090359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.090722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.091111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.093332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-55746121-25da-44e9-a723-2d93484c64ee None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:18.094575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55746121-25da-44e9-a723-2d93484c64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:18.123122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3680/7341] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:18.126942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746121-25da-44e9-a723-2d93484c64ee None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.162595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] MFA Rules not processed for user `ea05b9cbccbe4fa298503a412b287e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:18.163847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:18.167076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746121-25da-44e9-a723-2d93484c64ee None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.175357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.176030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.176309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.176577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.180660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:25:18.181063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.185917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.217198 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3681/7342] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:25:18.218211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.228535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:18.240805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30bb8-835f-4928-9f87-0330a0b5af79 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.253561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.254692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.256783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.257275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.259122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.266915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.274775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:18.343788 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3682/7343] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:25:18 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:18.355831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.373045 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3662/7344] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:18.565512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc972d4-3dc7-4391-a9f0-fe335e4952d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.579305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.580222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.581296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.581796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.585032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.587449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.674290 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3683/7345] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:25:18 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:18.678400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.698578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bfa24-7a97-4dc6-9338-6feab5be05f0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.714081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.714869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.715253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.715628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.716597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.718907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.736787 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3663/7346] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:18.741143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.757673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799a78-f369-482a-9a6c-fc5d632848bc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.772244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.773072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.773466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.773852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.775020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.776473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8f58-7353-4b28-b3bd-058b5e4827af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.808096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:18.815172 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3684/7347] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:18.820679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b57fd-a4e7-4a5d-a4b9-242e6d1e2776 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:18.838312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:18.839187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.839575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.839958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] PATH_INFO: `/v3/projects/d68091b6ebbb41a8b8ca1f08b575f941/users/bbd8a327adbe4fd1b30ea20a1d2b5b1d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:18.875391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68091b6ebbb41a8b8ca1f08b575f941, user_id=bbd8a327adbe4fd1b30ea20a1d2b5b1d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:18.883009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:18.935482 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3664/7348] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:25:18 2022] PUT /identity/v3/projects/d68091b6ebbb41a8b8ca1f08b575f941/users/bbd8a327adbe4fd1b30ea20a1d2b5b1d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:18.946694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:18.946983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:18.947257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:19.016432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] MFA Rules not processed for user `bbd8a327adbe4fd1b30ea20a1d2b5b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:19.017701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:19.200107 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3685/7349] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:19.211317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:19.213483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:19.332339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cdf0b-f9e8-4aef-abbd-abff91868b86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:19.346700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:19.347336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:19.347617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:19.347892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:19.363272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:19.364888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d85d8-569b-42a1-807e-25e2c11e0dc9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:19.376539 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3665/7350] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:29.191618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=74,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:29.371009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=49,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:33.008200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:33.214252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbd3b-dc2d-4c96-a146-39daf7ef355c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:33.219088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:33.219734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:33.220010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:33.220279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] PATH_INFO: `/v3/users/bbd8a327adbe4fd1b30ea20a1d2b5b1d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:33.221687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd8a327adbe4fd1b30ea20a1d2b5b1d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:33.223624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:33.324921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd8a327adbe4fd1b30ea20a1d2b5b1d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:33.326034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd8a327adbe4fd1b30ea20a1d2b5b1d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:33.345457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd8a327adbe4fd1b30ea20a1d2b5b1d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:33.357732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd8a327adbe4fd1b30ea20a1d2b5b1d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:33.362164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd8a327adbe4fd1b30ea20a1d2b5b1d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:33.389169 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3686/7351] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:33 2022] DELETE /identity/v3/users/bbd8a327adbe4fd1b30ea20a1d2b5b1d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:33.394154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:33.394699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:33.394699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:33.427907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:33.431484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:33.582799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3666/7352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:33.597441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:33.599172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:33.684003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:33.685661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:33.805765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64954-21e4-4308-b753-da71303febf5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:33.830117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:33.830925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:33.831344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:33.831621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:33.847247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:33.848717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:33.888653 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3687/7353] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:33.890541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418fd90-e914-41cf-9681-7b7ac6a1c822 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:33.901076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:33.902459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:33.902459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:33.902459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:33.917682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:34.185380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:34.186844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b2ebb-be3e-42e4-b47a-0184aadaec43 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:34.221737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3667/7354] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:25:34.460260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:34.461938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:34.480093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092428b7-3a04-49ff-8a08-2fdbb72d87d1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:34.499696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:34.500441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:34.500802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:34.503472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] PATH_INFO: `/v3/projects/d68091b6ebbb41a8b8ca1f08b575f941` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:34.505617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68091b6ebbb41a8b8ca1f08b575f941)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:34.507860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:34.551070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:34.619822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68091b6ebbb41a8b8ca1f08b575f941', 'request_id': 'req-4344ea48-b45a-44db-b6f8-916271d3d155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:34.633912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68091b6ebbb41a8b8ca1f08b575f941', 'request_id': 'req-4344ea48-b45a-44db-b6f8-916271d3d155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:34.654681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68091b6ebbb41a8b8ca1f08b575f941', 'request_id': 'req-4344ea48-b45a-44db-b6f8-916271d3d155'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:34.677647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] The token cache is being invalidate because project d68091b6ebbb41a8b8ca1f08b575f941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:34.677947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:34.685914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4344ea48-b45a-44db-b6f8-916271d3d155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:34.687702 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3688/7355] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:34 2022] DELETE /identity/v3/projects/d68091b6ebbb41a8b8ca1f08b575f941 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:34.711138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:34.711736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:34.711736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:34.756305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:34.757916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:34.864250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:34.947656 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3668/7356] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:34.953940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:34.954223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:34.954540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.000368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:35.001977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:35.030254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3689/7357] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:35.031715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.058119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc833f-db17-48fb-ac5a-edfa692bcc02 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.081694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.082466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.082837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.083205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.084334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:25:35.084732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.086773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.112097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3669/7358] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:25:35.113326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.132047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140479ee-84a4-4b41-b128-bf78c4cb5f9f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.140067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.141004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.141701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.142400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.145047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.161524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.251378 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3690/7359] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:25:35 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:35.253427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.295704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1fe3-098e-429f-91a5-1f0d2f0959e8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.548027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.550137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.550137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.550416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.551043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.553359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.616071 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3670/7360] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:25:35 2022] POST /identity/v3/users => generated 285 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:35.620116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.638937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26194b-607a-499e-8d23-c494a366e337 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.649694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.650325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.650597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.650865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.652220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.660533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.693379 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3691/7361] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:35.694672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.719898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2c9c-0744-48f7-8ca4-ed0b0d8fbaf0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.730134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.731543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.731543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.731766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.732405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.734042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1939f-84ec-4f03-b4be-e2c6decc888d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.772883 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3671/7362] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:35.778877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:35.807295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f89c9a-812a-4372-9086-5fdbe8ea173d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:35.826102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:35.826904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.827183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.827450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] PATH_INFO: `/v3/projects/64e05484e43141c6bb3380354b18237a/users/ec8d3ca2a8ff49798e0f6ba562d1c1e6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:35.904471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e05484e43141c6bb3380354b18237a, user_id=ec8d3ca2a8ff49798e0f6ba562d1c1e6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:35.904471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:35.976637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3692/7363] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:25:35 2022] PUT /identity/v3/projects/64e05484e43141c6bb3380354b18237a/users/ec8d3ca2a8ff49798e0f6ba562d1c1e6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:35.992772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:35.998540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:35.998917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:36.093819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] MFA Rules not processed for user `ec8d3ca2a8ff49798e0f6ba562d1c1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:36.095371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:36.277678 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3672/7364] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:36.289272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:36.291467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:36.427016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2036c-bb60-4478-a188-83b9a91a9737 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:36.435475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:36.436338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:36.436668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:36.437094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:36.468866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:36.471418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:36.506183 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3693/7365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:44.082965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:44.099931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69fa67-a595-428f-a627-69d37ba8b66e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:44.133007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:44.133879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:44.141056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:44.141056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:44.144803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:44.194903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:44.236125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:44.238856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69f83-ce85-4a8e-bf1e-795922a61819 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:44.254371 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3673/7366] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:46.485811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:50.127395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:50.128988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:50.274340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c8dee-4abe-4355-b64a-357c5b7f9940 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:50.289956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:50.290862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:50.290998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:50.291280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] PATH_INFO: `/v3/users/735cb543df9a480cb60de622526aad52` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:50.292618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735cb543df9a480cb60de622526aad52)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:50.295222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:50.418607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735cb543df9a480cb60de622526aad52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:50.419816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735cb543df9a480cb60de622526aad52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:50.441530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735cb543df9a480cb60de622526aad52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:50.456840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735cb543df9a480cb60de622526aad52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:50.458500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735cb543df9a480cb60de622526aad52'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:50.507446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3694/7367] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:50 2022] DELETE /identity/v3/users/735cb543df9a480cb60de622526aad52 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:50.512973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:50.514650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:50.515119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:50.563588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:50.566231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:50.705597 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3674/7368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:50.733916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:50.735628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:50.911535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478f04-b552-4b42-8c9a-a8c85f8379b2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:50.925632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:50.926264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:50.926548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:50.926825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:50.952284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:50.958248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584bdd0-3845-4f6d-846a-a328efd57329 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:50.989018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3695/7369] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:51.679812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:51.681465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:51.708783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a58e-0d49-42cb-8fc1-21cf0f3c92a1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:51.714475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:51.715914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:51.716305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:51.716679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] PATH_INFO: `/v3/projects/fafa0e8262b54463a9ce5d3d58519852` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:51.718052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafa0e8262b54463a9ce5d3d58519852)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:51.721436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:51.831720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafa0e8262b54463a9ce5d3d58519852', 'request_id': 'req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:51.839882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafa0e8262b54463a9ce5d3d58519852', 'request_id': 'req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:51.862580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafa0e8262b54463a9ce5d3d58519852', 'request_id': 'req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:51.880344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] The token cache is being invalidate because project fafa0e8262b54463a9ce5d3d58519852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:25:51.880638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:51.882046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8bc5e8e6-ca84-4c81-ac3f-85bc754ad6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:51.887056 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3675/7370] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:25:51 2022] DELETE /identity/v3/projects/fafa0e8262b54463a9ce5d3d58519852 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:51.888573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:51.889059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:51.889250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:51.918460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:51.920124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:51.945255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:52.014987 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3696/7371] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:52.024551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.024878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.025192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.073510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:52.075832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:52.090204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3676/7372] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:52.091135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.104322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a2df0-b593-48cf-ade8-1bfca33dfe0b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.109570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.110516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.111174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.112169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.113038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:25:52.113515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.115348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.136387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.141599 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3697/7373] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:25:52.169790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d5a62-cdec-426d-93ad-860503040752 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.184033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.185926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.186423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.187100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.188082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.190625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.314178 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3677/7374] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:25:52 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:25:52.319616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.333436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1da50-dd9a-4ce8-b927-5655f3b62707 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.491066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.491804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.492204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.492572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.493548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.497453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.544959 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3698/7375] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:25:52 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:25:52.546528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.560467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fba17-986e-4a31-a0e0-3e259153e36b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.568257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.569347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.569853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.570258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.572440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.574235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.607772 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3678/7376] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:52.611966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.626177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caec45-0763-482b-a137-5e213511bbea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.642358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.643897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.644189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.644460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.645146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.646775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67eda4-beee-4865-be4e-321436ffd501 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.678308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3699/7377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:25:52.681955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:52.703057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442cb3-8ccb-4d7f-8597-07d4df945449 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:52.717292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:52.718571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.719621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.721657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] PATH_INFO: `/v3/projects/d1abb2b7300b44b4af7b177c76b74216/users/c3a28b4dcd9f4cdfb724f5b29ce26b16/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.781969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:52.787832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1abb2b7300b44b4af7b177c76b74216, user_id=c3a28b4dcd9f4cdfb724f5b29ce26b16, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:52.791243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:52.847963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3679/7378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:25:52 2022] PUT /identity/v3/projects/d1abb2b7300b44b4af7b177c76b74216/users/c3a28b4dcd9f4cdfb724f5b29ce26b16/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:52.857528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:52.857830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:52.858044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:52.907900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:52.909203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:53.044876 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3700/7379] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:53.063620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:53.066040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:53.291461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1026a1-a533-4a4a-92b2-55271905493f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:53.301135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:53.301786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:53.307854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:53.308189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:53.326587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:53.329316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75fe01-972e-4d73-9379-185c6b79ac9d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:53.356959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3680/7380] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:25:58.087678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:58.089109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:58.112321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247617-4aad-45dc-b203-dba5d1c8c0ed None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:58.135901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:58.136765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:58.137236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:58.137686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] PATH_INFO: `/v3/users/f1bf4b13cd36489189844d1654816b87` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:58.152400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bf4b13cd36489189844d1654816b87)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:58.154739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:58.239761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:58.301948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bf4b13cd36489189844d1654816b87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:58.302645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bf4b13cd36489189844d1654816b87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:58.324057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bf4b13cd36489189844d1654816b87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:58.334875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bf4b13cd36489189844d1654816b87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:58.346056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bf4b13cd36489189844d1654816b87'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:25:58.384314 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3701/7381] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:25:58 2022] DELETE /identity/v3/users/f1bf4b13cd36489189844d1654816b87 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:25:58.389259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:58.389901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:58.389901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:58.431815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:25:58.433097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:58.707335 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3681/7382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:25:58.870588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:25:58.872389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:25:58.998040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187ef1-b899-420a-85f4-1651a21d2d3f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:25:59.002003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:25:59.002629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:25:59.002905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:25:59.003339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:25:59.013970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:25:59.015610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:25:59.029904 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3702/7383] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:00.613039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:00.617279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:00.647485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057cfc-de16-46c6-8b09-30ba1e0df5a7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:00.662202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:00.666086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:00.666534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:00.667186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] PATH_INFO: `/v3/projects/17bd57af51bd4d71a3b2c6908e86462d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:00.671655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bd57af51bd4d71a3b2c6908e86462d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:00.676496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:00.822724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bd57af51bd4d71a3b2c6908e86462d', 'request_id': 'req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:00.831833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bd57af51bd4d71a3b2c6908e86462d', 'request_id': 'req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:00.849423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bd57af51bd4d71a3b2c6908e86462d', 'request_id': 'req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:00.880410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] The token cache is being invalidate because project 17bd57af51bd4d71a3b2c6908e86462d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:00.888219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:00.890545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:00.897004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3682/7384] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:00 2022] DELETE /identity/v3/projects/17bd57af51bd4d71a3b2c6908e86462d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:00.904023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:00.942026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a3d4-2ecd-462d-8aab-5824de9cfd35 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:01.185267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:01.185937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:01.186220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:01.186496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] PATH_INFO: `/v3/users/b348f62fbaa543569eab33dc5ef92678` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:01.188153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b348f62fbaa543569eab33dc5ef92678)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:01.192944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:01.359078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:01.369417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b348f62fbaa543569eab33dc5ef92678'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:01.371665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b348f62fbaa543569eab33dc5ef92678'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:01.397112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b348f62fbaa543569eab33dc5ef92678'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:01.414295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b348f62fbaa543569eab33dc5ef92678'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:01.415398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ffba81b4-7d0f-481d-af66-a1ae0c6f1fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b348f62fbaa543569eab33dc5ef92678'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:01.492505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3703/7385] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:00 2022] DELETE /identity/v3/users/b348f62fbaa543569eab33dc5ef92678 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:01.784857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:01.786034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:01.835334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:01.983858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae4e1-3ba7-4ae9-8cfe-b9a1863fd5e7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:02.248685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:02.249532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:02.249819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:02.250091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:02.256561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:02.452596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:02.454453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:02.478296 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3683/7386] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:03.115547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:03.116690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:03.117207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:03.174554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] MFA Rules not processed for user `c3a28b4dcd9f4cdfb724f5b29ce26b16`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:03.176251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:03.281812 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3704/7387] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:03.296319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:03.298045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:03.328519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01c38-b400-489e-ab24-e8e52f72d6ae service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:03.351896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:03.352533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:03.354520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:03.354806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:03.388319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:03.390002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b050d16-18b4-49f5-ba25-10a643b2e405 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:03.434656 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3684/7388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:03.539646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:03.542452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:03.717391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e100-9925-4bb9-b262-1fdda1c1b400 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:03.725571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:03.726832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:03.727721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:03.728107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] PATH_INFO: `/v3/projects/b032f3e8adca49e89585c633e38d5753` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:03.730181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b032f3e8adca49e89585c633e38d5753)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:03.735674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:03.843563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b032f3e8adca49e89585c633e38d5753', 'request_id': 'req-b3dc7867-d02a-4d49-9458-661dea272c03'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:03.851481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:03.856144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b032f3e8adca49e89585c633e38d5753', 'request_id': 'req-b3dc7867-d02a-4d49-9458-661dea272c03'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:03.879385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b032f3e8adca49e89585c633e38d5753', 'request_id': 'req-b3dc7867-d02a-4d49-9458-661dea272c03'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:03.911598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] The token cache is being invalidate because project b032f3e8adca49e89585c633e38d5753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:03.911897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:03.915607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b3dc7867-d02a-4d49-9458-661dea272c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:03.918629 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3705/7389] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:03 2022] DELETE /identity/v3/projects/b032f3e8adca49e89585c633e38d5753 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:03.923197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:03.924510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:03.924510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:03.962236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:03.963488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:04.056687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:04.129113 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3685/7390] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:04.252322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.252998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.253292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.302297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:04.303492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:04.322052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3706/7391] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:04.326699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.344010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afb0b5-43a0-416a-aacc-10f58a4810c3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.358590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.359507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.360513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.361229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.362274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:04.368017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.370307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.402748 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3686/7392] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:04.407079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.421550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab7a4e-2b27-4773-80f7-0e364ec12cb1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.434889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.435089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.435234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.435505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.436150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.438120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.492059 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3707/7393] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:04 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:04.496399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.508991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3612-de25-4052-8860-c5bbf148edf3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.599634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.601722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:04.672986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.676162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.676709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.677210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.680289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.684128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.730309 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3687/7394] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:04 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:04.731859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.733869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e09bf-c910-4732-8e02-7a6565d3d798 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.739460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.740267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.740650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.741067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] PATH_INFO: `/v3/users/ec8d3ca2a8ff49798e0f6ba562d1c1e6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.742409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8d3ca2a8ff49798e0f6ba562d1c1e6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.745563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.759188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3942e-8328-4d66-af17-53b36b96fa04 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.768661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.769325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.769611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.772792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.773708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.779583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.853482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8d3ca2a8ff49798e0f6ba562d1c1e6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:04.854797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8d3ca2a8ff49798e0f6ba562d1c1e6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:04.863797 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3688/7395] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:04.866005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.893286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8d3ca2a8ff49798e0f6ba562d1c1e6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:04.902507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ecfc5-94f0-4e9a-ae3a-a7abfa9dc12f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.912410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.913614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.914242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.914633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.915524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:04.917630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:04.918227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8d3ca2a8ff49798e0f6ba562d1c1e6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:04.920131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b603908-8068-4427-9783-db5ff2a56844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8d3ca2a8ff49798e0f6ba562d1c1e6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:04.935652 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3689/7396] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:04.936960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:04.939634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:04.957450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cb73-e02a-4934-8413-d031bae6964e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:04.979896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3708/7397] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:04 2022] DELETE /identity/v3/users/ec8d3ca2a8ff49798e0f6ba562d1c1e6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:04.981581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.981925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:04.982208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:04.996045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:04.997182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:04.999623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:05.000136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] PATH_INFO: `/v3/projects/93099a782d19458b8f118f4e5f3e89aa/users/64c1269a0c194ce8a03427742df5a451/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:05.010111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:05.013011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:05.034180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93099a782d19458b8f118f4e5f3e89aa, user_id=64c1269a0c194ce8a03427742df5a451, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:05.039028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85456a-1c7e-4b36-9187-2040aaec7d90 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:05.069172 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3690/7398] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:04 2022] PUT /identity/v3/projects/93099a782d19458b8f118f4e5f3e89aa/users/64c1269a0c194ce8a03427742df5a451/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:05.079815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:05.081022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:05.081557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:05.092036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:05.175434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3709/7399] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:05.187322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] MFA Rules not processed for user `64c1269a0c194ce8a03427742df5a451`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:05.193729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:05.201144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:05.202585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:05.363337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:05.368022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3d1b6-59f7-42ab-a0c8-7c5ad1d2981c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:05.393243 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3691/7400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:05.397316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:05.525539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:05.555761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:05.561890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:05.563217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:05.604677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a347a-ca3f-44dc-8f0a-85bbd53d4f07 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:05.609229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:05.616145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:05.629429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:05.630190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:05.630534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:05.630880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:05.631716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:05.633702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:05.655122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3710/7401] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:05.743022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3692/7402] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:05 2022] POST /identity/v3/projects => generated 381 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:05.746452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:05.759820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99d89a-1e81-4082-9288-9979f750d59e service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:05.911708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:05.912407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:05.912694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:05.912993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:05.913651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:05.919848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:05.971622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:05.972933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3711/7403] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:05 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:05.988667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d4ca8-5339-4257-ba1f-33378fc8215e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:06.004223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:06.004863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.005167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.005436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.006191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:06.007896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:06.031827 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3693/7404] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:06.037146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:06.054099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59c247-26a9-4437-a9b2-13565739e295 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:06.071656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:06.072523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.072806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.073102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] PATH_INFO: `/v3/projects/0c4749e7593240e89e2cfaa38be2c0de/users/7ece3e2325844dd79f0703681bba8523/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.109205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4749e7593240e89e2cfaa38be2c0de, user_id=7ece3e2325844dd79f0703681bba8523, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:06.114342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:06.140392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:06.149751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3712/7405] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:06 2022] PUT /identity/v3/projects/0c4749e7593240e89e2cfaa38be2c0de/users/7ece3e2325844dd79f0703681bba8523/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:06.153693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:06.169083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24175-38b9-4577-b358-2c17c1f573b5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:06.318054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:06.318682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.318959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.319231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.319906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:06.321548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece09887-da79-443a-bb0b-fbec61c32f5f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:06.348334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:06.349313 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3694/7406] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:06.360375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127fed3-7d4a-4929-8096-1216467400dc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:06.366315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:06.367984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.368507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.369680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] PATH_INFO: `/v3/projects/0c4749e7593240e89e2cfaa38be2c0de/users/7ece3e2325844dd79f0703681bba8523/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.372704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4749e7593240e89e2cfaa38be2c0de, user_id=7ece3e2325844dd79f0703681bba8523, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:06.382226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:06.415595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3713/7407] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:06 2022] PUT /identity/v3/projects/0c4749e7593240e89e2cfaa38be2c0de/users/7ece3e2325844dd79f0703681bba8523/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:06.427608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.428125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.428125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.483396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] MFA Rules not processed for user `7ece3e2325844dd79f0703681bba8523`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:06.484673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:06.607920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:06.649964 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3695/7408] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:06.663592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:06.665755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:06.780088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e89d3-f057-4aad-a502-dcc8742ff4e4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:06.789645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:06.790405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:06.790548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:06.790825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:06.823071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:06.824551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:06.829421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:06.831614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:06.870433 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3714/7409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:07.005226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:07.019141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c160cc-3fb0-43c3-9c1c-431336f8baff None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:07.022008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a31fce-e6d4-4f88-9c67-44ac5549029c service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:07.023931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:07.024688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.024931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.025260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] PATH_INFO: `/v3/projects/64e05484e43141c6bb3380354b18237a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.026426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e05484e43141c6bb3380354b18237a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:07.028477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:07.037166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:07.038241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.039114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.039604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.099334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e05484e43141c6bb3380354b18237a', 'request_id': 'req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:07.107649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e05484e43141c6bb3380354b18237a', 'request_id': 'req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:07.118689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e05484e43141c6bb3380354b18237a', 'request_id': 'req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:07.137995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] The token cache is being invalidate because project 64e05484e43141c6bb3380354b18237a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:07.138304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:07.138979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0bc714c5-41ca-4b21-ae9d-163d1cb46e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:07.140944 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3696/7410] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:06 2022] DELETE /identity/v3/projects/64e05484e43141c6bb3380354b18237a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:07.147419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.147419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.147419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.176618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:07.178219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:07.189927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:07.193296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aea9d-e409-471c-a46b-4ec329789cb6 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:07.235786 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3715/7411] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:07.351275 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3697/7412] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:07.359665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.359988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.360317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.414931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:07.416967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:07.447771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3716/7413] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:07.449221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:07.478473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b52270-c3b2-48ae-aad1-a17db2fa44bc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:07.497649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:07.498482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.498592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.498820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.499477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:07.500386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:07.519563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:07.566188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3698/7414] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:26:07.570949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:07.623273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9809a-2545-4564-9cf1-21c4e9b06cf4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:07.644472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:07.647433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.649676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.650128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.651994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:07.664754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:07.762343 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3717/7415] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:07 2022] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:07.767370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:07.783234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614f72b-3a2b-4011-9978-349f3c778e01 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:07.797411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:07.959361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:07.960300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:07.961238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:07.961671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:07.963396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:07.965805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:07.996470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3699/7416] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:07 2022] POST /identity/v3/users => generated 280 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:08.000334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:08.011883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe990b6-53c9-4825-b96c-49028f30a5cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:08.018217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:08.019200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.021277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.021794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.022670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:08.026833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:08.055344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3718/7417] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:08.059604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:08.074194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e750-600c-46d3-8ca1-9cd277da0667 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:08.085823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:08.089873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.090655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.091156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.092942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:08.094944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007cc1-382d-4bb4-af2c-c6451dd13e49 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:08.124968 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3700/7418] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:08.129416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:08.155787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c424-5299-4f90-8e09-a90d85692772 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:08.162606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:08.163632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.164111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.164577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] PATH_INFO: `/v3/projects/c3b171505c124179844ba921fef7a431/users/7a38b1f56f9b41d9825ffdf3399fe4ac/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.183745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b171505c124179844ba921fef7a431, user_id=7a38b1f56f9b41d9825ffdf3399fe4ac, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:08.194113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:08.229660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3719/7419] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:08 2022] PUT /identity/v3/projects/c3b171505c124179844ba921fef7a431/users/7a38b1f56f9b41d9825ffdf3399fe4ac/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:08.229787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.230164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.230505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.292103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] MFA Rules not processed for user `7a38b1f56f9b41d9825ffdf3399fe4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:08.293999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:08.422339 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3701/7420] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:08.427454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:08.469077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:08.710226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff19c6a-898d-473b-b350-cb5d33653311 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:08.717599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:08.718642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.719052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.719422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.720166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:08.735609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:08.773061 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3720/7421] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:08 2022] POST /identity/v3/projects => generated 363 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:08.774931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:08.796718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dd10f-4836-4368-96b7-e039e4669880 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:08.920529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:08.921408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:08.921690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:08.921959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:08.922764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:08.925748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:08.981260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3702/7422] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:08 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:08.986745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:09.010888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a47071-8e35-4577-b617-8b1dde4a41f3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:09.026369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:09.027005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:09.027294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:09.027570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:09.031613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:09.043199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:09.093834 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3721/7423] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:09.094410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:09.116516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e433014-9b84-4aa9-8578-180bd73e8ffa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:09.136333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:09.137107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:09.137390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:09.137666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] PATH_INFO: `/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc/users/15f8e78c5a1741bb95f85717c29511f4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:09.143980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:09.192006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fc0f030d3947f2a21ced106f5e3bfc, user_id=15f8e78c5a1741bb95f85717c29511f4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:09.201297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:09.255832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3703/7424] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:09 2022] PUT /identity/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc/users/15f8e78c5a1741bb95f85717c29511f4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:09.258358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:09.297051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5a90-0762-45e1-9ac7-aef65387fa9a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:09.555397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:09.556023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:09.559410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:09.559774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:09.560453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:09.562170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752712c-da97-4c30-a049-93d3383fc8f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:09.614946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3722/7425] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:09.617685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:09.633828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d6f4-e6ff-4a46-81fb-0b6ae8697e3c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:09.643375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:09.644065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:09.644345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:09.644618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] PATH_INFO: `/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc/users/15f8e78c5a1741bb95f85717c29511f4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:09.651265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fc0f030d3947f2a21ced106f5e3bfc, user_id=15f8e78c5a1741bb95f85717c29511f4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:09.674594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:09.732036 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3704/7426] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:09 2022] PUT /identity/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc/users/15f8e78c5a1741bb95f85717c29511f4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:09.744468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b635-e00e-475e-86dc-e12bbbe8fadb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:09.745197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b635-e00e-475e-86dc-e12bbbe8fadb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:09.745619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b635-e00e-475e-86dc-e12bbbe8fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:09.808994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d387b635-e00e-475e-86dc-e12bbbe8fadb None None] MFA Rules not processed for user `15f8e78c5a1741bb95f85717c29511f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:09.810239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d387b635-e00e-475e-86dc-e12bbbe8fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:09.972036 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3723/7427] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:09.979712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:09.981998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:10.096719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60c9b-12cc-49e4-8d94-89fb90bfa841 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:10.097043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60c9b-12cc-49e4-8d94-89fb90bfa841 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:10.097342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60c9b-12cc-49e4-8d94-89fb90bfa841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:10.111670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12804e6-fff7-4905-9175-a632d611ae9f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:10.119078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:10.120131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:10.120691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:10.121238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:10.143660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:10.145598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:10.164686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2ab60c9b-12cc-49e4-8d94-89fb90bfa841 None None] MFA Rules not processed for user `c3a28b4dcd9f4cdfb724f5b29ce26b16`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:10.164851 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3705/7428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:10.165916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2ab60c9b-12cc-49e4-8d94-89fb90bfa841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:10.213596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:10.394059 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3724/7429] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:11.088869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:11.252353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589625e1-7480-438d-b6a7-737b84348157 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:11.268454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:11.269358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:11.269641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:11.269914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] PATH_INFO: `/v3/users/7a38b1f56f9b41d9825ffdf3399fe4ac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:11.271084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a38b1f56f9b41d9825ffdf3399fe4ac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:11.273704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:11.339324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a38b1f56f9b41d9825ffdf3399fe4ac'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:11.340068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a38b1f56f9b41d9825ffdf3399fe4ac'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:11.340845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a38b1f56f9b41d9825ffdf3399fe4ac'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:11.355810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a38b1f56f9b41d9825ffdf3399fe4ac'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:11.370552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a38b1f56f9b41d9825ffdf3399fe4ac'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:11.392964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:11.418202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:11.418751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:11.418751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:11.421537 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3706/7430] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:11 2022] DELETE /identity/v3/users/7a38b1f56f9b41d9825ffdf3399fe4ac => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:11.442075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:11.443353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:11.525800 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3725/7431] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:11.547358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:11.549528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:11.684349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497537d1-1ad6-47d0-8257-baf6c7e83d8b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:11.691285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:11.692724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:11.693258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:11.693673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:11.716460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:11.717947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:11.741648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3707/7432] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:12.748348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:12.750752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:12.768589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce915-f85c-4ca7-ba5d-8f775e2fdb3d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:12.776839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:12.777999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:12.778972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:12.779588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] PATH_INFO: `/v3/projects/c3b171505c124179844ba921fef7a431` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:12.783665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b171505c124179844ba921fef7a431)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:12.786758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:12.889662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b171505c124179844ba921fef7a431', 'request_id': 'req-e11ac266-b58a-4a62-ac00-73863d7fd83b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:12.907281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b171505c124179844ba921fef7a431', 'request_id': 'req-e11ac266-b58a-4a62-ac00-73863d7fd83b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:12.923109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b171505c124179844ba921fef7a431', 'request_id': 'req-e11ac266-b58a-4a62-ac00-73863d7fd83b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:12.948097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] The token cache is being invalidate because project c3b171505c124179844ba921fef7a431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:12.952250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:12.954155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:12.958723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3726/7433] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:12 2022] DELETE /identity/v3/projects/c3b171505c124179844ba921fef7a431 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:12.963197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:12.976168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347b077-56f5-4852-a937-49a988f0a305 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:13.066512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:13.068040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:13.069405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:13.069764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] PATH_INFO: `/v3/users/15f8e78c5a1741bb95f85717c29511f4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:13.072449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f8e78c5a1741bb95f85717c29511f4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:13.077778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:13.203092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f8e78c5a1741bb95f85717c29511f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:13.203975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f8e78c5a1741bb95f85717c29511f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:13.205216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f8e78c5a1741bb95f85717c29511f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:13.225858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f8e78c5a1741bb95f85717c29511f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:13.236966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-78bd3245-f749-4a05-9957-d08139f9845a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f8e78c5a1741bb95f85717c29511f4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:13.266300 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3708/7434] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:12 2022] DELETE /identity/v3/users/15f8e78c5a1741bb95f85717c29511f4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:14.701971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:14.703368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:14.836692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac266-b58a-4a62-ac00-73863d7fd83b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:15.083641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:15.113343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:15.114411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.114837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.115420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] PATH_INFO: `/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.117752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fc0f030d3947f2a21ced106f5e3bfc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:15.120547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:15.226945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fc0f030d3947f2a21ced106f5e3bfc', 'request_id': 'req-8822da4f-8989-4d89-9626-55d38d3b42f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:15.242644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fc0f030d3947f2a21ced106f5e3bfc', 'request_id': 'req-8822da4f-8989-4d89-9626-55d38d3b42f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:15.269902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fc0f030d3947f2a21ced106f5e3bfc', 'request_id': 'req-8822da4f-8989-4d89-9626-55d38d3b42f8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:15.310367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] The token cache is being invalidate because project 77fc0f030d3947f2a21ced106f5e3bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:15.310852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:15.311799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8822da4f-8989-4d89-9626-55d38d3b42f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:15.314821 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3727/7435] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:14 2022] DELETE /identity/v3/projects/77fc0f030d3947f2a21ced106f5e3bfc => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:15.319160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.319624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.319699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.367644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:15.369739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:15.388151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:15.495552 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3709/7436] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:15.504752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.505099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.505457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.536441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:15.540618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:15.561753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3728/7437] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:15.567049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:15.584590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f592-6d31-4423-b396-c097b615c8f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:15.597131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:15.597960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.598373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.598778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.599581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:15.600014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:15.614888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:15.638656 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3710/7438] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:15.639782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:15.653276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d9be-fbeb-400c-bb3f-e21c7bd6f93b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:15.676103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:15.677047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.677468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.677932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.678723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:15.680806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:15.724215 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3729/7439] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:15 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:15.726384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:15.740569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f98f-2e46-42ea-81e2-c364b696c307 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:15.886562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:15.887573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.888884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.889353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.890146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:15.892502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:15.951176 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3711/7440] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:15 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:15.951705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:15.968013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9e692-8568-4303-8160-88a3a6f07ad4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:15.981500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:15.982326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:15.982751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:15.983226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:15.984085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:15.987344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:16.026158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3730/7441] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:26:16.027934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:16.075005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb7e6-ebbd-4a5f-9629-c4139c25f902 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:16.091205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:16.092095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:16.092376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:16.092964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:16.114023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:16.116824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2547b-3b77-4dd2-a774-77cdd0960c04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:16.150286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:16.153441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3712/7442] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:16.191447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ea24-8a2d-43dc-88ce-cc72e3c15479 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:16.203490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:16.204209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:16.205179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:16.205455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] PATH_INFO: `/v3/projects/032e4a13d3524da69396649c0122f36e/users/96b0806beca74f948df4d658890486c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:16.242589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032e4a13d3524da69396649c0122f36e, user_id=96b0806beca74f948df4d658890486c0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:16.255181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:16.319519 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3731/7443] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:16 2022] PUT /identity/v3/projects/032e4a13d3524da69396649c0122f36e/users/96b0806beca74f948df4d658890486c0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:16.337696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:16.338138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:16.338747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:16.444189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] MFA Rules not processed for user `96b0806beca74f948df4d658890486c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:16.445456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:16.620209 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3713/7444] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:16.630685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:16.799367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551c36-4b11-40fa-abac-053494e0d738 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:16.811411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:16.812225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:16.813079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:16.813360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:16.817255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:16.822266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:16.890905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:16.930652 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3732/7445] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:16 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:16.935272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:16.964045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230c02-32ed-4e79-b326-e61aa80a5f47 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:16.979959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:17.153046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.154438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.154859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.155595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.156512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.163036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:17.220782 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3714/7446] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:16 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:17.222452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.240533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab661d-8cb8-4322-a5bd-113dfeab892a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.259796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.260508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.260876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.261233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.262070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.264621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:17.289539 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3733/7447] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:17.292960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.311116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896241b-b2fd-48d5-b713-4797e92fb86c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.318373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.322293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.322794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.323217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] PATH_INFO: `/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da/users/2d78b772b4ba467f8c73a5f9e97a4bc5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.461828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1213bf30f84a4daccd8a0afdcc44da, user_id=2d78b772b4ba467f8c73a5f9e97a4bc5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.485051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:17.533391 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3715/7448] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:17 2022] PUT /identity/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da/users/2d78b772b4ba467f8c73a5f9e97a4bc5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:17.537217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.551292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a808b-63f9-4112-a06a-ff94b0ae4da6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.682377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.683792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:17.719262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.720013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.721018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.722415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.723470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.731091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:17.757999 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3734/7449] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:17.758782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.779985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:17.889459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632150b-1af5-4354-920c-610dd78a6ff4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.899968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.902046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.902486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.904001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.907727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:17.933210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.936225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:17.952322 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3716/7450] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:17.953599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:17.968797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623fcde-3cdb-4f70-a542-c9dc2aaa01e5 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.982965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740ceb-b039-4070-abc1-9e7da8a30a84 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:17.986830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.988147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.988562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.989015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] PATH_INFO: `/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da/users/2d78b772b4ba467f8c73a5f9e97a4bc5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.992147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:17.993481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1213bf30f84a4daccd8a0afdcc44da, user_id=2d78b772b4ba467f8c73a5f9e97a4bc5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:17.995179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:17.995709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:17.996187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:17.997232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a783e7f-d546-4bf6-b2d7-397c13c7c0ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:18.001974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:18.012422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3717/7451] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:17 2022] PUT /identity/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da/users/2d78b772b4ba467f8c73a5f9e97a4bc5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:18.022939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:18.023291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:18.023636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:18.047681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:18.051415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:18.078015 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3735/7452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:18.096816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] MFA Rules not processed for user `2d78b772b4ba467f8c73a5f9e97a4bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:18.098824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:18.224485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:18.270875 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3718/7453] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:18.282061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:18.288275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:18.447491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60014c-74dd-42a1-ae7f-c523da3449d7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:18.544714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:18.565227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:18.565868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:18.566771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:18.567090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:18.617592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:18.623411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:18.659008 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3736/7454] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:18.796396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:18.800782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:18.875408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6fc3-9b6d-4494-b21d-0ac79c1a2f0a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:18.880225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:18.881066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:18.881494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:18.881908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:19.056945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:19.056945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5547d2-8947-463d-82a2-9a7d47741bf2 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:19.075900 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3719/7455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:23.031882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:23.170127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f67da-66e3-482d-a419-9dcc5276d238 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:23.180702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:23.181406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:23.181689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:23.181962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] PATH_INFO: `/v3/users/96b0806beca74f948df4d658890486c0` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:23.183158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b0806beca74f948df4d658890486c0)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:23.185207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:23.280964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b0806beca74f948df4d658890486c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:23.281662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b0806beca74f948df4d658890486c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:23.303040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b0806beca74f948df4d658890486c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:23.321932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b0806beca74f948df4d658890486c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:23.322720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b0806beca74f948df4d658890486c0'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:23.365505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3737/7456] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:23 2022] DELETE /identity/v3/users/96b0806beca74f948df4d658890486c0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:23.367049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:23.367975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:23.368430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:23.411159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:23.412406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:23.582864 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3720/7457] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:23.603204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:23.604925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:23.764383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b860d-ee33-41ae-981b-ebbb2d0d0a20 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:23.791271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:23.791906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:23.792187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:23.792476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:23.814262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:23.815750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b812-25c0-42a7-b0fa-a8610d52572a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:23.842392 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3738/7458] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:24.486306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:24.487914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:24.513661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07d14-1c83-45a6-b741-70bb10666e85 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:24.525325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:24.528775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:24.529100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:24.530724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] PATH_INFO: `/v3/users/b9d1964980794cd89161a90d0d8ce64f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:24.534907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d1964980794cd89161a90d0d8ce64f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:24.536892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:24.683055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d1964980794cd89161a90d0d8ce64f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:24.687251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d1964980794cd89161a90d0d8ce64f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:24.689270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d1964980794cd89161a90d0d8ce64f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:24.711882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d1964980794cd89161a90d0d8ce64f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:24.730819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d1964980794cd89161a90d0d8ce64f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:24.788071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:24.804189 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3721/7459] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:24 2022] DELETE /identity/v3/users/b9d1964980794cd89161a90d0d8ce64f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:24.808444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:24.809395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:24.809838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:24.843319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:24.859215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:24.863899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:25.013381 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3739/7460] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:25.043976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:25.045979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:25.322308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769ead-bb8a-4ce1-933d-60df4109ee42 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:25.340035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:25.340677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:25.349013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:25.349390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:25.384265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:25.385761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec30bb-d41a-42bd-b6d5-91760be3b179 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:25.414153 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3722/7461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:25.453722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:25.455926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:25.472117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62a154-8741-44c1-9776-d2731cbd710b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:25.478355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:25.479610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:25.480110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:25.480573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] PATH_INFO: `/v3/users/64c1269a0c194ce8a03427742df5a451` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:25.482378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c1269a0c194ce8a03427742df5a451)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:25.486098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:25.595891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c1269a0c194ce8a03427742df5a451'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:25.596375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c1269a0c194ce8a03427742df5a451'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:25.614418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c1269a0c194ce8a03427742df5a451'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:25.625082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c1269a0c194ce8a03427742df5a451'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:25.625854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c1269a0c194ce8a03427742df5a451'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:25.667896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3740/7462] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:25 2022] DELETE /identity/v3/users/64c1269a0c194ce8a03427742df5a451 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:25.672754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:25.674589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:25.675078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:25.761026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:25.766221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:25.802408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:25.803891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:25.986709 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3723/7463] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:26.022455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770c445-7b1d-4a7a-a03c-650ea4f21bfa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:26.041110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:26.041775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.042061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.042337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] PATH_INFO: `/v3/projects/032e4a13d3524da69396649c0122f36e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.047544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032e4a13d3524da69396649c0122f36e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:26.049595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:26.093428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:26.096603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.139238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:26.204817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032e4a13d3524da69396649c0122f36e', 'request_id': 'req-560acb92-7412-4f28-b5fb-d2375db6c4d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.215639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032e4a13d3524da69396649c0122f36e', 'request_id': 'req-560acb92-7412-4f28-b5fb-d2375db6c4d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.234073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032e4a13d3524da69396649c0122f36e', 'request_id': 'req-560acb92-7412-4f28-b5fb-d2375db6c4d1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.248149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461649-a784-4df4-bdaf-ea1583beb2d2 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:26.260940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] The token cache is being invalidate because project 032e4a13d3524da69396649c0122f36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:26.261266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.262653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.271123 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3741/7464] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:25 2022] DELETE /identity/v3/projects/032e4a13d3524da69396649c0122f36e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:26.273351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:26.275793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.363408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:26.364253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.364629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.365082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.368611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.399496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:26.459009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560acb92-7412-4f28-b5fb-d2375db6c4d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:26.463951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:26.464600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.464878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.465224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] PATH_INFO: `/v3/users/2d78b772b4ba467f8c73a5f9e97a4bc5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.466389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d78b772b4ba467f8c73a5f9e97a4bc5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:26.468473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:26.513377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:26.516476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:26.544083 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3724/7465] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:26.550060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d78b772b4ba467f8c73a5f9e97a4bc5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.551110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d78b772b4ba467f8c73a5f9e97a4bc5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.565168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d78b772b4ba467f8c73a5f9e97a4bc5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.605481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d78b772b4ba467f8c73a5f9e97a4bc5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.609226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a3404f8c-ccae-4340-9ec3-f9e6a6ee44b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d78b772b4ba467f8c73a5f9e97a4bc5'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:26.661461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3742/7466] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:26 2022] DELETE /identity/v3/users/2d78b772b4ba467f8c73a5f9e97a4bc5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:26.981856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:26.983354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.996767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f5fd3-bfda-40eb-9f76-08da50fb3ee1 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.075932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.076932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.077232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.077654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] PATH_INFO: `/v3/projects/9bbec6170ffa47c6ab74e04afe41e6f8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.078866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbec6170ffa47c6ab74e04afe41e6f8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.080951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.139707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbec6170ffa47c6ab74e04afe41e6f8', 'request_id': 'req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:27.149937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbec6170ffa47c6ab74e04afe41e6f8', 'request_id': 'req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:27.160501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbec6170ffa47c6ab74e04afe41e6f8', 'request_id': 'req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:27.174935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] The token cache is being invalidate because project 9bbec6170ffa47c6ab74e04afe41e6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:27.175162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:27.175954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1b27ab4c-fea0-4e8a-98e2-b9e84ed3f473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:27.177966 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3725/7467] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:26 2022] DELETE /identity/v3/projects/9bbec6170ffa47c6ab74e04afe41e6f8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:27.182702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.183186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.183286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.206726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:27.207951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:27.236313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:27.315987 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3743/7468] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:27.323621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.324148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.324762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.368724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:27.373045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:27.409220 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3726/7469] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:27.410023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.429134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5671eb-5e35-43a0-9371-b492a464e4c1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.437360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.439123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.439836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.440368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.441493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:27.441989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.444251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.460552 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3744/7470] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:27.465442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.479902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad182-bd09-4f7d-a747-543c2ec89576 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.485196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.486436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.486739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.487003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.487635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.489574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.551911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.560864 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3727/7471] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:27 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:27.569021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a535-a27a-4113-bd02-40830c55197f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.682989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.684561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.685910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.686897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.687605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.692405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.742060 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3745/7472] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:27 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:27.745895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.757757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8674-bb9c-40aa-9318-ad6c393f788b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.763255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.764344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.764820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.765360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.766227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.768924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.776029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:27.787558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.798541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3728/7473] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:27.802351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b6bf-e9c3-4691-8616-465c7da65172 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.809044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.810802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.811186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.811558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.812329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.814839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa847d7-d12c-46dd-b141-34f75b1a51c1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.843289 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3746/7474] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:26:27.848722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.865129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dff3-9823-4cad-bd5b-562bd60c5d28 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.871776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.873516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.874215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.874215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] PATH_INFO: `/v3/projects/a7a7fcf4e3914ac2a206015645d9b239/users/143690efffdb48caa991f983cbeb0a1e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.895061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7fcf4e3914ac2a206015645d9b239, user_id=143690efffdb48caa991f983cbeb0a1e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.898076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.935525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3729/7475] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:27 2022] PUT /identity/v3/projects/a7a7fcf4e3914ac2a206015645d9b239/users/143690efffdb48caa991f983cbeb0a1e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:27.937534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.937811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.938095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.004122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] MFA Rules not processed for user `143690efffdb48caa991f983cbeb0a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:28.006023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.014904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:28.017884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.139089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3747/7476] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:28.151876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658391-5c13-4864-8368-e933040945f2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:28.152881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:28.155313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.169006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:28.169666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.169947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.170232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] PATH_INFO: `/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.171683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1213bf30f84a4daccd8a0afdcc44da)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:28.173849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:28.221098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:28.283770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669dadb-69d1-4129-888b-495cd0fde4cd None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:28.288883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1213bf30f84a4daccd8a0afdcc44da', 'request_id': 'req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.298817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1213bf30f84a4daccd8a0afdcc44da', 'request_id': 'req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.319219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1213bf30f84a4daccd8a0afdcc44da', 'request_id': 'req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.339498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] The token cache is being invalidate because project 6d1213bf30f84a4daccd8a0afdcc44da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:28.340176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.341108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.343480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3730/7477] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:28 2022] DELETE /identity/v3/projects/6d1213bf30f84a4daccd8a0afdcc44da => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:28.344695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:28.358438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.380519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:28.381152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.381926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.381926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.383588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.503658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a0b3-c21d-4fe8-ba2f-677a189a7b46 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:28.515559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:28.516894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.517585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.518062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] PATH_INFO: `/v3/projects/93099a782d19458b8f118f4e5f3e89aa` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.520024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93099a782d19458b8f118f4e5f3e89aa)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:28.522614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:28.525750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:28.527205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c2b56-8d39-4073-95cc-cc85be254c21 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:28.533940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:28.554773 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3748/7478] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:28.556124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50d7e-1982-4068-a7ab-6d0ac554595b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.556411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50d7e-1982-4068-a7ab-6d0ac554595b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.556692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50d7e-1982-4068-a7ab-6d0ac554595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.596598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-26a50d7e-1982-4068-a7ab-6d0ac554595b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:28.596598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26a50d7e-1982-4068-a7ab-6d0ac554595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.620184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3749/7479] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:28.628734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.629268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.629843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.677265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:28.680263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93099a782d19458b8f118f4e5f3e89aa', 'request_id': 'req-b2c51d98-2d96-41ad-81c6-bee95b9317e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.681001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.694804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93099a782d19458b8f118f4e5f3e89aa', 'request_id': 'req-b2c51d98-2d96-41ad-81c6-bee95b9317e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.710595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93099a782d19458b8f118f4e5f3e89aa', 'request_id': 'req-b2c51d98-2d96-41ad-81c6-bee95b9317e1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.743020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] The token cache is being invalidate because project 93099a782d19458b8f118f4e5f3e89aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:28.744286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.746367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:28.750612 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3731/7480] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:28 2022] DELETE /identity/v3/projects/93099a782d19458b8f118f4e5f3e89aa => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:28.756847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:28.760665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.846765 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3750/7481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:28.846765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:28.864130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.901731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f4ada-5958-4518-92ab-5b9ccb4419b6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:28.918501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:28.919628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.920239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.920698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] PATH_INFO: `/v3/users/7ece3e2325844dd79f0703681bba8523` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.922279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ece3e2325844dd79f0703681bba8523)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:28.925725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:28.943701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51d98-2d96-41ad-81c6-bee95b9317e1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:28.959922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:28.960713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:28.961114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:28.961482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:28.966003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:28.975407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:29.010376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.012072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.035961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3732/7482] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:29.036537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ece3e2325844dd79f0703681bba8523'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:29.037040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ece3e2325844dd79f0703681bba8523'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:29.037182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.050132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ece3e2325844dd79f0703681bba8523'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:29.059815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d4c-ce30-42e1-8fff-725268dbc4e2 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.072178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ece3e2325844dd79f0703681bba8523'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:29.073896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.074706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.075082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.075467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.075679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ece3e2325844dd79f0703681bba8523'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:29.076300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:29.076694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.082977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.105891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3733/7483] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:29.110295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.114352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:29.136528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c104d7-663d-4ca4-b601-3414349856c6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.149120 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3751/7484] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:28 2022] DELETE /identity/v3/users/7ece3e2325844dd79f0703681bba8523 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:29.154060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.156364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.156755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.157289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.158108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.161074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.235136 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3734/7485] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:29 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:29.246156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.348151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7825d-9f8b-45ef-8662-d5b2776c2763 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.437157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.438008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.439392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.439713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.440676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.443168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.487355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.499325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3752/7486] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:29 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:29.505812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f74b1-c2ac-4d1f-bb5e-133023e9350d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.521644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.524199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.524663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.525122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.525947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.529747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.558213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.573066 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3735/7487] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:29.575319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39d39-7cf4-42e0-ae02-46aaed183541 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.603149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.603793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.604072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.604341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.605580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.607387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1130d-ab42-44b4-bf3c-dce3ef87efaf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.623425 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3753/7488] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:29.625068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.649583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914632d-a8d8-4f29-83a9-376f19314961 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:29.666878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:29.666878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.667074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.667237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] PATH_INFO: `/v3/projects/ee771fc759694b1f9fe37b1e22d83c96/users/9dfe74835dbf42fab19a08e828fca7dd/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.711467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee771fc759694b1f9fe37b1e22d83c96, user_id=9dfe74835dbf42fab19a08e828fca7dd, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:29.714207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:29.748892 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3736/7489] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:29 2022] PUT /identity/v3/projects/ee771fc759694b1f9fe37b1e22d83c96/users/9dfe74835dbf42fab19a08e828fca7dd/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:29.749698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:29.750134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:29.750575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:29.818264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] MFA Rules not processed for user `9dfe74835dbf42fab19a08e828fca7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:29.820094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:29.860445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:29.918626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:29.920892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:29.968617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:30.051532 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3754/7490] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:30.052802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.139378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553117-5d96-49cd-8b29-2e92d7c8ec2a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.160091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.163872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.164156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.164434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] PATH_INFO: `/v3/projects/0c4749e7593240e89e2cfaa38be2c0de` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.169920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4749e7593240e89e2cfaa38be2c0de)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.174617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.244145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857a2f-6599-4665-8d38-3a0251e63741 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.252588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.254027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.254458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.254919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.255737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.257735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.309831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4749e7593240e89e2cfaa38be2c0de', 'request_id': 'req-1d3ce042-4596-4153-ad68-efb243fb5dc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:30.327759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4749e7593240e89e2cfaa38be2c0de', 'request_id': 'req-1d3ce042-4596-4153-ad68-efb243fb5dc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:30.341258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4749e7593240e89e2cfaa38be2c0de', 'request_id': 'req-1d3ce042-4596-4153-ad68-efb243fb5dc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:30.352388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3755/7491] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:30 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:30.356263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.365810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] The token cache is being invalidate because project 0c4749e7593240e89e2cfaa38be2c0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:30.366400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:30.368251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1d3ce042-4596-4153-ad68-efb243fb5dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:30.372986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3737/7492] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:29 2022] DELETE /identity/v3/projects/0c4749e7593240e89e2cfaa38be2c0de => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:30.377369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb5c-48b4-4a30-93fb-4fcfa5c04d23 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.378216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb5c-48b4-4a30-93fb-4fcfa5c04d23 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.378760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb5c-48b4-4a30-93fb-4fcfa5c04d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.425812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2dd4eb5c-48b4-4a30-93fb-4fcfa5c04d23 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:30.428885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2dd4eb5c-48b4-4a30-93fb-4fcfa5c04d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:30.499874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf20087-5f99-4e5f-bad8-019a678d7020 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.511859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.512659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.512766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.513031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.513667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.516278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.566761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3738/7493] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:30.575053 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3756/7494] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:30 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:30.576799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.578949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:30.579284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.583114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.585717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.594363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e356b-a15e-4dc4-8d0f-8731b994c06f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.600881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.602436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.602822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.603194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.604050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.606897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.630466 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3757/7495] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:30.631569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.645167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8714f9-a2a2-4fc2-b34b-675fbf2e92be admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.656939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.659729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.661107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.663475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] PATH_INFO: `/v3/projects/a165a2fda4c54359a2457f1071984f87/users/7ffbda37f49e4833bb9c611f73ba64c9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.677515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:30.677515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:30.699450 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3739/7496] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:30.704645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.714867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a165a2fda4c54359a2457f1071984f87, user_id=7ffbda37f49e4833bb9c611f73ba64c9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.723506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.729288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fadbb4-9b4e-488d-9312-bd8ec687d35f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.737897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:30.750199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.755271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.755817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.756091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.756782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:30.757108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.764952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3758/7497] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:30 2022] PUT /identity/v3/projects/a165a2fda4c54359a2457f1071984f87/users/7ffbda37f49e4833bb9c611f73ba64c9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:30.766245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.771299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.807533 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3740/7498] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:30.808606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:30.834739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745acbc-6693-4872-a917-9a40a0ec1533 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.891906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:30.940430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3db1d-9747-4b77-bad2-f4847e9a03db admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:30.954342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:30.955876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:30.956449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:30.956873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:30.957658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:30.959440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:30.992931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3759/7499] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:30.993990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.031770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.032419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.032698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.033011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.034917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.036831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.037562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfaa14-9ab9-4eda-852b-02425fc4dfb2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.059943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.060790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.061199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.061572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] PATH_INFO: `/v3/projects/a165a2fda4c54359a2457f1071984f87/users/7ffbda37f49e4833bb9c611f73ba64c9/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.064413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a165a2fda4c54359a2457f1071984f87, user_id=7ffbda37f49e4833bb9c611f73ba64c9, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.067416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae14140-2f5d-40ab-bf80-004f663128c7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.096658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3760/7500] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:30 2022] PUT /identity/v3/projects/a165a2fda4c54359a2457f1071984f87/users/7ffbda37f49e4833bb9c611f73ba64c9/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:31.097837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3741/7501] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:31.109803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.110351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.110774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.111271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.193510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] MFA Rules not processed for user `7ffbda37f49e4833bb9c611f73ba64c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:31.195107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:31.267332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5f36-ebbe-4b56-8281-776c2af18458 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.285970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.291500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.291798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.292228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.293381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.300675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.360577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3742/7502] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:31 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:31.366693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.395770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee88af-afb5-4100-8818-77d9daa99cb4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.414702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.415342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.415618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.415888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.416529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.418436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.435088 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3743/7503] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:31.439239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.445647 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3761/7504] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:31.458165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.459827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4c927-25c1-45c3-8f17-0f52873c4104 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.462584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:31.477621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.478378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.478824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.479194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.479943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.481696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.508126 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3744/7505] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:31.515406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.533509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590113-ad68-42bc-bdc4-ebcd80084606 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.562697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.566498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.568890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.569306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] PATH_INFO: `/v3/projects/a288cff9df7740e78720478d8a91fa85/users/b89ebbd16b9c42579cd78fcce6bf55b6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.627775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a288cff9df7740e78720478d8a91fa85, user_id=b89ebbd16b9c42579cd78fcce6bf55b6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.639624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f2263-95c7-44d5-bea9-92a182e00388 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.654544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367b5d-fc31-4884-9e76-6841f3a263f6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.662475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.664766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.665343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.666306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.669287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3745/7506] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:31 2022] PUT /identity/v3/projects/a288cff9df7740e78720478d8a91fa85/users/b89ebbd16b9c42579cd78fcce6bf55b6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:31.679598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.680035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.680374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.703432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:31.707542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:31.743377 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3762/7507] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:31.798667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] MFA Rules not processed for user `b89ebbd16b9c42579cd78fcce6bf55b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:31.799522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:31.858476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.873555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304446-a7a5-4d55-a1d2-91e2540d5e76 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:31.881541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:31.923363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:31.975671 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3746/7508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:31.982571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:31.996506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:31.997334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:31.997711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:31.998092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] PATH_INFO: `/v3/users/9dfe74835dbf42fab19a08e828fca7dd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:31.999516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfe74835dbf42fab19a08e828fca7dd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.002113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.139568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfe74835dbf42fab19a08e828fca7dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:32.143680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfe74835dbf42fab19a08e828fca7dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:32.147481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c2026-310f-4806-a52a-3e349041c450 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:32.160246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfe74835dbf42fab19a08e828fca7dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:32.163971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:32.164605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.164880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.165176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.165814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.179208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.185998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfe74835dbf42fab19a08e828fca7dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:32.187491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9961f307-d361-4484-ada3-d0c45ba340ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfe74835dbf42fab19a08e828fca7dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:32.248554 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3763/7509] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:31 2022] DELETE /identity/v3/users/9dfe74835dbf42fab19a08e828fca7dd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:32.254762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.255877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.256926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.258856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3747/7510] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:31 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:32.264616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:32.267596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:32.316851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:32.326342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:32.487968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b341a-d17b-4e8e-ae25-1bd548f90b9f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:32.493328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:32.494039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.494388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.494727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.495429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.497465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.503964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3764/7511] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:32.543616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:32.545523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:32.565465 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3748/7512] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:32 2022] POST /identity/v3/users => generated 296 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:32.572875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:32.600687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb73e-d860-4fd7-9adf-2595c325b71b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:32.620162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:32.620724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.623674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.623955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.624635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.627652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.628119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:32.673865 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3749/7513] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:32.674928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:32.712259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4de1-6de8-483a-9e7e-d3b183f13f9d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:32.737892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:32.739083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.739564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.741738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] PATH_INFO: `/v3/projects/9f40dbec1e894a1b9752bec93c8593fe/users/f5d2f404c35145f687a507dcc589a453/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.743002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0eae-b38e-412f-8c53-8b1b30d4f6a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:32.756387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:32.757240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:32.757353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:32.757598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:32.798941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.800285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.818031 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3765/7514] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:32.848748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40dbec1e894a1b9752bec93c8593fe, user_id=f5d2f404c35145f687a507dcc589a453, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:32.870019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:32.899730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3750/7515] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:32 2022] PUT /identity/v3/projects/9f40dbec1e894a1b9752bec93c8593fe/users/f5d2f404c35145f687a507dcc589a453/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:32.904107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:32.932395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737de8cf-fe64-46b6-ada1-a683e5d05aeb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:33.022963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:33.025772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.055092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:33.056272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.058076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.060067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.060880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:33.067647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:33.075740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:33.103069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3766/7516] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:33.106466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:33.133892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c3608-dac6-4161-b0c7-9cf1bfca9642 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:33.150017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:33.150726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.151010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.151286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] PATH_INFO: `/v3/projects/9f40dbec1e894a1b9752bec93c8593fe/users/f5d2f404c35145f687a507dcc589a453/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.155109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40dbec1e894a1b9752bec93c8593fe, user_id=f5d2f404c35145f687a507dcc589a453, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:33.159268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db372cd-012f-493d-8e56-d8b7ca7dcc87 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:33.177101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3767/7517] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:33 2022] PUT /identity/v3/projects/9f40dbec1e894a1b9752bec93c8593fe/users/f5d2f404c35145f687a507dcc589a453/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:33.190874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.191160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.191464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.194309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659632b1-3219-407e-a460-e8ddf8f49ba3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:33.242902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] MFA Rules not processed for user `f5d2f404c35145f687a507dcc589a453`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:33.245592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.399012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:33.399630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.400001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.400183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] PATH_INFO: `/v3/users/f07c79f23b434d2fb03e1502242ec2c9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.404817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07c79f23b434d2fb03e1502242ec2c9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:33.413554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:33.447898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3768/7518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:33.459685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:33.461450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.534320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:33.541248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07c79f23b434d2fb03e1502242ec2c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:33.542285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07c79f23b434d2fb03e1502242ec2c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:33.543828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07c79f23b434d2fb03e1502242ec2c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:33.555339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07c79f23b434d2fb03e1502242ec2c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:33.570399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d3b00b2c-4354-448c-9403-07fc1dc17a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07c79f23b434d2fb03e1502242ec2c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:33.627541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b644e-b558-48f5-8448-e46976f32d95 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:33.628400 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3751/7519] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:33 2022] DELETE /identity/v3/users/f07c79f23b434d2fb03e1502242ec2c9 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:33.633969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.634328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.634608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.681434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:33.686466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.711980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:33.713388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:33.713843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:33.714387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:33.722014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.831223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:33.865316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:33.866231 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3752/7520] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:33.881827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:33.885579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:33.887909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:33.926152 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3769/7521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:34.041417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8f38-96e5-47bc-b635-54d979910e5e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:34.046029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:34.047209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.047813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.048392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.061750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:34.065294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94dd43-ce0e-439e-8ba8-2910ff4c85d5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:34.096343 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3753/7522] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:34.358054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:34.359767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:34.392220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03c75-e558-416c-8b3e-ebee1b6ef053 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:34.404384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:34.405253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.405535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.405808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] PATH_INFO: `/v3/projects/c078c94ad4534775a4cf63490629a2c2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.411031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c078c94ad4534775a4cf63490629a2c2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:34.413971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:34.524224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c078c94ad4534775a4cf63490629a2c2', 'request_id': 'req-21d87529-9652-4314-85b8-19819d8488b8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:34.533863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c078c94ad4534775a4cf63490629a2c2', 'request_id': 'req-21d87529-9652-4314-85b8-19819d8488b8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:34.550029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c078c94ad4534775a4cf63490629a2c2', 'request_id': 'req-21d87529-9652-4314-85b8-19819d8488b8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:34.567576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] The token cache is being invalidate because project c078c94ad4534775a4cf63490629a2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:34.568219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:34.569151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:34.575678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3770/7523] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:34 2022] DELETE /identity/v3/projects/c078c94ad4534775a4cf63490629a2c2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:34.577208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e9fb-5b3c-4fe6-8723-f1029d9c48ef None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.577683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e9fb-5b3c-4fe6-8723-f1029d9c48ef None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.577761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228e9fb-5b3c-4fe6-8723-f1029d9c48ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.618191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e228e9fb-5b3c-4fe6-8723-f1029d9c48ef None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:34.619420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e228e9fb-5b3c-4fe6-8723-f1029d9c48ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:34.714396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:34.716132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:34.747396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3754/7524] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:34.756053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.756597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.757044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.789358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:34.796833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:34.799104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:34.811100 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3755/7525] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:34.816786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:34.834216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475b978-e65f-4224-9017-3e01cc606318 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:34.853288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:34.854792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.855081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.855354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.856492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:34.857798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:34.859341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:34.869880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d87529-9652-4314-85b8-19819d8488b8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:34.900420 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3756/7526] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:34.901295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:34.901564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:34.902104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.904231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.904625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] PATH_INFO: `/v3/projects/ee771fc759694b1f9fe37b1e22d83c96` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.907222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee771fc759694b1f9fe37b1e22d83c96)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:34.909839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:34.913499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dec52-9129-4a83-ae8f-52d037517077 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:34.918566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:34.919164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:34.919440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:34.919824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:34.920580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:34.926149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:34.989698 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3757/7527] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:34 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:34.992600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.063893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee771fc759694b1f9fe37b1e22d83c96', 'request_id': 'req-41d9c308-a32e-40d7-a481-9a89c55a0605'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.092122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee771fc759694b1f9fe37b1e22d83c96', 'request_id': 'req-41d9c308-a32e-40d7-a481-9a89c55a0605'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.109221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:35.115034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee771fc759694b1f9fe37b1e22d83c96', 'request_id': 'req-41d9c308-a32e-40d7-a481-9a89c55a0605'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.140817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82eaa-67e6-4d85-a0de-1171eeeb0265 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.144941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] The token cache is being invalidate because project ee771fc759694b1f9fe37b1e22d83c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:35.148443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.150194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.161319 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3771/7528] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:34 2022] DELETE /identity/v3/projects/ee771fc759694b1f9fe37b1e22d83c96 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:35.162486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.166915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:35.239052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.239900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.240319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.242236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.243109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.246439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:35.288076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3758/7529] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:34 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:35.291814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.294898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:35.335182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f755d-d4fd-4aa0-912c-cb8e0109dfe6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.337163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c308-a32e-40d7-a481-9a89c55a0605 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.352256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.353598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.354531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.355547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.356010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.357275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] PATH_INFO: `/v3/users/7ffbda37f49e4833bb9c611f73ba64c9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.357691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.358110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.359512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffbda37f49e4833bb9c611f73ba64c9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.360107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.364586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:35.365704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:35.382006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3759/7530] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:35.386951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.402906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483aee1-b0c7-428d-9efd-f8f4d2dea040 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.408492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.409896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.410499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.410985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.411844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.415533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:35.435046 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3760/7531] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:35.439886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.458476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffebbb-d8b1-4337-8e13-01f7c5da553e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.465746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.466734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.467250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.467745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] PATH_INFO: `/v3/projects/99281dcb2fcd4a0481f8ead306560127/users/b88bfd4efe394752b4238810e25e3621/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.491723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99281dcb2fcd4a0481f8ead306560127, user_id=b88bfd4efe394752b4238810e25e3621, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.496403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fb9bb-fe10-42b7-9244-9c5a58d07908 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:35.508401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffbda37f49e4833bb9c611f73ba64c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.510512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffbda37f49e4833bb9c611f73ba64c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.528996 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3761/7532] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:35 2022] PUT /identity/v3/projects/99281dcb2fcd4a0481f8ead306560127/users/b88bfd4efe394752b4238810e25e3621/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:35.535055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffbda37f49e4833bb9c611f73ba64c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.543075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.544435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.544855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.560554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffbda37f49e4833bb9c611f73ba64c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.564651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffbda37f49e4833bb9c611f73ba64c9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:35.566372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:35.631478 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3772/7533] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:35 2022] DELETE /identity/v3/users/7ffbda37f49e4833bb9c611f73ba64c9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:35.650121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] MFA Rules not processed for user `b88bfd4efe394752b4238810e25e3621`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:35.651275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:35.776587 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3762/7534] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:35.791878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:35.793921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:35.930784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb1607-f0e1-4afe-9a6e-1534281c10ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:35.953695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:35.953695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:35.953695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:35.953695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:35.988044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:35.990812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfedfe-35a8-461c-b7a2-c597e93ef182 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:36.020686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3773/7535] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:36.157012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:36.162542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:36.250641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:36.311939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a10f5-c2ae-4ae1-8487-050eb485f1c4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:36.320754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:36.321460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.321849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.322127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] PATH_INFO: `/v3/projects/a165a2fda4c54359a2457f1071984f87` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.323266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a165a2fda4c54359a2457f1071984f87)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:36.325288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:36.395571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4446c-f8b6-491c-8d6f-8ae48ad89bed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.396009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4446c-f8b6-491c-8d6f-8ae48ad89bed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.396447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4446c-f8b6-491c-8d6f-8ae48ad89bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.417235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a165a2fda4c54359a2457f1071984f87', 'request_id': 'req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:36.424231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a165a2fda4c54359a2457f1071984f87', 'request_id': 'req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:36.434462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a165a2fda4c54359a2457f1071984f87', 'request_id': 'req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:36.439833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7cc4446c-f8b6-491c-8d6f-8ae48ad89bed None None] MFA Rules not processed for user `608b9dc1a00d489a94524f99820022f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:36.441101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7cc4446c-f8b6-491c-8d6f-8ae48ad89bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:36.451278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] The token cache is being invalidate because project a165a2fda4c54359a2457f1071984f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:36.452485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:36.455062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae88039a-dd1a-4d85-a1a2-dab93e4adc1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:36.457289 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3763/7536] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:36 2022] DELETE /identity/v3/projects/a165a2fda4c54359a2457f1071984f87 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:36.462249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f90cae-2767-4458-a96b-3343240db30b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.462675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f90cae-2767-4458-a96b-3343240db30b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.463077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f90cae-2767-4458-a96b-3343240db30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.487860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-23f90cae-2767-4458-a96b-3343240db30b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:36.489818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23f90cae-2767-4458-a96b-3343240db30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:36.585563 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3774/7537] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:36.602712 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3764/7538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:36.611640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.611928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.612205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.666101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:36.669592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:36.691064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3775/7539] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:36.692257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f90cae-2767-4458-a96b-3343240db30b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:36.707098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f90cae-2767-4458-a96b-3343240db30b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:36.712391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:36.713278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.713734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.714178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.715624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:36.716124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:36.718945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:36.733884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3765/7540] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:26:36.738070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:36.749969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48586-7259-430a-954a-9b47f2277d02 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:36.762194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:36.762995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.763451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.763868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.764657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:36.769246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:36.770299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:36.772395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:36.832835 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3776/7541] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:36 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:36.845747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:36.930812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:36.941764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b4a44-7c19-4d5c-9291-010f0c515a4d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:36.979701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578e37-dc44-4006-ab22-bf94b8084f44 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:36.991143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:36.993282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:36.993907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:36.993907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:36.994469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.001734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.018406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:37.023741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.025234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.026025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.026667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.031156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:37.048783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3777/7542] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:36 2022] POST /identity/v3/users => generated 305 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:37.049728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:37.053817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:37.191737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53183a7-1990-4fc7-b61d-801795c183d4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:37.198950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.199580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.199866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.200287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.202122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:37.203093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.205845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.222083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.224268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.245711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3778/7543] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:37.247012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:37.257085 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3766/7544] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:37.259159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f41a-3c11-4ef3-83b6-2ee5d305a4fb service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:37.264997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.265617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.265941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.267233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.267978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.269781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.290300 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3779/7545] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:37.293979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:37.308564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99e27-b874-4825-bb09-b68d9495f5b4 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:37.315394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.316018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.316301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.316631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.318340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.320237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34107c-2ef3-44f8-a079-7133b98df942 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.350754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3767/7546] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:37.354585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:37.381126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3821-1779-4674-b736-a7b0b6cf6217 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:37.401936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.402714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.403068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.403410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] PATH_INFO: `/v3/projects/482f6a5cbb48425d9fc4b016f299693a/users/efd332362106404fb2b5c920395fe13a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.439419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482f6a5cbb48425d9fc4b016f299693a, user_id=efd332362106404fb2b5c920395fe13a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.442293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:37.485896 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3780/7547] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:37 2022] PUT /identity/v3/projects/482f6a5cbb48425d9fc4b016f299693a/users/efd332362106404fb2b5c920395fe13a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:37.487810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.488089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.488373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.549108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] MFA Rules not processed for user `efd332362106404fb2b5c920395fe13a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:37.553274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:37.758884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3768/7548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:37.760876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:37.923678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8766b8-43a3-4d9c-83d6-187d077ff4a7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:37.934557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:37.935194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:37.935532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:37.935809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:37.936776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:37.939907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:38.007751 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3781/7549] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:37 2022] POST /identity/v3/projects => generated 407 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:38.011767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:38.036820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe210b-c75e-4e18-901f-50005b8d244e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:38.133903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:38.226984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:38.230451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:38.233436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:38.234570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:38.238373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:38.249272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:38.297260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3769/7550] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:38 2022] POST /identity/v3/users => generated 310 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:38.301714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:38.319058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680fb9-f348-4b7f-8e28-26a9f4e6edc5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:38.343794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:38.346145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:38.346458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:38.346759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:38.349300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:38.352574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:38.416272 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3782/7551] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:38.417703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:38.435761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00b56-d5aa-48e1-9a0d-0e1a42dc76d5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:38.460407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:38.463783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:38.464134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:38.464424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] PATH_INFO: `/v3/projects/2d8a6cf39e2042feabe1fe6de5800281/users/9cb3ae24c8a64e89b15e7e06dd945671/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:38.531628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8a6cf39e2042feabe1fe6de5800281, user_id=9cb3ae24c8a64e89b15e7e06dd945671, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:38.541968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:38.607742 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3770/7552] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:38 2022] PUT /identity/v3/projects/2d8a6cf39e2042feabe1fe6de5800281/users/9cb3ae24c8a64e89b15e7e06dd945671/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:38.612013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:38.632842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b517024-4fbd-46dd-aa8b-60708d7c15ca admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:38.687183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:38.881716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:38.882339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:38.882737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:38.882861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:38.883423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:38.896500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d8c7a-d187-4696-8f89-3e6139c9f30d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:38.920645 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3783/7553] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:26:38.925019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:38.944579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a715d-299d-42fe-9fc7-a02846729845 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:38.972983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:38.973689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:38.973970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:38.974254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] PATH_INFO: `/v3/projects/2d8a6cf39e2042feabe1fe6de5800281/users/9cb3ae24c8a64e89b15e7e06dd945671/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:38.981513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8a6cf39e2042feabe1fe6de5800281, user_id=9cb3ae24c8a64e89b15e7e06dd945671, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:38.994571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:39.050733 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3771/7554] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:38 2022] PUT /identity/v3/projects/2d8a6cf39e2042feabe1fe6de5800281/users/9cb3ae24c8a64e89b15e7e06dd945671/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:39.051484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:39.052758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:39.053333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:39.143062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] MFA Rules not processed for user `9cb3ae24c8a64e89b15e7e06dd945671`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:39.152082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:39.405931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3784/7555] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:39 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:39.416603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:39.498562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0e91-7fd7-41ba-a874-6c5861c9acf8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:39.503849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:39.504730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:39.505157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:39.505535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:39.529628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:39.537525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:39.564589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3772/7556] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:39 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:39.834972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:39.837428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:39.949928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:39.970672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d07bb5-553d-4c90-9643-a9e0ffc1a19e service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:39.977273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:39.977889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:39.978164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:39.978432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:40.010297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6a9f-e6f3-4bc8-a175-f0bff22dd5a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:40.022341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:40.023229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:40.025785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:40.026221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:40.032347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:40.062056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:40.065817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:40.114360 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3785/7557] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:40.162135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:40.163764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaabe83-02d2-4676-a796-41fe519f5bac service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:40.187912 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3773/7558] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:39 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:50.089730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:50.092740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:50.095559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:50.175857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:50.251319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663fbf-e9c5-49e9-9c7d-eb9f4fcf3076 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:50.256258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:50.256946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:50.257206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:50.257478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] PATH_INFO: `/v3/users/b89ebbd16b9c42579cd78fcce6bf55b6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:50.258652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89ebbd16b9c42579cd78fcce6bf55b6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:50.261465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:50.363444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89ebbd16b9c42579cd78fcce6bf55b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:50.364979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89ebbd16b9c42579cd78fcce6bf55b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:50.381174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89ebbd16b9c42579cd78fcce6bf55b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:50.398217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89ebbd16b9c42579cd78fcce6bf55b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:50.398726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89ebbd16b9c42579cd78fcce6bf55b6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:50.455248 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3786/7559] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:50 2022] DELETE /identity/v3/users/b89ebbd16b9c42579cd78fcce6bf55b6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:50.459955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:50.460530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:50.461000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:50.490718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:50.492266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:50.617508 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3774/7560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:26:50.629925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:50.632120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:50.824107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506621f-99d9-48a9-a357-a95deb9641c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:50.835078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:50.836152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:50.836763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:50.837126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:50.861988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:50.864819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:50.893453 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3787/7561] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:51.681781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:51.684378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:51.714456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab7fb-9fd6-48c0-970a-62cc229c313a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:51.736101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:51.736782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:51.737088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:51.737566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] PATH_INFO: `/v3/projects/a288cff9df7740e78720478d8a91fa85` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:51.741752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a288cff9df7740e78720478d8a91fa85)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:51.751883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:51.888054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a288cff9df7740e78720478d8a91fa85', 'request_id': 'req-fc89caa2-339e-4569-9a7f-9a50cec37ac8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:51.895363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a288cff9df7740e78720478d8a91fa85', 'request_id': 'req-fc89caa2-339e-4569-9a7f-9a50cec37ac8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:51.905271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a288cff9df7740e78720478d8a91fa85', 'request_id': 'req-fc89caa2-339e-4569-9a7f-9a50cec37ac8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:51.922195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] The token cache is being invalidate because project a288cff9df7740e78720478d8a91fa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:51.922408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:51.923730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:51.925945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3775/7562] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:51 2022] DELETE /identity/v3/projects/a288cff9df7740e78720478d8a91fa85 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:51.929623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:51.947232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b57a-dec5-44a2-b529-4d7ab0fa8dd0 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:51.975299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:52.026846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:52.027636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:52.027918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:52.028190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] PATH_INFO: `/v3/users/f5d2f404c35145f687a507dcc589a453` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:52.029618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d2f404c35145f687a507dcc589a453)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:52.031861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:52.101273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d2f404c35145f687a507dcc589a453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.101824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d2f404c35145f687a507dcc589a453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.112940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d2f404c35145f687a507dcc589a453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.131365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d2f404c35145f687a507dcc589a453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.132372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bcde52c9-a271-4bd1-a37b-b3672b9dd5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d2f404c35145f687a507dcc589a453'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.159455 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3788/7563] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:51 2022] DELETE /identity/v3/users/f5d2f404c35145f687a507dcc589a453 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:52.615313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:52.617589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:52.640559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89caa2-339e-4569-9a7f-9a50cec37ac8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:52.830361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:52.832707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:52.833114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:52.833463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] PATH_INFO: `/v3/projects/9f40dbec1e894a1b9752bec93c8593fe` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:52.835521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f40dbec1e894a1b9752bec93c8593fe)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:52.843810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:52.897503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:52.920605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f40dbec1e894a1b9752bec93c8593fe', 'request_id': 'req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.930988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f40dbec1e894a1b9752bec93c8593fe', 'request_id': 'req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.943787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f40dbec1e894a1b9752bec93c8593fe', 'request_id': 'req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.974411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] The token cache is being invalidate because project 9f40dbec1e894a1b9752bec93c8593fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:52.974755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.981594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e873a6eb-7ac1-4cd1-870d-af72ef08ff98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:52.986042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3776/7564] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:52 2022] DELETE /identity/v3/projects/9f40dbec1e894a1b9752bec93c8593fe => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:52.990618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:52.991173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:52.991173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.034475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:53.036416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:53.134407 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3789/7565] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:53.141326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.141861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.142270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.394337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:53.408005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:53.426049 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3777/7566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:53.430032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.448000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e374f-c99e-4f45-9e8d-e73ebf781ed0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.454153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.456043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.456169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.456469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.457466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:53.457816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.459489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.473791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3790/7567] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:53.477793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.488483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1561c0-a246-4282-aee5-b9822816df9f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.493637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.497479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.497883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.499548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.500454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.502799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.534303 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3778/7568] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:53 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:53.538083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.550654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5c543-5634-48ea-ab1f-39b7e09f4d8a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.586846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:53.633524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.634139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.634415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.634682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.635299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.637803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.663032 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3791/7569] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:53 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:53.666794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.680769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a072-828f-4de5-86c0-22e5756e317d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.697764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.698987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.699601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.700124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.701125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.703135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.732754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3779/7570] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:53.734015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.758740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695837e3-aec2-44f1-8e37-7372fe267445 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.765895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.768162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.768860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.769515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.770653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.772498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3924d-b278-440a-a1d1-2138a643e465 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.794766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:53.803893 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3792/7571] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:53.808175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41d5e-970a-4235-8fa4-f0c928913f34 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:53.814649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:53.815759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.816421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.816946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] PATH_INFO: `/v3/projects/934106226731415f80af59311eaf32f9/users/9d061cc0e09b4b5196d33cd1994e149c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.837288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=934106226731415f80af59311eaf32f9, user_id=9d061cc0e09b4b5196d33cd1994e149c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:53.841854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:53.870265 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3780/7572] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:53 2022] PUT /identity/v3/projects/934106226731415f80af59311eaf32f9/users/9d061cc0e09b4b5196d33cd1994e149c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:53.882727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:53.883206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:53.883593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:53.922473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] MFA Rules not processed for user `9d061cc0e09b4b5196d33cd1994e149c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:53.924053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:54.021216 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3793/7573] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:54.027211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.161367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e824b9-819a-4a8d-b739-16a4b6f81a4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.168806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.169536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.170043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.170384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.171085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.173308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:54.255687 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3781/7574] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:54 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:54.257080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.274446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc53df-9137-4e2b-a4e7-014fece46bbc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.403492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.404943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.405727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.405727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.406313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.409020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:54.473980 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3794/7575] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:54 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:54.478274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.512988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce916e-b7db-4a75-81a2-73326d8a750c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.528601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.529246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.529522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.529792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.530478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.532109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:54.556104 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3782/7576] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:54.559545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.572229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a147-ae8e-4abf-947b-7dc41de91687 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.582652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.583333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.585286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.603032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.603876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.605579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b08a6-cf0b-4d93-90da-9fb2ecfb3095 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:54.623349 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3795/7577] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:54.628174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.639792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754024b-6db0-4cde-a451-ac4ec861b888 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.645532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.648129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.648530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.648896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] PATH_INFO: `/v3/projects/cc2b11addd1646d98540679616accfac/users/62efe54f4e6b4e1bbe7310aa9ffe44d1/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.675120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2b11addd1646d98540679616accfac, user_id=62efe54f4e6b4e1bbe7310aa9ffe44d1, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.679456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:54.695537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:54.705115 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3783/7578] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:54 2022] PUT /identity/v3/projects/cc2b11addd1646d98540679616accfac/users/62efe54f4e6b4e1bbe7310aa9ffe44d1/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:54.716366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.716653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.716945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.756409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] MFA Rules not processed for user `62efe54f4e6b4e1bbe7310aa9ffe44d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:54.757654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:54.762821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:54.865928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3796/7579] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:54.868584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:54.955814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d48a3-e60e-4045-816d-6a640d003f75 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:54.961689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:54.962707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:54.963128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:54.963539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:54.964339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:54.966471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.005764 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3784/7580] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:54 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:55.006599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.019832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe04d6-4f3a-499f-8ed3-9092ff99f183 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.093024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.094595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.095143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.096225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.097358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.099815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.145763 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3797/7581] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:55 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:26:55.148737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.164024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485842b-45c1-47be-b8c6-73b83b64b47c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.171309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.189008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.189858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.190132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.190841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.192462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.225633 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3785/7582] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:55.229717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.248693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c99a94-442e-4582-8595-86920190d64d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.258523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.259322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.259669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.260012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] PATH_INFO: `/v3/projects/7d79df9e5e474b16996b88a51cd57d4d/users/8e484edd5da640c18eaae99b00ffbfbd/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.290708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d79df9e5e474b16996b88a51cd57d4d, user_id=8e484edd5da640c18eaae99b00ffbfbd, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.293878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.326531 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3798/7583] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:55 2022] PUT /identity/v3/projects/7d79df9e5e474b16996b88a51cd57d4d/users/8e484edd5da640c18eaae99b00ffbfbd/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:55.328713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.357765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e0a-35c3-4b6e-a6f9-04b0a8721b3c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.435740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.436363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.436826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.437294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.437937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.440501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10480d16-827f-4f06-aaf5-00753d551f5f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.456023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3786/7584] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:55.457082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.480866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b3920-1728-412c-b552-5cedea0fb554 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.498925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.503402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.504813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.505228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] PATH_INFO: `/v3/projects/7d79df9e5e474b16996b88a51cd57d4d/users/8e484edd5da640c18eaae99b00ffbfbd/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.513787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d79df9e5e474b16996b88a51cd57d4d, user_id=8e484edd5da640c18eaae99b00ffbfbd, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.521241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:55.545964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3799/7585] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:55 2022] PUT /identity/v3/projects/7d79df9e5e474b16996b88a51cd57d4d/users/8e484edd5da640c18eaae99b00ffbfbd/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:55.558862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87863acf-a765-4977-aa09-50f4004a194d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.559331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87863acf-a765-4977-aa09-50f4004a194d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.559608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87863acf-a765-4977-aa09-50f4004a194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.648626 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-87863acf-a765-4977-aa09-50f4004a194d None None] MFA Rules not processed for user `8e484edd5da640c18eaae99b00ffbfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:55.649894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87863acf-a765-4977-aa09-50f4004a194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:55.799732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:55.820238 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3787/7586] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:55.832262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.834150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:55.913369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87863acf-a765-4977-aa09-50f4004a194d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:55.915018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87863acf-a765-4977-aa09-50f4004a194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:55.972899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5d70-4ef4-4368-8fd5-16c0b3dd2d36 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:55.978559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:55.979897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:55.980282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:55.981387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:55.997691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:55.999252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb974-419f-4f3c-8b23-68c03d3aee1b service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:56.006319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:56.019725 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3800/7587] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:56.091668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87863acf-a765-4977-aa09-50f4004a194d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:56.096627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:56.098265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:56.098265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:56.098265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] PATH_INFO: `/v3/users/efd332362106404fb2b5c920395fe13a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:56.099226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd332362106404fb2b5c920395fe13a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:56.101528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:56.223964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd332362106404fb2b5c920395fe13a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:56.225352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd332362106404fb2b5c920395fe13a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:56.227783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd332362106404fb2b5c920395fe13a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:56.240187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd332362106404fb2b5c920395fe13a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:56.256776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd332362106404fb2b5c920395fe13a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:56.301076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3788/7588] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:55 2022] DELETE /identity/v3/users/efd332362106404fb2b5c920395fe13a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:56.305612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648603f1-80a4-4801-93a6-979030943e5b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:56.306062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648603f1-80a4-4801-93a6-979030943e5b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:56.306161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648603f1-80a4-4801-93a6-979030943e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:56.354000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-648603f1-80a4-4801-93a6-979030943e5b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:56.358362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-648603f1-80a4-4801-93a6-979030943e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:56.476030 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3801/7589] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:56.487087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:56.488599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:56.668937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a70d-2ae4-46e4-9d2a-e6d22ad24f42 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:56.688710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:56.690028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:56.690379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:56.690715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:56.710491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:56.713069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:56.728745 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3789/7590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:56.915866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648603f1-80a4-4801-93a6-979030943e5b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:56.917344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-648603f1-80a4-4801-93a6-979030943e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:56.983321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648603f1-80a4-4801-93a6-979030943e5b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:56.987101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:56.987722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:56.988052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:56.988330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:56.990118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:57.072802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:57.074280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:57.085696 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3802/7591] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:57.415355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:57.417841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:57.440479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0659a7-eb9f-48bf-9d90-76182bc639e8 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:57.457487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:57.458282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:57.458652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:57.458941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] PATH_INFO: `/v3/projects/482f6a5cbb48425d9fc4b016f299693a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:57.461141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482f6a5cbb48425d9fc4b016f299693a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:57.467256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:57.496159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:57.627175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482f6a5cbb48425d9fc4b016f299693a', 'request_id': 'req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.638673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482f6a5cbb48425d9fc4b016f299693a', 'request_id': 'req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.675329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482f6a5cbb48425d9fc4b016f299693a', 'request_id': 'req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.693372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] The token cache is being invalidate because project 482f6a5cbb48425d9fc4b016f299693a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:57.693691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.695675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.697761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3790/7592] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:57 2022] DELETE /identity/v3/projects/482f6a5cbb48425d9fc4b016f299693a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:57.701825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:57.718646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c581e-878d-4ba8-a0b5-55ab0e0dd2bf service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:57.837532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:57.850312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:57.850977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:57.851242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:57.851526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] PATH_INFO: `/v3/users/9cb3ae24c8a64e89b15e7e06dd945671` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:57.853569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb3ae24c8a64e89b15e7e06dd945671)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:57.855515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:57.931304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb3ae24c8a64e89b15e7e06dd945671'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.932264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb3ae24c8a64e89b15e7e06dd945671'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.945872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb3ae24c8a64e89b15e7e06dd945671'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.955988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb3ae24c8a64e89b15e7e06dd945671'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.957249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-034d3f1f-70b0-4e74-93b3-25b34a90bf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb3ae24c8a64e89b15e7e06dd945671'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:57.989535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3803/7593] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:57 2022] DELETE /identity/v3/users/9cb3ae24c8a64e89b15e7e06dd945671 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:59.079982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:59.081633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:59.095406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c9d0-7d09-4da7-a7b1-b345f7e87a96 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:59.174467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:59.175494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.175997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.176578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] PATH_INFO: `/v3/projects/2d8a6cf39e2042feabe1fe6de5800281` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.177973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8a6cf39e2042feabe1fe6de5800281)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:59.180150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:59.254952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8a6cf39e2042feabe1fe6de5800281', 'request_id': 'req-4ebd48e8-20c8-46e4-ae58-991bad88db17'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:59.264072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8a6cf39e2042feabe1fe6de5800281', 'request_id': 'req-4ebd48e8-20c8-46e4-ae58-991bad88db17'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:59.277545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8a6cf39e2042feabe1fe6de5800281', 'request_id': 'req-4ebd48e8-20c8-46e4-ae58-991bad88db17'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:59.292979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] The token cache is being invalidate because project 2d8a6cf39e2042feabe1fe6de5800281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:59.293305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:59.293986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ebd48e8-20c8-46e4-ae58-991bad88db17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:59.295826 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3791/7594] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:59 2022] DELETE /identity/v3/projects/2d8a6cf39e2042feabe1fe6de5800281 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:59.301153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.301951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.302418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.328134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:59.335459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:59.454809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.455545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.455921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.460752 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3804/7595] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:59.484192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:59.486761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:59.501571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:59.509114 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3792/7596] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:59.522092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f68589-0af6-4371-b6bb-9865b266841e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:59.535933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:59.536853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.537698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.537698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.538652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:59.539051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:59.540778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:59.566258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:59.566465 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3805/7597] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:26:59.576271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff107a-23f2-4609-b1ab-9d13a80e11a0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:59.600114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:59.600747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.601076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.604934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.605691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:59.609810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:59.671629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3793/7598] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:59 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:59.676093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:59.693374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed23050-54a8-4a5c-bae7-fb140036f008 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:59.847404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:59.848001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:59.848286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:59.848571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:59.849579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:59.858281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:59.878787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:59.909666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3806/7599] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:59 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:59.910738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:59.919175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:59.959276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407eec4-26a5-4f0a-8c33-bf0b2bd4a828 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:00.016599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:00.017430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:00.017798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:00.018072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:00.018857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:00.023021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:00.071473 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3794/7600] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:00.089955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:00.112473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2adfb4-b2a6-4db2-b8e2-3052c3cfff47 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:00.127449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:00.128406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:00.130097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:00.131146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:00.131503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:00.133219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e95e16-bcb1-49ec-af4e-cb6c9a27ec00 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:00.167598 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3807/7601] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:00.169035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:00.184837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ff51-35bb-4082-aa67-68d5f803e4b7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:00.210926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:00.211636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:00.211919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:00.212187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] PATH_INFO: `/v3/projects/6cc04c1d6eda4106b17d53c9b26451cd/users/2461a10d1fc1404fa64aaddb749c8f35/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:00.271030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc04c1d6eda4106b17d53c9b26451cd, user_id=2461a10d1fc1404fa64aaddb749c8f35, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:00.281357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:00.344989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3795/7602] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:00 2022] PUT /identity/v3/projects/6cc04c1d6eda4106b17d53c9b26451cd/users/2461a10d1fc1404fa64aaddb749c8f35/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:00.346856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:00.347666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:00.348089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:00.427653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] MFA Rules not processed for user `2461a10d1fc1404fa64aaddb749c8f35`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:00.428986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:00.521430 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3808/7603] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:00.523541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:00.671728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4e75-5c53-4cbe-8e80-f453cc25a317 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:00.706178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:00.707210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:00.707700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:00.708186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:00.710365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:00.729318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:00.800567 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3796/7604] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:00 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:00.808967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:00.832633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46b77-8845-43a8-89ca-572f48814942 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.011319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.011319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.011319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.011319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.011756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.011756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.056884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3809/7605] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:00 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:01.061010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:01.080500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb24f3-3602-49f5-8bda-1e952fc8ce59 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.098963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.099757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.100110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.100454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.101358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.103041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.127813 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3797/7606] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:01.129676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:01.152637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dffe-9ef0-472b-8fa5-be185e829078 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.157813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.159206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.159564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.160141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] PATH_INFO: `/v3/projects/6c5b88d227224ff1accadb47c7bd013c/users/d4501ff4a729461b976b1a42be9eee75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.191469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5b88d227224ff1accadb47c7bd013c, user_id=d4501ff4a729461b976b1a42be9eee75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.196422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.220315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3810/7607] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:01 2022] PUT /identity/v3/projects/6c5b88d227224ff1accadb47c7bd013c/users/d4501ff4a729461b976b1a42be9eee75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:01.224238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:01.236329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ee833-530f-4ae5-81d7-e1a1fe6d6e32 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.347507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.348282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.348631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.349033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.349750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.351487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db9b71-c1a2-4954-8962-2b9894089dda admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.378095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3798/7608] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:01.381594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:01.409432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276ea4-2281-47f8-b466-803c870a3212 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.426796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.427639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.427922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.428434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] PATH_INFO: `/v3/projects/6c5b88d227224ff1accadb47c7bd013c/users/d4501ff4a729461b976b1a42be9eee75/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.436025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5b88d227224ff1accadb47c7bd013c, user_id=d4501ff4a729461b976b1a42be9eee75, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.443506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.492448 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3811/7609] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:01 2022] PUT /identity/v3/projects/6c5b88d227224ff1accadb47c7bd013c/users/d4501ff4a729461b976b1a42be9eee75/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:01.494419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.494837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.495177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.574337 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] MFA Rules not processed for user `d4501ff4a729461b976b1a42be9eee75`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:01.575708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:01.633367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:01.737700 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3799/7610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:01.749429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:01.751462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:01.803299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:01.867290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132947c-9d6a-41d9-93a8-bbd61c22dca4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:01.881417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:01.882417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:01.882903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:01.883386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:01.982920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:01.984524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f2440-9290-443a-a5f8-a75ba58085f6 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:01.997967 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3812/7611] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:03.957256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:03.958920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:04.062055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c3d98-6b91-451e-990b-455d1b063182 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:04.071108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:04.073247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:04.073617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:04.074029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] PATH_INFO: `/v3/users/b88bfd4efe394752b4238810e25e3621` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:04.080297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88bfd4efe394752b4238810e25e3621)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:04.082452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:04.156438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88bfd4efe394752b4238810e25e3621'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:04.158936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88bfd4efe394752b4238810e25e3621'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:04.159643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88bfd4efe394752b4238810e25e3621'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:04.172117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88bfd4efe394752b4238810e25e3621'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:04.182689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88bfd4efe394752b4238810e25e3621'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:04.206351 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3800/7612] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:03 2022] DELETE /identity/v3/users/b88bfd4efe394752b4238810e25e3621 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:04.210504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:04.210977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:04.211073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:04.234668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:04.236574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:04.304417 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3813/7613] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:04.314783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:04.316494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:04.367856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:04.390999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae37e6-8435-496e-95a6-4f5bbc68cc6d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:04.395257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:04.396105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:04.396534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:04.396983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:04.409812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:04.411429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb86b-901a-4b69-9866-0de54b73b7e8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:04.430146 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3801/7614] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:04.763862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:04.765490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:04.810088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244752b2-ace1-4f80-ab58-fd8750d6c0c2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:04.819614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:04.821058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:04.821549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:04.830089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] PATH_INFO: `/v3/projects/99281dcb2fcd4a0481f8ead306560127` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:04.838273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99281dcb2fcd4a0481f8ead306560127)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:04.840359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:04.971274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99281dcb2fcd4a0481f8ead306560127', 'request_id': 'req-7db03e47-9458-4053-afe7-9bd1c40a1771'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:05.011998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99281dcb2fcd4a0481f8ead306560127', 'request_id': 'req-7db03e47-9458-4053-afe7-9bd1c40a1771'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:05.033286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99281dcb2fcd4a0481f8ead306560127', 'request_id': 'req-7db03e47-9458-4053-afe7-9bd1c40a1771'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:05.050260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:05.055611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] The token cache is being invalidate because project 99281dcb2fcd4a0481f8ead306560127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:05.057007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:05.058333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7db03e47-9458-4053-afe7-9bd1c40a1771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:05.060595 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3814/7615] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:04 2022] DELETE /identity/v3/projects/99281dcb2fcd4a0481f8ead306560127 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:05.067598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.068294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.068294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.097368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:05.098774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:05.209570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3802/7616] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:05.217231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.217724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.217950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.240602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:05.242320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:05.253310 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3815/7617] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:05.257308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.271157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a37b9-1d11-428b-b59a-9defa429d519 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.276060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.276683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.277012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.277351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.278006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:05.278304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.279945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.301024 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3803/7618] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:05.302096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.324368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ed86-d830-4332-9ff3-550e0e2842ee None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.340667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.341461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.341810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.342139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.342872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.347228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.385275 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3816/7619] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:05 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:05.389124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.402180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb3f5-4815-464b-bd6f-dece021c70af admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.474416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.475061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.475368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.475614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.476254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.478211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.505127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3804/7620] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:05 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:05.509118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.522039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c002d-7e16-4df3-9391-2f360c0386a4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.527569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.528389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.528773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.529127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.529864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.531637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.543579 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3817/7621] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:05.547652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.558052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73675-e6bd-47f2-b8b5-d23712e595f0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.562854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.563986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.564264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.564784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.566064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.567658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aeff1-966c-4c4a-8b72-e9179888a139 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.579941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3805/7622] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:05.584314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.604012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbed5b-a19e-4aa8-bf6a-a774aff3e948 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.608994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.609739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.610120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.610458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] PATH_INFO: `/v3/projects/db17e8b491fe4f99851b0f92f2ac0f87/users/9a20706ee8d0498caba87d9fc030e990/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.627005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db17e8b491fe4f99851b0f92f2ac0f87, user_id=9a20706ee8d0498caba87d9fc030e990, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.630218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.647088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3818/7623] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:05 2022] PUT /identity/v3/projects/db17e8b491fe4f99851b0f92f2ac0f87/users/9a20706ee8d0498caba87d9fc030e990/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:05.657863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.658157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.658439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.686447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] MFA Rules not processed for user `9a20706ee8d0498caba87d9fc030e990`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:05.687652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:05.731791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:05.763804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3806/7624] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:05.775474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:05.777302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:05.857341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ead2a-1d16-44bb-b661-06cc3ef348b6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:05.862562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:05.863248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:05.863635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:05.863773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:05.874193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:05.876253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:05.886673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3819/7625] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:06.472969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:06.474688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:06.556240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abe360-8e16-4796-b0cf-bdf01cde0610 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:06.562027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:06.563788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:06.564726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:06.565399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:06.567885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:06.665204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:06.668200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd8ee-f0ad-44a9-9e15-a91bc1ac4a0e service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:06.682978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3807/7626] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:08.208045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:08.209767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:08.344176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6440e-8700-4ebd-b345-38c619d6e5e9 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:08.355152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:08.355963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:08.356340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:08.356739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] PATH_INFO: `/v3/users/2461a10d1fc1404fa64aaddb749c8f35` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:08.358115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2461a10d1fc1404fa64aaddb749c8f35)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:08.361382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:08.441094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:08.449596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2461a10d1fc1404fa64aaddb749c8f35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.450904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2461a10d1fc1404fa64aaddb749c8f35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.460037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2461a10d1fc1404fa64aaddb749c8f35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.471905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2461a10d1fc1404fa64aaddb749c8f35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.473004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2461a10d1fc1404fa64aaddb749c8f35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.501928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3820/7627] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:08 2022] DELETE /identity/v3/users/2461a10d1fc1404fa64aaddb749c8f35 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:08.503794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:08.504249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:08.504569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:08.544802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:08.547272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:08.668880 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3808/7628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:08.680381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:08.682403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:08.826696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6240-c0ed-4e62-9e72-54189a68f38f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:08.847356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:08.848407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:08.848841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:08.849283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:08.879316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:08.882052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:08.905080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3821/7629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:09.447666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.449667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:09.473022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960265-33b4-4774-8ee8-d5a9fd9b083c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.507884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.507884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.507884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.507884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] PATH_INFO: `/v3/projects/6cc04c1d6eda4106b17d53c9b26451cd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.513643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc04c1d6eda4106b17d53c9b26451cd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.515592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.605841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:09.648627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc04c1d6eda4106b17d53c9b26451cd', 'request_id': 'req-edd833ed-6c81-454d-82eb-8fe7de76ea3f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.667704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc04c1d6eda4106b17d53c9b26451cd', 'request_id': 'req-edd833ed-6c81-454d-82eb-8fe7de76ea3f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.693341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc04c1d6eda4106b17d53c9b26451cd', 'request_id': 'req-edd833ed-6c81-454d-82eb-8fe7de76ea3f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.724520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] The token cache is being invalidate because project 6cc04c1d6eda4106b17d53c9b26451cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:09.724732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.725455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.730371 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3809/7630] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:09 2022] DELETE /identity/v3/projects/6cc04c1d6eda4106b17d53c9b26451cd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:09.738206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.755015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b2e7-842a-4374-bc72-725602b35346 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.911835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.914700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.914987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.915252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] PATH_INFO: `/v3/users/d4501ff4a729461b976b1a42be9eee75` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.916463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4501ff4a729461b976b1a42be9eee75)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.918474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:10.035375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4501ff4a729461b976b1a42be9eee75'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:10.037466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4501ff4a729461b976b1a42be9eee75'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:10.056983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4501ff4a729461b976b1a42be9eee75'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:10.076641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4501ff4a729461b976b1a42be9eee75'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:10.079271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f46d2214-4df7-48e2-8ccb-d278788710b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4501ff4a729461b976b1a42be9eee75'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:10.082003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:10.120084 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3822/7631] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:09 2022] DELETE /identity/v3/users/d4501ff4a729461b976b1a42be9eee75 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:10.703842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:10.706285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:10.743825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd833ed-6c81-454d-82eb-8fe7de76ea3f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:10.875964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:10.876823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:10.877207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:10.877576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] PATH_INFO: `/v3/projects/6c5b88d227224ff1accadb47c7bd013c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:10.880599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5b88d227224ff1accadb47c7bd013c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:10.883263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.004143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5b88d227224ff1accadb47c7bd013c', 'request_id': 'req-6b9dd857-94ad-4f09-8253-9c2a703093d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:11.021249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5b88d227224ff1accadb47c7bd013c', 'request_id': 'req-6b9dd857-94ad-4f09-8253-9c2a703093d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:11.039180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5b88d227224ff1accadb47c7bd013c', 'request_id': 'req-6b9dd857-94ad-4f09-8253-9c2a703093d7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:11.060230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] The token cache is being invalidate because project 6c5b88d227224ff1accadb47c7bd013c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:11.060557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:11.065113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6b9dd857-94ad-4f09-8253-9c2a703093d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:11.073485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.076175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.076598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.080218 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3810/7632] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:10 2022] DELETE /identity/v3/projects/6c5b88d227224ff1accadb47c7bd013c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:11.117952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:11.119830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:11.265875 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3823/7633] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:11.274304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.274591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.274926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.306097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:11.307426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:11.322173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.327989 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3811/7634] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:11.343276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818136a7-667e-4926-b51b-09072d4e4c72 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.360421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.361332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.361715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.364117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.365117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:11.365805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:11.367805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.390158 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3824/7635] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:11.396196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.422390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469da50-a933-4df1-bc20-f39b01ddf216 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.432272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.433723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.433723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.433723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.434515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:11.436597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.510023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3812/7636] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:11 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:11.513915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.528943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb4b54-1624-4c58-a551-acdb871eaf7b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.658686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.659574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.660317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.662380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.668269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:11.675912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.746136 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3825/7637] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:11 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:11.754249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.771759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634944b1-f7f1-4ed6-8270-7279fc919782 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.784228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.785341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.785341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.786557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.786557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:11.788663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.820357 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3813/7638] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:11.825299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.841816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769568af-7ed8-47c5-848f-0c905e73aa70 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.859551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.861118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.861663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.862465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.864203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:11.866705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9da6b3-c655-40e4-8d22-378d2d97d002 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:11.896502 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3826/7639] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:27:11.901017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:11.914595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641c9d-8702-453d-8ea9-bfe4420ef0b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:11.930699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:11.931472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:11.931747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:11.932156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] PATH_INFO: `/v3/projects/1af890f31cd04588927c9585ede66f92/users/1c5e52bcb256417c8fa10d13a6c1121e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:11.939804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:11.998038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af890f31cd04588927c9585ede66f92, user_id=1c5e52bcb256417c8fa10d13a6c1121e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:12.005013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:12.049612 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3814/7640] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:11 2022] PUT /identity/v3/projects/1af890f31cd04588927c9585ede66f92/users/1c5e52bcb256417c8fa10d13a6c1121e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:12.062022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.062619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.062898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.101967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:12.104233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.114052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] MFA Rules not processed for user `1c5e52bcb256417c8fa10d13a6c1121e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:12.116196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.218689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:12.231109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615784f3-bced-4b63-869f-fd806c2d0395 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:12.239369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:12.241749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.242542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.243377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] PATH_INFO: `/v3/users/9d061cc0e09b4b5196d33cd1994e149c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.247059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d061cc0e09b4b5196d33cd1994e149c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:12.249258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:12.295156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3827/7641] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:12.307986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:12.310359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.356012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d061cc0e09b4b5196d33cd1994e149c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.357455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d061cc0e09b4b5196d33cd1994e149c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.358353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d061cc0e09b4b5196d33cd1994e149c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.382910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d061cc0e09b4b5196d33cd1994e149c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.403067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a76473-bd98-4037-8280-df2cbd45ea82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d061cc0e09b4b5196d33cd1994e149c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.453549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3815/7642] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:12 2022] DELETE /identity/v3/users/9d061cc0e09b4b5196d33cd1994e149c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:12.455712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.456064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.456513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.467652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e22e1e-b5a1-41b9-b631-b4a9dc9b3654 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:12.494417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:12.495735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.558819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:12.560018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.560018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.561303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.562659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.628784 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3816/7643] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:12.628784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:12.628784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.644574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:12.648458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ba3f-4436-439f-be92-d1b2d1024a1b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:12.662087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:12.663209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.664135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.664653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] PATH_INFO: `/v3/users/9a20706ee8d0498caba87d9fc030e990` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.666676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a20706ee8d0498caba87d9fc030e990)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:12.672073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:12.672464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:12.673636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:12.688041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3828/7644] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:12.689132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:12.691859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.772703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a20706ee8d0498caba87d9fc030e990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.773668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a20706ee8d0498caba87d9fc030e990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.775183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a20706ee8d0498caba87d9fc030e990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.802226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a20706ee8d0498caba87d9fc030e990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.814278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1df95127-20f7-4b5c-b87d-08652bc3abe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a20706ee8d0498caba87d9fc030e990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:12.819717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:12.838272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc04b-68ef-478c-906c-27b3873b6f81 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:12.845017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:12.846257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.847336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.847758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.850820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.856448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3817/7645] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:12 2022] DELETE /identity/v3/users/9a20706ee8d0498caba87d9fc030e990 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:12.859560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:12.859894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:12.860153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:12.874998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:12.877839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:12.888342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:12.889632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:12.897221 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3829/7646] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:13.002664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3818/7647] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:13.024402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:13.026862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:13.047424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79032e4-a401-4275-ac59-15050c054165 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:13.145574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:13.146256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:13.148161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:13.148621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:13.187093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:13.189227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:13.206147 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3830/7648] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:13.443046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:13.444493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:13.468640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a33b-da4d-43a3-bc5c-9a4e8be2c46f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:13.473490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:13.474113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:13.474393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:13.474658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] PATH_INFO: `/v3/projects/934106226731415f80af59311eaf32f9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:13.478084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=934106226731415f80af59311eaf32f9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:13.480445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:13.546632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:13.548951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:13.611062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742ef67-6c66-4515-851f-3e9b6507b777 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:13.618932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934106226731415f80af59311eaf32f9', 'request_id': 'req-0f76e401-8d81-4f1b-b711-5298fdf549bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.625430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934106226731415f80af59311eaf32f9', 'request_id': 'req-0f76e401-8d81-4f1b-b711-5298fdf549bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.643816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934106226731415f80af59311eaf32f9', 'request_id': 'req-0f76e401-8d81-4f1b-b711-5298fdf549bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.665236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:13.671803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] The token cache is being invalidate because project 934106226731415f80af59311eaf32f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:13.672461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.673499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.692080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3819/7649] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:13 2022] DELETE /identity/v3/projects/934106226731415f80af59311eaf32f9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:13.696672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:13.699100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:13.727564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:13.731183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:13.732739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:13.733656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] PATH_INFO: `/v3/projects/db17e8b491fe4f99851b0f92f2ac0f87` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:13.738127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=db17e8b491fe4f99851b0f92f2ac0f87)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:13.746744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:13.778031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e401-8d81-4f1b-b711-5298fdf549bd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:13.786772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:13.787646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:13.787927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:13.788199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] PATH_INFO: `/v3/users/62efe54f4e6b4e1bbe7310aa9ffe44d1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:13.789438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62efe54f4e6b4e1bbe7310aa9ffe44d1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:13.791612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:13.851074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62efe54f4e6b4e1bbe7310aa9ffe44d1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.851794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62efe54f4e6b4e1bbe7310aa9ffe44d1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.852569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62efe54f4e6b4e1bbe7310aa9ffe44d1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.862105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62efe54f4e6b4e1bbe7310aa9ffe44d1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.882207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ae38ceb2-b089-48b9-a4eb-a200004709eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62efe54f4e6b4e1bbe7310aa9ffe44d1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.882865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db17e8b491fe4f99851b0f92f2ac0f87', 'request_id': 'req-8f484cc6-ad82-4595-b2da-b2357bdd7eff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.906186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db17e8b491fe4f99851b0f92f2ac0f87', 'request_id': 'req-8f484cc6-ad82-4595-b2da-b2357bdd7eff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.910208 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3820/7650] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:13 2022] DELETE /identity/v3/users/62efe54f4e6b4e1bbe7310aa9ffe44d1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:13.921360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db17e8b491fe4f99851b0f92f2ac0f87', 'request_id': 'req-8f484cc6-ad82-4595-b2da-b2357bdd7eff'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.935315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] The token cache is being invalidate because project db17e8b491fe4f99851b0f92f2ac0f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:13.935549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.936356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8f484cc6-ad82-4595-b2da-b2357bdd7eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:13.942495 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3831/7651] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:13 2022] DELETE /identity/v3/projects/db17e8b491fe4f99851b0f92f2ac0f87 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:13.944825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:13.945174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:13.945743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:13.988060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:13.990733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.168087 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3821/7652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:14.179671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.181204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.181900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.213748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:14.214964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.232080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3832/7653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:14.234205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.259711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c2c7a-9efd-4917-bcb0-365ce50f7a21 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.284190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.285022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.285391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.285720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.286440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:14.286837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.289685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.308941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3822/7654] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:14.310572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.321850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.328603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad440511-5e62-42c3-b78d-5762d826fcd0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.329565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.336174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.348627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.349290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.349786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.350708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.354143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.366955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815501-830c-40b8-bdcf-b6f6097c5359 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.376450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:14.386245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.387475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.387747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.388014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] PATH_INFO: `/v3/projects/cc2b11addd1646d98540679616accfac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.390405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2b11addd1646d98540679616accfac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.394744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.394910 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3833/7655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:14 2022] POST /identity/v3/projects => generated 359 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:14.399600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.402097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:14.490673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdac5b-9917-49ba-83f1-7e4f89673ba0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.503722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2b11addd1646d98540679616accfac', 'request_id': 'req-1dc4cc5d-bd71-4bd2-a649-59463190acf9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.514215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2b11addd1646d98540679616accfac', 'request_id': 'req-1dc4cc5d-bd71-4bd2-a649-59463190acf9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.524709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2b11addd1646d98540679616accfac', 'request_id': 'req-1dc4cc5d-bd71-4bd2-a649-59463190acf9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.539125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] The token cache is being invalidate because project cc2b11addd1646d98540679616accfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:14.539448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.540271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.542023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3823/7656] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:14 2022] DELETE /identity/v3/projects/cc2b11addd1646d98540679616accfac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:14.546027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.548320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.579534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.584636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.584636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.584636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.584636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.584636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.633028 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3834/7657] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:14 2022] POST /identity/v3/users => generated 280 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:14.634447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.636942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.652071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443e71-0fec-4801-93c9-86cae025b2bb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.652267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4cc5d-bd71-4bd2-a649-59463190acf9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.659855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.661351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.661474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.661903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.662038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.662233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.662363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] PATH_INFO: `/v3/users/8e484edd5da640c18eaae99b00ffbfbd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.662498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.663135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.663591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e484edd5da640c18eaae99b00ffbfbd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.664729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.665738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.678434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3835/7658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:14.682633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.697694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de00c0-e680-437a-b24c-f6038907d095 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.705000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.705834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.706277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.707378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.707378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.709061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.725056 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3836/7659] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:14.727189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:14.732740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e484edd5da640c18eaae99b00ffbfbd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.733648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e484edd5da640c18eaae99b00ffbfbd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.734430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e484edd5da640c18eaae99b00ffbfbd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.738622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c0ea-43d4-4f80-aa55-73bb0231c4ac admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:14.750536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:14.751319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.751595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.751872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] PATH_INFO: `/v3/projects/dc25405334a54e0eb5c71f8d517c7ded/users/516119566296489ba8c644aba7e3d3a3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.752266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e484edd5da640c18eaae99b00ffbfbd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.760832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d8c3ca96-58f6-4f81-b733-34326883377b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e484edd5da640c18eaae99b00ffbfbd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:14.771461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc25405334a54e0eb5c71f8d517c7ded, user_id=516119566296489ba8c644aba7e3d3a3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:14.775213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:14.781478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3824/7660] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:14 2022] DELETE /identity/v3/users/8e484edd5da640c18eaae99b00ffbfbd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:14.815571 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3837/7661] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:14 2022] PUT /identity/v3/projects/dc25405334a54e0eb5c71f8d517c7ded/users/516119566296489ba8c644aba7e3d3a3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:14.816646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:14.817002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:14.817258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:14.843852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:14.855665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] MFA Rules not processed for user `516119566296489ba8c644aba7e3d3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:14.858038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:14.986559 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3825/7662] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:14.999432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.001327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:15.054938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:15.075008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef435e71-3f30-4992-bb6e-3b3990f82f21 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.087242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.088413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.089860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.091757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.106560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.109204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f982b14-65d5-4847-a716-f6f3d4c50eb7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.126435 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3838/7663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:15.143063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.144288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:15.244203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cf7b0-55cc-4a41-a8c6-c3edceb1f915 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.249822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.251284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.251928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.252204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] PATH_INFO: `/v3/projects/7d79df9e5e474b16996b88a51cd57d4d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.253571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d79df9e5e474b16996b88a51cd57d4d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.255605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.337334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d79df9e5e474b16996b88a51cd57d4d', 'request_id': 'req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:15.346268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d79df9e5e474b16996b88a51cd57d4d', 'request_id': 'req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:15.354874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d79df9e5e474b16996b88a51cd57d4d', 'request_id': 'req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:15.371542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] The token cache is being invalidate because project 7d79df9e5e474b16996b88a51cd57d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:15.371907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:15.372919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bfc54593-b0cd-47dd-bb97-ec6e3a2085bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:15.375904 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3826/7664] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:15 2022] DELETE /identity/v3/projects/7d79df9e5e474b16996b88a51cd57d4d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:15.381972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.382437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.382518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.414506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:15.415828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:15.504366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.504671 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3839/7665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:15.505343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.506042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.539547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:15.541019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:15.570353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.588292 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3827/7666] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:15.589847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57598de-9acf-41bf-b542-dd1a636baf8d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.602251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.603007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.603280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.603549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.604226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:15.604513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.606182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.624286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.634917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f7bd-1600-48a9-a5df-99d507317a75 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.635699 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3840/7667] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:15.647073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.647680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.647958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.648225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.649009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.651001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.704112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:15.717335 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3828/7668] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:15 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:15.719044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.731244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f718-4be6-4674-b0ab-231fd87c0efd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.832140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.832852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.833148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.833419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.834052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.839273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.876151 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3841/7669] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:15 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:15.880983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.898628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1218a-c905-4507-adc6-19ca60841500 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.906322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.907702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.908052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.908438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.909231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.911657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.928975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3829/7670] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:15.930506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.942412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571bea4-bd5c-4688-8e3e-a7b220f4e4cb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.947873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.948480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.948765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.949071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:15.949716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:15.951325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0910b96-a3d6-4641-959a-5dd55bcc21eb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:15.962872 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3842/7671] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:15.966908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:15.978289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9c9-b9f4-40d6-b082-ff5720d3efc6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:15.996465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:15.998608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:15.999496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:15.999949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] PATH_INFO: `/v3/projects/e284a9949db8456ca783be2785318a0f/users/8f9ce5602f944b78a70bd6ccf96703d9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.035036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e284a9949db8456ca783be2785318a0f, user_id=8f9ce5602f944b78a70bd6ccf96703d9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.039206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.079857 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3830/7672] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:15 2022] PUT /identity/v3/projects/e284a9949db8456ca783be2785318a0f/users/8f9ce5602f944b78a70bd6ccf96703d9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:16.098585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.098946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.099172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.139050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] MFA Rules not processed for user `8f9ce5602f944b78a70bd6ccf96703d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:16.142115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:16.239181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:16.288616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3843/7673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:16.293426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:16.417534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd515bbb-aa69-4da9-b5d8-73226461a13b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:16.428418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:16.429730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.430197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.430629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.431179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.433813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.483838 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3831/7674] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:16 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:16.485764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:16.503673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32410-cd4a-4f7c-926c-abf267b396ed None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:16.620048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:16.621227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.621801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.622212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.622985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.625091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.656678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3844/7675] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:16 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:16.660033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:16.672357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6333c-dc57-44a8-9089-a6efc1e6c0cd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:16.678081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:16.678791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.679132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.679495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.680687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.682522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.696162 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3832/7676] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:27:16.700161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:16.714195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a9c3-d775-4320-b71e-1e3a591dc6d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:16.720166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:16.721179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.721695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.722139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] PATH_INFO: `/v3/projects/f95873cd7e5f433a800942a57d92d46e/users/823845120f3549b5a7f5265b6e21df60/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.746677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95873cd7e5f433a800942a57d92d46e, user_id=823845120f3549b5a7f5265b6e21df60, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.749820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.783184 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3845/7677] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:16 2022] PUT /identity/v3/projects/f95873cd7e5f433a800942a57d92d46e/users/823845120f3549b5a7f5265b6e21df60/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:16.784606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:16.800377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242865-1d98-4be7-9376-3c9010e161ca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:16.933654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:16.934355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:16.934662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:16.935596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:16.935958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:16.939929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3698b-433e-4ede-b11e-137ce3234a97 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:16.984070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3833/7678] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:27:16.990788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:17.010841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e435c3-fa84-48f9-b85d-67ad111f8222 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:17.023379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:17.024080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:17.024347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:17.024617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] PATH_INFO: `/v3/projects/f95873cd7e5f433a800942a57d92d46e/users/823845120f3549b5a7f5265b6e21df60/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:17.026697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95873cd7e5f433a800942a57d92d46e, user_id=823845120f3549b5a7f5265b6e21df60, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:17.029670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:17.042525 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3846/7679] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:16 2022] PUT /identity/v3/projects/f95873cd7e5f433a800942a57d92d46e/users/823845120f3549b5a7f5265b6e21df60/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:17.054810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:17.055099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:17.055370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:17.101632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] MFA Rules not processed for user `823845120f3549b5a7f5265b6e21df60`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:17.103269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:17.150158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:17.283275 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3834/7680] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:17.291133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:17.292855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:17.394427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6cf35-8797-46b9-8f41-b9dff8cd952c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:17.398950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:17.399934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:17.400255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:17.400575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:17.416096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:17.417602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:17.430968 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3847/7681] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:17.602955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:17.645004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0fb0-ec3f-4fa9-94b3-6cc40c24355a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:17.695502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:17.698815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:17.699341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:17.699597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:17.793435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:17.795037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072dcc7-74b5-4744-8706-9f76a38a3b1e service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:17.806920 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3835/7682] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:23.866627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:23.941092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:23.982135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c283d-c69c-44bb-a63e-b90bbf669171 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:23.998000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:23.998684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:23.998964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:23.999237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] PATH_INFO: `/v3/users/8f9ce5602f944b78a70bd6ccf96703d9` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:24.000732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9ce5602f944b78a70bd6ccf96703d9)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:24.002751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:24.100963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9ce5602f944b78a70bd6ccf96703d9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:24.102102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9ce5602f944b78a70bd6ccf96703d9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:24.113881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9ce5602f944b78a70bd6ccf96703d9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:24.155389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9ce5602f944b78a70bd6ccf96703d9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:24.157228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9ce5602f944b78a70bd6ccf96703d9'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:24.225093 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3848/7683] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:23 2022] DELETE /identity/v3/users/8f9ce5602f944b78a70bd6ccf96703d9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:24.230035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:24.230474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:24.230644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:24.268109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:24.269390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:24.390628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3836/7684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:24.401515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:24.403114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:24.513904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8c26a-7447-497d-a05c-05a11cb869f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:24.523423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:24.524294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:24.524741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:24.525306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:24.550912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:24.552389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:24.576027 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3849/7685] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:25.180816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:25.182352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:25.203277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741463-b107-4c60-9d6e-0ec36c17d145 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:25.212813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:25.213505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:25.213776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:25.214039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] PATH_INFO: `/v3/projects/e284a9949db8456ca783be2785318a0f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:25.215170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e284a9949db8456ca783be2785318a0f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:25.217110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:25.318965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e284a9949db8456ca783be2785318a0f', 'request_id': 'req-1943184e-c090-41ae-aab2-802e2c57c29f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.330454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:25.336937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e284a9949db8456ca783be2785318a0f', 'request_id': 'req-1943184e-c090-41ae-aab2-802e2c57c29f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.359511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e284a9949db8456ca783be2785318a0f', 'request_id': 'req-1943184e-c090-41ae-aab2-802e2c57c29f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.388990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] The token cache is being invalidate because project e284a9949db8456ca783be2785318a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:25.389212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.391530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.395925 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3837/7686] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:25 2022] DELETE /identity/v3/projects/e284a9949db8456ca783be2785318a0f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:25.399644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:25.414916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c6a29-bf04-45aa-9437-beea21f4f07b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:25.597268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:25.597940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:25.598222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:25.598501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] PATH_INFO: `/v3/users/823845120f3549b5a7f5265b6e21df60` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:25.603615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823845120f3549b5a7f5265b6e21df60)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:25.605687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:25.612470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:25.736587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823845120f3549b5a7f5265b6e21df60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.737315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823845120f3549b5a7f5265b6e21df60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.749684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823845120f3549b5a7f5265b6e21df60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.768929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823845120f3549b5a7f5265b6e21df60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.769641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823845120f3549b5a7f5265b6e21df60'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:25.810103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3850/7687] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:25 2022] DELETE /identity/v3/users/823845120f3549b5a7f5265b6e21df60 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:25.981453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:25.983602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.082205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.083622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.122005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943184e-c090-41ae-aab2-802e2c57c29f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.198392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.199946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.200938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.201508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.204110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.222586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.224446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.226248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae440-7a2d-4c46-a077-f42e3b0a0a87 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.232435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.236214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.236484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.236760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] PATH_INFO: `/v3/users/516119566296489ba8c644aba7e3d3a3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.238147 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=516119566296489ba8c644aba7e3d3a3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.241400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.272545 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3838/7688] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:26.342649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.345586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.349576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516119566296489ba8c644aba7e3d3a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.350263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516119566296489ba8c644aba7e3d3a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.363936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516119566296489ba8c644aba7e3d3a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.371917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d99869-b404-497f-9203-e5a3c67fc4c9 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.377549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.378201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.378477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.378749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] PATH_INFO: `/v3/projects/f95873cd7e5f433a800942a57d92d46e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.380159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95873cd7e5f433a800942a57d92d46e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.382185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.389082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516119566296489ba8c644aba7e3d3a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.390285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-4a81ce63-2e11-40de-9418-72f8e79faa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516119566296489ba8c644aba7e3d3a3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.407691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:26.413494 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3851/7689] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:26 2022] DELETE /identity/v3/users/516119566296489ba8c644aba7e3d3a3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:26.419696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.420303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.420808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.449760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:26.451613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.453048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95873cd7e5f433a800942a57d92d46e', 'request_id': 'req-569d07ca-1fa4-46a0-91b8-0434017b9c4e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.459860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95873cd7e5f433a800942a57d92d46e', 'request_id': 'req-569d07ca-1fa4-46a0-91b8-0434017b9c4e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.470864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95873cd7e5f433a800942a57d92d46e', 'request_id': 'req-569d07ca-1fa4-46a0-91b8-0434017b9c4e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.481082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:26.487412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] The token cache is being invalidate because project f95873cd7e5f433a800942a57d92d46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:26.487914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.489203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-569d07ca-1fa4-46a0-91b8-0434017b9c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.495360 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3839/7690] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:26 2022] DELETE /identity/v3/projects/f95873cd7e5f433a800942a57d92d46e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:26.497197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae099-4108-4d15-b9b8-f4fe25d309dd None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.497896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae099-4108-4d15-b9b8-f4fe25d309dd None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.498443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae099-4108-4d15-b9b8-f4fe25d309dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.522066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fd2ae099-4108-4d15-b9b8-f4fe25d309dd None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:26.523512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fd2ae099-4108-4d15-b9b8-f4fe25d309dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.539926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3852/7691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:26.550511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.552553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.608545 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3840/7692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:26.618467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.618863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.619339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.632510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21637b5-13b3-4c46-a409-e21d803475fa None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.636753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.637560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.638009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.638456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.643117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:26.644533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.651947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.653649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.660688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3841/7693] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:26.662264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.667507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3853/7694] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:26.673307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7ef3-86bf-417a-84f0-924892f91b4b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.678880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.679591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.680003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.680807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.681576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:26.682059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.684356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.702664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3842/7695] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:26.703962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.717236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a31092-8bb3-4a7b-9a0a-5ac514b7528a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.723829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.724667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.725072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.725447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.726169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.728488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.768100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.778440 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3854/7696] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:26.784733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29752-a5b5-4ca2-9972-bbd32e81c839 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.857831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.858742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.859173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.859699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.860821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.863322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.896975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.908067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3843/7697] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:26.911276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423092-620a-4ecf-b310-23522a6ec21f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.922465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.923869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.926068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.926652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.927449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.931197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.944045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3855/7698] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:26.948733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.960215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf7c2-8bce-40f8-9a2d-cb2c3a57be91 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.968108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.968803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.969941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.970467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.971256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.973068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.983902 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3844/7699] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:26.988255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.000296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781147-c914-4293-aacd-d0f26b31905a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.006669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.009237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.009237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.009237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] PATH_INFO: `/v3/projects/8e838b2063054588a46f7aa6edfd773e/users/c5d51d4cddf4469bbf3ba788fd532121/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.040843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e838b2063054588a46f7aa6edfd773e, user_id=c5d51d4cddf4469bbf3ba788fd532121, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.043966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8de545-5991-4548-95f2-7c5d0d701cc0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.062772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.065064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3856/7700] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:26 2022] PUT /identity/v3/projects/8e838b2063054588a46f7aa6edfd773e/users/c5d51d4cddf4469bbf3ba788fd532121/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:27.074967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.075704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.076108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.076285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.112115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0288a31-a7c2-4016-a5a4-91f589eed009 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.131172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] MFA Rules not processed for user `c5d51d4cddf4469bbf3ba788fd532121`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.133329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.178524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.189539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.190449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.190723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.191011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] PATH_INFO: `/v3/projects/dc25405334a54e0eb5c71f8d517c7ded` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.191361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.193332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc25405334a54e0eb5c71f8d517c7ded)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.196937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.237344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3857/7701] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:27.246478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.248020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.300276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc25405334a54e0eb5c71f8d517c7ded', 'request_id': 'req-e73a7795-dfc1-4a13-aebb-39b56161897c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:27.324042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc25405334a54e0eb5c71f8d517c7ded', 'request_id': 'req-e73a7795-dfc1-4a13-aebb-39b56161897c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:27.332863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd61bb0-e5b2-4333-a7b6-a57cdac13db4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.341855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc25405334a54e0eb5c71f8d517c7ded', 'request_id': 'req-e73a7795-dfc1-4a13-aebb-39b56161897c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:27.362193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] The token cache is being invalidate because project dc25405334a54e0eb5c71f8d517c7ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:27.362845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:27.363153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e73a7795-dfc1-4a13-aebb-39b56161897c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:27.368004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3845/7702] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:27 2022] DELETE /identity/v3/projects/dc25405334a54e0eb5c71f8d517c7ded => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:27.370033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01893965-5189-4910-a540-0efd1a69d955 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.370375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01893965-5189-4910-a540-0efd1a69d955 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.370739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01893965-5189-4910-a540-0efd1a69d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.391727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-01893965-5189-4910-a540-0efd1a69d955 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.392978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-01893965-5189-4910-a540-0efd1a69d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.417338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.418214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.418615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.418990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.422900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.515275 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3846/7703] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:27.517878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.518158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.518448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.529989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.532461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.554576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.555799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.558531 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3858/7704] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:27.577562 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3847/7705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:27.584291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.648840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1593b8-978d-44ee-8cd4-74a8dc2632d2 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.663885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.664708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.665212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.665564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.666219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:27.666517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.670354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.709928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3859/7706] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:27.714601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.725043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447678-8c06-4f7c-8f0a-a8dda2248e01 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.733757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.734565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.734931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.735304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.736035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.739299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.778501 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3848/7707] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:27.783471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.800119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61cf9-c33d-48e9-842f-8621f369501a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.858793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.907464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.908298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.908709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.909145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.913774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.916031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.978622 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3860/7708] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:27.985683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.005440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636290a-2ff6-4f04-a500-1f4e0dd1bb2f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.018312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:28.019108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.019629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.021163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.021885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:28.026186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:28.046558 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3849/7709] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:28.050190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.075030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4611b0-9978-4d3b-9a4f-8c8e158156c4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.083415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:28.084032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.084306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.084572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.085240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:28.087041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4f00-c51e-4d5e-95c2-02738ca6f21e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:28.100415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3861/7710] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:27:28.104753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.120171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a993656-4e98-414f-bb0d-b74f52d2f770 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.125050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:28.126379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.126851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.127226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] PATH_INFO: `/v3/projects/c4715d948a304c8184fab752484bf088/users/d2b3f83d87c844379b53088d2b3d7f84/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.144803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4715d948a304c8184fab752484bf088, user_id=d2b3f83d87c844379b53088d2b3d7f84, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:28.147758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:28.166921 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3850/7711] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:28 2022] PUT /identity/v3/projects/c4715d948a304c8184fab752484bf088/users/d2b3f83d87c844379b53088d2b3d7f84/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:28.176649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.177040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.177425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.222974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] MFA Rules not processed for user `d2b3f83d87c844379b53088d2b3d7f84`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:28.226262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:28.451569 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3862/7712] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:28.452214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.573628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:28.627124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b47051-ed73-40f1-90c2-8806203e5068 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.633165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:28.633963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.634249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.634522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.636124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:28.638736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:28.682526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.684200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:28.725821 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3851/7713] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:28 2022] POST /identity/v3/projects => generated 363 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:28.733624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.817453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225a875-eff2-45d5-ab36-2fa71b97e06a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.926847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071252-0306-4318-91a1-237f3716fd02 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:28.932495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:28.933176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:28.933695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:28.934020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:28.935029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:28.937682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:28.955412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:28.975756 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3852/7714] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:28 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:28.979908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:28.994637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4619e-7003-42ec-a957-909fce1b4004 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.001457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.002051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.002352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.002648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.004874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:29.020939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.020939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.020939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.020939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.021405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.021405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.023663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.025706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.039667 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3853/7715] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:29.040892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:29.052874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ac78-3f91-4d1e-a4de-3e1bf1ab1bb8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.058022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.058723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.060679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.060679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] PATH_INFO: `/v3/projects/c3fd68d6098b48c2aaf94adba7099cee/users/52036abf1ca64afb880242430a4aa643/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.063690 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3863/7716] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:29.122867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fd68d6098b48c2aaf94adba7099cee, user_id=52036abf1ca64afb880242430a4aa643, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.132266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.165152 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3854/7717] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:29 2022] PUT /identity/v3/projects/c3fd68d6098b48c2aaf94adba7099cee/users/52036abf1ca64afb880242430a4aa643/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:29.171336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:29.186431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94309-53fa-4f39-a0d8-68218c0185a9 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.373361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.373934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.374217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.374486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.375129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.379050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601530-36dc-4a4e-bacc-25bbf94d04fb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.414831 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3864/7718] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:29.429806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:29.476097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7ab5b-84f1-4b89-8575-bc24fdebfded admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.492381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.493845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.495900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.496265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] PATH_INFO: `/v3/projects/c3fd68d6098b48c2aaf94adba7099cee/users/52036abf1ca64afb880242430a4aa643/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.502131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fd68d6098b48c2aaf94adba7099cee, user_id=52036abf1ca64afb880242430a4aa643, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.505286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.534874 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3855/7719] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:29 2022] PUT /identity/v3/projects/c3fd68d6098b48c2aaf94adba7099cee/users/52036abf1ca64afb880242430a4aa643/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:29.550786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.550786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.550786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.611063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] MFA Rules not processed for user `52036abf1ca64afb880242430a4aa643`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:29.612426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:29.629808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:29.632854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:29.749635 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3865/7720] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:29.775841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:29.778718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:29.829377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1fed1-9b02-46ff-942b-54c6729c34d1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.839613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.840215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.840485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.840749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.842590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:29.853068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:29.882957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ba57-4e56-48e5-b3de-2590e640f1a7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:29.896512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:29.897284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:29.897637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:29.899167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:29.934824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:29.940848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.942287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.962454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:29.964545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:29.972501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3866/7721] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:29.979878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3856/7722] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:30.081891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:30.118087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:30.130792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715214-6e87-446d-af37-34e1980c2614 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:30.142313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:30.142949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:30.143226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:30.143494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:30.202446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f68be-afb2-47cf-b409-18ee7722a75f service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:30.221850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c322a-eebd-4510-a007-65474e937535 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:30.223508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c322a-eebd-4510-a007-65474e937535 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:30.223783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c322a-eebd-4510-a007-65474e937535 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:30.224049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c322a-eebd-4510-a007-65474e937535 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:30.227054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-631c322a-eebd-4510-a007-65474e937535 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:30.258709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c322a-eebd-4510-a007-65474e937535 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:30.261126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c322a-eebd-4510-a007-65474e937535 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:30.316086 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3867/7723] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:30.342240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:30.346471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7811-63f2-498a-8a18-1abdb18657d1 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:30.391441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3857/7724] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:34.944484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c322a-eebd-4510-a007-65474e937535 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:34.946819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-631c322a-eebd-4510-a007-65474e937535 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.035238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c322a-eebd-4510-a007-65474e937535 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.042409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.043854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.043854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.044424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] PATH_INFO: `/v3/users/c5d51d4cddf4469bbf3ba788fd532121` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.045847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d51d4cddf4469bbf3ba788fd532121)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.049054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.127350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d51d4cddf4469bbf3ba788fd532121'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:35.128932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d51d4cddf4469bbf3ba788fd532121'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:35.143111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d51d4cddf4469bbf3ba788fd532121'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:35.157367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d51d4cddf4469bbf3ba788fd532121'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:35.159141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d51d4cddf4469bbf3ba788fd532121'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:35.186832 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3868/7725] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:34 2022] DELETE /identity/v3/users/c5d51d4cddf4469bbf3ba788fd532121 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:35.192645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.193137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.193401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.220653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:35.222130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.299249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3858/7726] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:35.309659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.311306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.320845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:35.418205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abf06-6e85-41de-a8c1-b6e945ab054d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.431267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.432860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.433255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.434622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.458180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.461546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98c45-cf36-48c1-81fd-4819b968e08c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.487420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3869/7727] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:35.967006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.968648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.988946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6e5c-daaf-4330-b2a9-ef7f0aba492d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.014530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.015587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.016475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.016930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] PATH_INFO: `/v3/projects/8e838b2063054588a46f7aa6edfd773e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.018076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e838b2063054588a46f7aa6edfd773e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.025451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.118409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:36.177872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e838b2063054588a46f7aa6edfd773e', 'request_id': 'req-7dc440c7-1926-4bf5-86d1-45e769c741e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:36.193574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e838b2063054588a46f7aa6edfd773e', 'request_id': 'req-7dc440c7-1926-4bf5-86d1-45e769c741e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:36.220532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e838b2063054588a46f7aa6edfd773e', 'request_id': 'req-7dc440c7-1926-4bf5-86d1-45e769c741e6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:36.258992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] The token cache is being invalidate because project 8e838b2063054588a46f7aa6edfd773e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:36.259292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:36.268083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7dc440c7-1926-4bf5-86d1-45e769c741e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:36.277264 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3859/7728] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:35 2022] DELETE /identity/v3/projects/8e838b2063054588a46f7aa6edfd773e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:36.281858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.282441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.282705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.314047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:36.315729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:36.427032 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3870/7729] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:36.435822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.436630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.437164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.481664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:36.486183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:36.505377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3860/7730] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:36.509931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.523442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461e112-307e-47fa-aca6-a52a4a67af52 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.541841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.542769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.543327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.543801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.544730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:36.545309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.548149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.575704 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3871/7731] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:27:36.581064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.592242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879d798-02ae-4338-9f93-30360ca74503 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.614434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.615061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.615875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.616147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.616872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.621937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.661078 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3861/7732] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:36 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:36.665302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.677780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515ae6-d084-4708-8575-130769ae54aa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.769694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.770393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.770786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.771159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.771922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.775029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.810176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.822227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3872/7733] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:36 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:36.845427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d582d-e2bd-45d7-9542-bf29bdfa4c35 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.850323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.851059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.851617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.852112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.852764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.854408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.868385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3862/7734] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:36.871503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.888715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07972a-4a04-4bce-bd60-a3f3e1dfa8e8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.893737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.894346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.894621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.894889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.895526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.897174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4ff4-0545-4b9e-96ed-a65fceb065ec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.912293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3873/7735] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:36.914073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:36.927084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877dc83-c921-47eb-a61f-54469701ab17 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:36.935092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:36.936763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:36.937326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:36.938847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] PATH_INFO: `/v3/projects/627fbc4caf0e4a9894dca145af67992d/users/f5a09213e1ff4636bc4a41eb4800c0c4/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:36.959707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=627fbc4caf0e4a9894dca145af67992d, user_id=f5a09213e1ff4636bc4a41eb4800c0c4, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:36.964385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:36.998042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3863/7736] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:36 2022] PUT /identity/v3/projects/627fbc4caf0e4a9894dca145af67992d/users/f5a09213e1ff4636bc4a41eb4800c0c4/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:37.009136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.009420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.009693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.040922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:37.066873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] MFA Rules not processed for user `f5a09213e1ff4636bc4a41eb4800c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:37.072218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:37.254944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3874/7737] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:37.259490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:37.402727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061d26-9ccd-4d2d-803f-75aeef9ff5fe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:37.409421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:37.410510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.410792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.411659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.412609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:37.415388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:37.467117 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3864/7738] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:37.472589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:37.486754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287812f-f3ab-40db-a117-6add17aa77c7 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:37.632386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:37.633309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.633615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.633885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.634535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:37.636484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:37.692648 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3875/7739] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:37 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:37.696865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:37.708742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906eda3-68cb-4df7-b705-42b6f8205694 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:37.725186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:37.728102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.728611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.729118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.729982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:37.735927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:37.768403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3865/7740] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:37.772143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:37.784827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a6d-91ac-4ea8-bbe3-7987cb38f157 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:37.790014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:37.790635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.790971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.791247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.791899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:37.794167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553a1b-cb0d-4b80-a33f-ad3d50bb6e36 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:37.810168 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3876/7741] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:37.811004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:37.825854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c6d87-ab0f-4358-b020-ba775b740ebe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:37.832274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:37.834824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.835352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.835818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] PATH_INFO: `/v3/projects/7cd07e8ece594f3ebf40e376b086eeac/users/593bca51f29346bd83ffa2ce13d4ec2d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.858374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd07e8ece594f3ebf40e376b086eeac, user_id=593bca51f29346bd83ffa2ce13d4ec2d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:37.862068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:37.881052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:37.904991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:37.905312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:37.905553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:37.908770 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3866/7742] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:37 2022] PUT /identity/v3/projects/7cd07e8ece594f3ebf40e376b086eeac/users/593bca51f29346bd83ffa2ce13d4ec2d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:37.942777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] MFA Rules not processed for user `593bca51f29346bd83ffa2ce13d4ec2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:37.944318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:38.024935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.027608 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3877/7743] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:38.098508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b907d-6852-457d-9ec9-cae0d7a0d694 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.104339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.104973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.105259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.105532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.106296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.110047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.149786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.152950 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3867/7744] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:38 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:38.165100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23e10-3305-476b-8e78-5f90683eb1af None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.177065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:38.263909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.264617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.265196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.265474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.267633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.269746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.298753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3878/7745] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:38 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:38.302871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.314445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4d66-9692-429d-9cd9-12c67bf719a2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.323402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.324111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.324458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.324801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.325569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.327779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.346459 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3868/7746] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:38.347450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.363062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fb6a-b20d-44bc-9601-fb54fb9ba347 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.378004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.380406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.381604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.382146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] PATH_INFO: `/v3/projects/5a88dc746b644412ad336150a097bbc5/users/f34c209f5bfd46afb67b90f2b4dfabf1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.423822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a88dc746b644412ad336150a097bbc5, user_id=f34c209f5bfd46afb67b90f2b4dfabf1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.428151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.475221 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3879/7747] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:38 2022] PUT /identity/v3/projects/5a88dc746b644412ad336150a097bbc5/users/f34c209f5bfd46afb67b90f2b4dfabf1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:38.476522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.490968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d293-e95a-4942-a9d2-ac87978a78e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.639896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.640524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.641436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.641715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.642366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.644021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33222733-53d7-4b20-8b62-61f624914590 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.655869 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3869/7748] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:38.659794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.678949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8605e-9f46-4587-848e-3502b35dbef3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.685759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.686540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.686826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.687106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] PATH_INFO: `/v3/projects/5a88dc746b644412ad336150a097bbc5/users/f34c209f5bfd46afb67b90f2b4dfabf1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.689861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a88dc746b644412ad336150a097bbc5, user_id=f34c209f5bfd46afb67b90f2b4dfabf1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:38.693822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:38.708489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3880/7749] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:38 2022] PUT /identity/v3/projects/5a88dc746b644412ad336150a097bbc5/users/f34c209f5bfd46afb67b90f2b4dfabf1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:38.718754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.719558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.719852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:38.764606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] MFA Rules not processed for user `f34c209f5bfd46afb67b90f2b4dfabf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:38.766655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:38.843592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:38.858029 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3870/7750] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:38.870233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:38.872342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:38.987127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7ebd-d124-49f6-90cd-e668643414c9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:38.991000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:38.994057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:38.994057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:38.994057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:39.070792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:39.072325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:39.089007 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3881/7751] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:41.184517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.206665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfcd6a-6a02-4db7-b349-26728ed0c8dc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.220157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.221827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.222402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.223568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.541445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.543175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.580953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3871/7752] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:43.222074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:43.237992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12260152-7058-4ef4-8f12-790cdaa7cf59 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:43.255039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:43.255693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:43.256405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:43.256683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:43.293013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:43.294495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:43.365627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3882/7753] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:51.563588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=30 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:53.120328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:53.120328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:53.348091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:53.358259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0947-869a-4cf3-814b-37e8df558d7a service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:53.375982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:53.378600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:53.378600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:53.392666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:53.392666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:53.424521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:53.430118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e4ce-0d7b-4a57-a7b6-ba6fdf14f211 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:53.466289 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3872/7754] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:55.753764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:55.755304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:55.949459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3315ce1-98d2-40c8-a9d7-4112953b7af2 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:55.957007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:55.957834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:55.958117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:55.958389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] PATH_INFO: `/v3/users/143690efffdb48caa991f983cbeb0a1e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:55.959745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143690efffdb48caa991f983cbeb0a1e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:55.961919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:56.084678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143690efffdb48caa991f983cbeb0a1e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:56.085679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143690efffdb48caa991f983cbeb0a1e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:56.098113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143690efffdb48caa991f983cbeb0a1e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:56.121886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143690efffdb48caa991f983cbeb0a1e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:56.122643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143690efffdb48caa991f983cbeb0a1e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:56.153089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3883/7755] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:55 2022] DELETE /identity/v3/users/143690efffdb48caa991f983cbeb0a1e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:56.157915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:56.158425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:56.158516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:56.197598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:56.202457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:56.360823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3873/7756] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:56.366862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:56.368986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:56.504759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3f49-ed94-40b3-8c9a-be8d55b34367 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:56.518047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:56.520386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:56.520674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:56.520985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:56.552282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:56.553832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caaf91-ec70-494a-aa67-42fef7f698c9 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:56.573848 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3884/7757] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:57.164544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:57.166577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:57.185192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48382a3d-180e-42ae-8b72-f7596beff62e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:57.208777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:57.209557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.209928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.210429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] PATH_INFO: `/v3/projects/a7a7fcf4e3914ac2a206015645d9b239` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.213613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a7fcf4e3914ac2a206015645d9b239)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:57.218892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:57.289920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a7fcf4e3914ac2a206015645d9b239', 'request_id': 'req-014d2a20-a36f-466f-b2af-ca6784aaefa7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:57.316232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a7fcf4e3914ac2a206015645d9b239', 'request_id': 'req-014d2a20-a36f-466f-b2af-ca6784aaefa7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:57.328805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a7fcf4e3914ac2a206015645d9b239', 'request_id': 'req-014d2a20-a36f-466f-b2af-ca6784aaefa7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:57.361607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] The token cache is being invalidate because project a7a7fcf4e3914ac2a206015645d9b239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:57.362266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:57.363302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-014d2a20-a36f-466f-b2af-ca6784aaefa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:57.365970 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3874/7758] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:57 2022] DELETE /identity/v3/projects/a7a7fcf4e3914ac2a206015645d9b239 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:57.370756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.371286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.371286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.422154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:57.429403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:57.473587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:57.568797 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3885/7759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:57.577777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.578810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.579348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.635776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:57.637350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:57.649386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3875/7760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:57.653839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:57.668660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64d3cb-b488-45b1-b5c8-991aab2f940d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:57.675018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:57.675743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.676060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.676385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.677213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:57.677733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:57.680730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:57.696833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3886/7761] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:27:57.701007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:57.706688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:57.712857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100aa8-6f13-47c4-836f-8559bb603419 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:57.722603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:57.723797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.725175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.725918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.726735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:57.729297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:57.768686 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3876/7762] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:57 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:57.772687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:57.787038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f276-d704-4923-a316-23afaecfd084 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:57.932818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:57.933600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:57.933877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:57.934146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:57.934772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:57.945322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:57.989303 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3887/7763] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:57 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:57.990467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.011682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df632c89-2bea-401d-ad0f-b945310ecf2e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:58.026775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:58.028661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.029753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.031142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.032431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:58.035671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:58.062794 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3877/7764] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:58.067167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.081160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b7f5-2049-4427-bdd0-7d3fcdf2d5ec admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:58.095051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:58.095683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.095956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.096231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.096877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:58.098525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d5453-57c4-451d-85ec-cda0f58afe92 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:58.120447 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3888/7765] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:58.125700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.137858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac57a7-3e34-4899-99e9-de956c032d4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:58.151067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:58.151910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.152193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.152466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] PATH_INFO: `/v3/projects/c23538bd11b442748faf7cf13c10275e/users/efa7a2a7459d4a7e9283875dde5ceeb8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.188749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23538bd11b442748faf7cf13c10275e, user_id=efa7a2a7459d4a7e9283875dde5ceeb8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:58.194968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:58.225930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3878/7766] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:58 2022] PUT /identity/v3/projects/c23538bd11b442748faf7cf13c10275e/users/efa7a2a7459d4a7e9283875dde5ceeb8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:58.236800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.237255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.237527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.300626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] MFA Rules not processed for user `efa7a2a7459d4a7e9283875dde5ceeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:58.301841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:58.483511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3889/7767] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:58.493465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.495321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:58.647966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe005-0a84-42be-bed1-def2dea6180c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:58.651664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:58.652299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.652556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.652823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.708877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:58.721340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:58.745147 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3879/7768] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:58.807054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.862952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:58.947050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:58.948728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:58.969972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a8b85-f82b-4387-87d4-deadecd3c458 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:58.975455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:58.976683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:58.977715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:58.978062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] PATH_INFO: `/v3/users/efa7a2a7459d4a7e9283875dde5ceeb8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:58.979588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa7a2a7459d4a7e9283875dde5ceeb8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:58.982715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:59.094594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa7a2a7459d4a7e9283875dde5ceeb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.095615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa7a2a7459d4a7e9283875dde5ceeb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.118360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa7a2a7459d4a7e9283875dde5ceeb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.135872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cda1d-e2db-4182-892e-03bb5aa60b57 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:59.138904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa7a2a7459d4a7e9283875dde5ceeb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.141534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-68ed4da8-223e-47e9-8beb-ee9a3809c73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa7a2a7459d4a7e9283875dde5ceeb8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.149810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:59.157543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:59.157543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:59.158097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] PATH_INFO: `/v3/users/f5a09213e1ff4636bc4a41eb4800c0c4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:59.159292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a09213e1ff4636bc4a41eb4800c0c4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:59.161806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:59.193659 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3890/7769] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:58 2022] DELETE /identity/v3/users/efa7a2a7459d4a7e9283875dde5ceeb8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:59.198146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:59.198837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:59.199307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:59.250241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a09213e1ff4636bc4a41eb4800c0c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.250894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a09213e1ff4636bc4a41eb4800c0c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.251943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a09213e1ff4636bc4a41eb4800c0c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.256951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:59.259148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:59.261136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:59.268296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a09213e1ff4636bc4a41eb4800c0c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.278333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-35d1c3dc-600c-4e9d-aca9-5c5387410f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a09213e1ff4636bc4a41eb4800c0c4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:59.319705 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3880/7770] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:58 2022] DELETE /identity/v3/users/f5a09213e1ff4636bc4a41eb4800c0c4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:27:59.321997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:59.322281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:59.322555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:59.364274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:59.367395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:59.406171 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3891/7771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:59.417481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:59.423300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:59.512502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:59.528743 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3881/7772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:59.544505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:59.546012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:59.573390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc18a-20b9-4173-a85f-2c700a18b737 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:59.721404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e8ae9-2224-4449-bc16-c0b92f4fb958 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:59.735416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:59.736047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:59.738423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:59.738729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:59.743158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:59.745356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:59.745650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:59.747556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:59.771002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:59.772600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:59.782817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:59.784281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:59.808472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3882/7773] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:59.812335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3892/7774] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:00.978848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:00.981434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.019356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058429-8cf0-4e40-91ca-deb1e415d6a9 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.033448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.034269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.034623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.034966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] PATH_INFO: `/v3/projects/c23538bd11b442748faf7cf13c10275e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.044479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23538bd11b442748faf7cf13c10275e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.048849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.161222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.162668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.200593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97ab7b-1485-4a57-83c8-e50f2ec4fa63 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.206735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23538bd11b442748faf7cf13c10275e', 'request_id': 'req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.221669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23538bd11b442748faf7cf13c10275e', 'request_id': 'req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.243201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23538bd11b442748faf7cf13c10275e', 'request_id': 'req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.244804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:01.267452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] The token cache is being invalidate because project c23538bd11b442748faf7cf13c10275e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:01.267750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.272473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-154b02c4-5fa4-43e5-8fbd-ac54eb410fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.274842 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3883/7775] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:00 2022] DELETE /identity/v3/projects/c23538bd11b442748faf7cf13c10275e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:01.281851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e29f-9576-4154-8d39-7f5e553f7d01 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.282355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e29f-9576-4154-8d39-7f5e553f7d01 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.282639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e29f-9576-4154-8d39-7f5e553f7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.331123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3ca8e29f-9576-4154-8d39-7f5e553f7d01 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:01.332381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3ca8e29f-9576-4154-8d39-7f5e553f7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.417653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.420255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.420537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.420811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] PATH_INFO: `/v3/projects/627fbc4caf0e4a9894dca145af67992d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.425060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627fbc4caf0e4a9894dca145af67992d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.433171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.480711 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3884/7776] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:01.489877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.490259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.491834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.541773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:01.543616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.558623 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3885/7777] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:01.583398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.592645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627fbc4caf0e4a9894dca145af67992d', 'request_id': 'req-dcda303e-8714-46e1-bb92-ef4ff7a22be2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.608616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1848d7-e452-4a49-8a6c-569050399cbb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.608831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627fbc4caf0e4a9894dca145af67992d', 'request_id': 'req-dcda303e-8714-46e1-bb92-ef4ff7a22be2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.627018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627fbc4caf0e4a9894dca145af67992d', 'request_id': 'req-dcda303e-8714-46e1-bb92-ef4ff7a22be2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.660865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] The token cache is being invalidate because project 627fbc4caf0e4a9894dca145af67992d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:01.662815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.665342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.674167 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3893/7778] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:01 2022] DELETE /identity/v3/projects/627fbc4caf0e4a9894dca145af67992d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:01.678445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.681200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.744578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:01.748038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.748805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.749122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.749389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.752877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:28:01.753462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.758007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.774841 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3886/7779] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:01.776005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.778947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.799704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20da8f-49f3-42a4-825d-f02ca08ebe72 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.807352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.808611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.809230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.809518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.810427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.815050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.815488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda303e-8714-46e1-bb92-ef4ff7a22be2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.831518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.833538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.835559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.835559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] PATH_INFO: `/v3/users/593bca51f29346bd83ffa2ce13d4ec2d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.840675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593bca51f29346bd83ffa2ce13d4ec2d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.853928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.876698 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3887/7780] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:01 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:28:01.879882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.954316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593bca51f29346bd83ffa2ce13d4ec2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.958079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593bca51f29346bd83ffa2ce13d4ec2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.973130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593bca51f29346bd83ffa2ce13d4ec2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.994529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593bca51f29346bd83ffa2ce13d4ec2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:01.996048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593bca51f29346bd83ffa2ce13d4ec2d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.018777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14b485-2928-4b8f-a962-06c615fe01db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.025440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.026066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.026346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.026620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.027523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.030125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.041125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:02.044131 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3894/7781] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:01 2022] DELETE /identity/v3/users/593bca51f29346bd83ffa2ce13d4ec2d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:02.068869 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3888/7782] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:01 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:02.072999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.074549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.209708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f384-2d8e-4630-a346-611736eecbb6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.236440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.237564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.238081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.238490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.239225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.241515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.261080 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3895/7783] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:28:02.265051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.285384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97606-4421-44ac-bfa5-751422bd6145 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.294597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.295520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.295970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.296393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.297420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.300210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.312493 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3889/7784] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:02.317182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.342114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c0bf-cabb-444a-857e-bfd139761b8f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.349138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.351729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.355534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.356498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.357027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.357545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] PATH_INFO: `/v3/projects/d5e8356c0d9142a6a4476f882e5ff9ca/users/5985661c15e84fb38ef71f176e0028b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.377604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e8356c0d9142a6a4476f882e5ff9ca, user_id=5985661c15e84fb38ef71f176e0028b5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.381765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99593a-4f01-4e98-a07e-56270a86d142 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.383323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b2cf-76bf-44ee-adbc-a86b0aab173f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.410744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.415399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.415971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.416462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] PATH_INFO: `/v3/users/1c5e52bcb256417c8fa10d13a6c1121e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.420245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5e52bcb256417c8fa10d13a6c1121e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.423591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3896/7785] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:02 2022] PUT /identity/v3/projects/d5e8356c0d9142a6a4476f882e5ff9ca/users/5985661c15e84fb38ef71f176e0028b5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:02.426234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.430003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.430664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.431521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.478142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:02.481988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.516149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:02.532992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5e52bcb256417c8fa10d13a6c1121e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.534671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5e52bcb256417c8fa10d13a6c1121e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.535831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5e52bcb256417c8fa10d13a6c1121e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.552801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5e52bcb256417c8fa10d13a6c1121e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.573013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4a03c91b-0c50-49a4-a4ca-b09bc8f5591f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5e52bcb256417c8fa10d13a6c1121e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:02.629168 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3890/7786] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:02 2022] DELETE /identity/v3/users/1c5e52bcb256417c8fa10d13a6c1121e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:02.633477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.634110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.635465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.658200 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3897/7787] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:02.679061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:02.680385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.688206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.689779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.796510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ebfa7-a6e0-4441-a2df-2d5ae0ab9328 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.876241 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3891/7788] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:02.880887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:02.884359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:02.917771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd22dad-26c9-4649-8ce9-062625fdb745 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:02.939036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.939694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.939964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.940484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] PATH_INFO: `/v3/projects/7cd07e8ece594f3ebf40e376b086eeac` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.941881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd07e8ece594f3ebf40e376b086eeac)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.942463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:02.943106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:02.943388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:02.943659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:02.943835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:02.984887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:02.986489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:03.008496 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3898/7789] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:28:03.009222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:03.025412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=4,keystone:SELECT=83,keystone:DELETE=13 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:03.034816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd07e8ece594f3ebf40e376b086eeac', 'request_id': 'req-2489434b-b3b6-4744-b8d1-a48343bc43e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.035056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2096d4-8992-472f-998b-5f336b90fa5a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:03.044051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd07e8ece594f3ebf40e376b086eeac', 'request_id': 'req-2489434b-b3b6-4744-b8d1-a48343bc43e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.067602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd07e8ece594f3ebf40e376b086eeac', 'request_id': 'req-2489434b-b3b6-4744-b8d1-a48343bc43e9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.088291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] The token cache is being invalidate because project 7cd07e8ece594f3ebf40e376b086eeac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:03.089263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.094990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.099653 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3892/7790] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:02 2022] DELETE /identity/v3/projects/7cd07e8ece594f3ebf40e376b086eeac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:03.100986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:03.103731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:03.141432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:03.142100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:03.142425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:03.142697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:03.144727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:03.224504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:03.273353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489434b-b3b6-4744-b8d1-a48343bc43e9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:03.285331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:03.287051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:03.290477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:03.291220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:03.291569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:03.291908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] PATH_INFO: `/v3/users/f34c209f5bfd46afb67b90f2b4dfabf1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:03.301678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34c209f5bfd46afb67b90f2b4dfabf1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:03.303754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:03.311215 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3899/7791] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:03.409090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34c209f5bfd46afb67b90f2b4dfabf1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.411748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34c209f5bfd46afb67b90f2b4dfabf1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.412433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34c209f5bfd46afb67b90f2b4dfabf1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.430765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34c209f5bfd46afb67b90f2b4dfabf1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.443335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34c209f5bfd46afb67b90f2b4dfabf1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:03.477093 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3893/7792] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:03 2022] DELETE /identity/v3/users/f34c209f5bfd46afb67b90f2b4dfabf1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:04.356586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:04.358922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:04.418690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:04.421739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:04.425070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0cfb-a7e3-465f-b13d-2535df55159d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:04.580735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:04.581444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:04.581780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:04.582059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] PATH_INFO: `/v3/projects/1af890f31cd04588927c9585ede66f92` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:04.583815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af890f31cd04588927c9585ede66f92)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:04.585842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:04.591382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:04.630397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd73c7-ecbe-4887-948e-2cb8609a58ba admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:04.658447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:04.660334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:04.660737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:04.661044 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] PATH_INFO: `/v3/projects/5a88dc746b644412ad336150a097bbc5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:04.664779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a88dc746b644412ad336150a097bbc5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:04.668668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:04.673551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af890f31cd04588927c9585ede66f92', 'request_id': 'req-adb0f012-cc57-4552-98e0-84c9792b0607'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.683080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af890f31cd04588927c9585ede66f92', 'request_id': 'req-adb0f012-cc57-4552-98e0-84c9792b0607'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.700494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af890f31cd04588927c9585ede66f92', 'request_id': 'req-adb0f012-cc57-4552-98e0-84c9792b0607'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.729369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] The token cache is being invalidate because project 1af890f31cd04588927c9585ede66f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:04.729744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.734949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-adb0f012-cc57-4552-98e0-84c9792b0607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.740929 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3900/7793] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:04 2022] DELETE /identity/v3/projects/1af890f31cd04588927c9585ede66f92 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:04.746928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:04.747307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:04.747512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:04.766973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a88dc746b644412ad336150a097bbc5', 'request_id': 'req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.783872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a88dc746b644412ad336150a097bbc5', 'request_id': 'req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.807162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a88dc746b644412ad336150a097bbc5', 'request_id': 'req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.821204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:04.822003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] The token cache is being invalidate because project 5a88dc746b644412ad336150a097bbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:04.822800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.823229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fdaa0a46-4ec4-4e6b-9a2a-3a543dc10a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:04.824693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:04.827115 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3894/7794] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:04 2022] DELETE /identity/v3/projects/5a88dc746b644412ad336150a097bbc5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:05.015028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:05.048380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3901/7795] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:05.186318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.187103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.188319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.252157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:05.256217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:05.288138 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3895/7796] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:05.292346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.304890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306e0c3-ba9c-4a16-999a-5bc2f38006d9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.330496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.331118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.331392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.331679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.332598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:28:05.332972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.334930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.344720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.346208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:05.372489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab8fa-44e8-4bc3-bdf4-8febe22eaf81 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.379335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3902/7797] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:05.386374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.397818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.401548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.402057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.402499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] PATH_INFO: `/v3/users/d2b3f83d87c844379b53088d2b3d7f84` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.405505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b3f83d87c844379b53088d2b3d7f84)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.407495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.418374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2eaca-a759-4ee9-936a-6e9d853251f5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.443436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.444346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.444773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.445224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.446157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.448318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.509694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3903/7798] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:05 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:05.513780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.538754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b3f83d87c844379b53088d2b3d7f84'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:05.540201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b3f83d87c844379b53088d2b3d7f84'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:05.541119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b3f83d87c844379b53088d2b3d7f84'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:05.557048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b3f83d87c844379b53088d2b3d7f84'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:05.573256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0022b599-4166-430b-aa67-0a295434e09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b3f83d87c844379b53088d2b3d7f84'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:05.613965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3896/7799] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:05 2022] DELETE /identity/v3/users/d2b3f83d87c844379b53088d2b3d7f84 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:05.618644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.619110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.619524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.635711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e53c-6a37-49fe-9bfc-9191b974f0fc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.658189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:05.662272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:05.754723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:05.773034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.774071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.774719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.775367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.778163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.780426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.801285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3897/7800] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:05.827161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.829537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:05.837658 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3904/7801] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:05 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:28:05.841753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.845381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:05.882306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef48e-5ee5-4092-b5bb-aa313c83b7b6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.895759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.897507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.902215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.903243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.905783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.908941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.927668 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3905/7802] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:28:05.931477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:05.955536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172081ad-3ce4-4afe-945c-e747d38af71d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.956059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00738b8-40f8-45fa-9642-7a30aba9a33b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:05.969867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.970517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.970630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:05.970812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.971071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.971186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:05.971458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:05.971725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:05.972366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.974215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.985077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:05.986545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d831d6-4bf6-4a4b-b8bb-05e98233f400 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:05.999225 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3906/7803] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:06.000216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:06.011167 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3898/7804] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:06.027090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19e80-7e69-4283-9a2b-271c83b80572 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:06.036583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:06.037292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:06.037647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:06.037883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] PATH_INFO: `/v3/projects/e26f288a72124147a70a71d5c17b9f86/users/9ada2d444d9444769736896f92af01d0/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:06.070390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26f288a72124147a70a71d5c17b9f86, user_id=9ada2d444d9444769736896f92af01d0, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:06.075952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:06.121737 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3907/7805] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:05 2022] PUT /identity/v3/projects/e26f288a72124147a70a71d5c17b9f86/users/9ada2d444d9444769736896f92af01d0/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:06.124059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:06.124476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:06.125403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:06.206101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] MFA Rules not processed for user `9ada2d444d9444769736896f92af01d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:06.207559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:06.357164 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3899/7806] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:06.364185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:06.367401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:06.392837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:06.496388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0100-97a9-4c9b-99ce-8fd71e5302c2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:06.501464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:06.502193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:06.502600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:06.502977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:06.518458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:06.520482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:06.539508 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3908/7807] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:28:06.864709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:06.866509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:07.068595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19ffc-9e09-4bd7-959b-438de8d14374 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:07.082430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:07.083354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:07.083790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:07.084217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] PATH_INFO: `/v3/projects/c4715d948a304c8184fab752484bf088` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:07.086354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4715d948a304c8184fab752484bf088)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:07.088691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:07.123300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:07.173944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4715d948a304c8184fab752484bf088', 'request_id': 'req-8af6f3ed-be70-4690-b07c-a71817dc1743'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.185120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4715d948a304c8184fab752484bf088', 'request_id': 'req-8af6f3ed-be70-4690-b07c-a71817dc1743'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.207841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4715d948a304c8184fab752484bf088', 'request_id': 'req-8af6f3ed-be70-4690-b07c-a71817dc1743'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.232870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] The token cache is being invalidate because project c4715d948a304c8184fab752484bf088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:07.233245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.234067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.235638 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3900/7808] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:06 2022] DELETE /identity/v3/projects/c4715d948a304c8184fab752484bf088 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:07.239903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:07.256663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60c5-3265-4759-b6b0-785316686946 service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:07.336343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:07.337745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:07.337745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:07.338798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] PATH_INFO: `/v3/users/52036abf1ca64afb880242430a4aa643` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:07.344471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52036abf1ca64afb880242430a4aa643)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:07.345902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:07.427311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52036abf1ca64afb880242430a4aa643'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.428757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52036abf1ca64afb880242430a4aa643'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.439758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52036abf1ca64afb880242430a4aa643'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.457859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52036abf1ca64afb880242430a4aa643'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.460747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b8144e38-97b5-43eb-b9ed-d36ae8ff6369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52036abf1ca64afb880242430a4aa643'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:07.486908 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3909/7809] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:07 2022] DELETE /identity/v3/users/52036abf1ca64afb880242430a4aa643 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:08.262665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:08.264342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:08.301466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f3ed-be70-4690-b07c-a71817dc1743 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:08.429269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:08.430751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:08.431307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:08.431807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] PATH_INFO: `/v3/projects/c3fd68d6098b48c2aaf94adba7099cee` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:08.435138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fd68d6098b48c2aaf94adba7099cee)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:08.442403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:08.549910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fd68d6098b48c2aaf94adba7099cee', 'request_id': 'req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:08.569625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fd68d6098b48c2aaf94adba7099cee', 'request_id': 'req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:08.591144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fd68d6098b48c2aaf94adba7099cee', 'request_id': 'req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:08.616526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] The token cache is being invalidate because project c3fd68d6098b48c2aaf94adba7099cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:08.616997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:08.617756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9cda9a8f-e20b-4922-b9e4-9b5db4e5fb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:08.623204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3901/7810] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:08 2022] DELETE /identity/v3/projects/c3fd68d6098b48c2aaf94adba7099cee => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:08.628396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:08.628851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:08.628987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:08.654865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:08.657175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:08.708344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:08.762277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:08.762570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:08.762852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:08.773311 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3910/7811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:08.790470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:08.797259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:08.819209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:08.826158 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3902/7812] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:08.840926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791aeb4-39e1-4eb2-8bd1-c2a7e67235ff None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:08.842231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:08.842859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:08.843142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:08.843517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:08.846610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:28:08.846936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:08.856419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:08.889036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:08.895491 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3911/7813] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:08.900175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544aea-d8cc-444e-8354-e7ca0a916a4a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:08.913725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:08.914368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:08.914652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:08.914924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:08.915562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:08.917533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:08.965736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:08.971560 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3903/7814] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:08.978127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c4f3a-8ad6-4b2c-91e2-d3ea69bd9912 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.056774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.058179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.058578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.058863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.059560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.061779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:09.110472 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3912/7815] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:08 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:09.114238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:09.127576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba06224-a16f-401d-99ee-b65df24ccfa1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.136060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.136890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.137284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.139466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.140435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.142419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:09.158021 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3904/7816] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:09.162170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:09.181659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774ea14-4a38-4fbc-b00e-08f29e04014e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.186903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.187786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.188138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.188484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.189560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.192476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd81d7-d934-4fb3-9cbf-e47f6a3a6c44 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:09.206601 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3913/7817] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:09.210887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:09.221868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:09.231064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdc7d-1408-4b48-a3ea-c19cb4c90c5f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.243209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.245615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.245615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.245615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] PATH_INFO: `/v3/projects/243ca72d18a44bd2aaebe1f3fe62a55d/users/d4f8827a818c4f5aa6bfc637a2e767c7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.297480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243ca72d18a44bd2aaebe1f3fe62a55d, user_id=d4f8827a818c4f5aa6bfc637a2e767c7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.300170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:09.336820 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3905/7818] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:09 2022] PUT /identity/v3/projects/243ca72d18a44bd2aaebe1f3fe62a55d/users/d4f8827a818c4f5aa6bfc637a2e767c7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:09.360052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.361889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.362518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.410625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] MFA Rules not processed for user `d4f8827a818c4f5aa6bfc637a2e767c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:09.413061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:09.515918 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3914/7819] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:09.520088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:09.748749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7797eb-6297-4eb5-9e8a-8262361731d6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.763023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.763757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.764042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.764315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.765016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.769621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:09.828845 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3906/7820] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:09 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:28:09.830888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:09.846756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a931-db83-48c4-87af-162f900c20b4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:09.908025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:09.980081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:09.980765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:09.981075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:09.981406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:09.982718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:09.987934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.043227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3915/7821] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:09 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:10.044152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:10.058910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb04d-c129-4e9f-8ed2-fb1652547121 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:10.073050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:10.074245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.074740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.075316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.076138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:10.081670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.108972 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3907/7822] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:10.113500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:10.128844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738348-3527-4b9b-ae71-45bc3f32b894 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:10.141344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:10.142039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.142321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.142804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] PATH_INFO: `/v3/projects/89d4deabf18648548fd788bcc8e35287/users/6f7e5d16c39c41d89d857f0dcf06cc53/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.183468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d4deabf18648548fd788bcc8e35287, user_id=6f7e5d16c39c41d89d857f0dcf06cc53, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:10.186334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.217771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3916/7823] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:10 2022] PUT /identity/v3/projects/89d4deabf18648548fd788bcc8e35287/users/6f7e5d16c39c41d89d857f0dcf06cc53/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:10.221833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:10.233498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ffad-6be9-4287-ad10-d447aee2e9ca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:10.395314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:10.395932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.396207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.396480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.397152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:10.400983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770715e-4f19-4c21-9d81-3a77782b90c3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.432374 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3908/7824] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:28:10.434453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:10.451799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8761b3-eefe-4dcf-ac5d-95ff2ce2d94f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:10.469661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:10.472479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.472767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.477104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] PATH_INFO: `/v3/projects/89d4deabf18648548fd788bcc8e35287/users/6f7e5d16c39c41d89d857f0dcf06cc53/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.488108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d4deabf18648548fd788bcc8e35287, user_id=6f7e5d16c39c41d89d857f0dcf06cc53, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:10.490851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.536933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3917/7825] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:10 2022] PUT /identity/v3/projects/89d4deabf18648548fd788bcc8e35287/users/6f7e5d16c39c41d89d857f0dcf06cc53/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:10.540201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.540735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.543348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.579213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] MFA Rules not processed for user `6f7e5d16c39c41d89d857f0dcf06cc53`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:10.580859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:10.650178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:10.720737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3909/7826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:10.733834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:10.736582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:10.862298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b11ad3-1f3d-4ad1-ad33-3ff0f8b0b2d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:10.867289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:10.867924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:10.868204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:10.868601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:10.903569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:10.905074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3b3ab-ada4-41bb-8b01-621e71bbaa62 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:10.940981 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3918/7827] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:11.014599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:11.016245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:11.047311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8198ac-2aeb-4298-ab71-5dd997246bd7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:11.058842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:11.059480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:11.059761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:11.060035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:11.201875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:11.203376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:11.219219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:11.219517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:11.219774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:11.242719 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3910/7828] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:11.310263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] MFA Rules not processed for user `5985661c15e84fb38ef71f176e0028b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:11.311501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:11.512242 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3919/7829] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:11.517384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:11.520230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:11.731670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8831-343b-4dc7-8839-6c8ef0ea51ee service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:11.745686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:11.748347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:11.748647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:11.748987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:11.749680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:11.757212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:11.840847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:11.841416 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3911/7830] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:11 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:28:11.878762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d9c7-75cb-40b0-9b5d-1ae9946c5508 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:11.892174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:11.892746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:11.893054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:11.899518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:11.901548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:11.905567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338930d-b2dc-437b-a962-6b0bca90de1a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:11.932989 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3920/7831] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:11.934141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:11.949913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebd386-7892-4fb8-a963-f3f612f32fab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:11.957517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:11.958231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:11.958512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:11.958785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] PATH_INFO: `/v3/system/users/66da35bfcd6843c28758fc2b33a647b4/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:11.979448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66da35bfcd6843c28758fc2b33a647b4, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:11.982789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:11.993580 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3912/7832] 10.222.0.16 () {60 vars in 1378 bytes} [Fri Oct 28 10:28:11 2022] PUT /identity/v3/system/users/66da35bfcd6843c28758fc2b33a647b4/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:12.005102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:12.005394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:12.005670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:12.015054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:12.066228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] MFA Rules not processed for user `66da35bfcd6843c28758fc2b33a647b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:12.068229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:12.226126 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3921/7833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:12 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 10:28:12.232116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:12.305461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:12.407978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ebbb-c5d6-4865-9394-4b73167054bc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:12.480171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66da35bfcd6843c28758fc2b33a647b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:12.481136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:12.481537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:12.481904 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] PATH_INFO: `/v3/services` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:12.483105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:12.485902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:12.495112 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3913/7834] 10.222.0.16 () {58 vars in 1110 bytes} [Fri Oct 28 10:28:12 2022] GET /identity/v3/services => generated 2191 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:12.499842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:12.853888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c50878-6217-4f3d-9461-523d89bac594 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:13.002762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:13.065204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66da35bfcd6843c28758fc2b33a647b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:13.072176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:13.072964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:13.073260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] PATH_INFO: `/v3/limits` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:13.074046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:13.075764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 28 10:28:13.190360 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 28 10:28:13.191776 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:28:13.197121 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3922/7835] 10.222.0.16 () {60 vars in 1126 bytes} [Fri Oct 28 10:28:12 2022] POST /identity/v3/limits => generated 124 bytes in 693 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:28:13.197231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:13.533098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4b6a-e81d-4a60-a4e4-9fed20549553 None tempest-ImageQuotaTest-1118650941-system-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:13.536123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:13.697841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66da35bfcd6843c28758fc2b33a647b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:13.699333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:13.699744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:13.700237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:13.701049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:13.702350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4968c7-6d00-4bc2-be6d-0da2cc93aaf4 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:13.732300 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3914/7836] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:28:13 2022] GET /identity/v3/registered_limits => generated 129 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:13.738290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:13.996446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372aaa87-3af1-49ec-b370-22d04b3b085a None tempest-ImageQuotaTest-1118650941-system-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:14.075624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66da35bfcd6843c28758fc2b33a647b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:14.076377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:14.076875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:14.077183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:14.077856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:14.078942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:14.085374 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3923/7837] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:28:13 2022] GET /identity/v3/registered_limits => generated 129 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:16.152493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d2f-5d92-447b-92a2-aa4dadbf44ed None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:16.153520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d2f-5d92-447b-92a2-aa4dadbf44ed None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:16.155491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e38d2f-5d92-447b-92a2-aa4dadbf44ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:16.162149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:16.198945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701faf-ae9a-47a1-9ba0-1ebaa7c667b0 None tempest-ImageQuotaTest-1118650941-system-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:16.202051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-26e38d2f-5d92-447b-92a2-aa4dadbf44ed None None] MFA Rules not processed for user `608b9dc1a00d489a94524f99820022f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:16.203895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26e38d2f-5d92-447b-92a2-aa4dadbf44ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:16.220470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:16.221138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:16.227797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:16.228184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] PATH_INFO: `/v3/users/d4f8827a818c4f5aa6bfc637a2e767c7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:16.230874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f8827a818c4f5aa6bfc637a2e767c7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:16.237482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:16.362897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:16.369568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f8827a818c4f5aa6bfc637a2e767c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:16.371543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f8827a818c4f5aa6bfc637a2e767c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:16.381999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3915/7838] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:16.394103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f8827a818c4f5aa6bfc637a2e767c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:16.417341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f8827a818c4f5aa6bfc637a2e767c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:16.419634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f8827a818c4f5aa6bfc637a2e767c7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:16.504027 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3924/7839] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:16 2022] DELETE /identity/v3/users/d4f8827a818c4f5aa6bfc637a2e767c7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:16.508654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dec686-e994-46dc-9850-1f100be25013 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:16.509265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dec686-e994-46dc-9850-1f100be25013 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:16.509946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dec686-e994-46dc-9850-1f100be25013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:16.542420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-98dec686-e994-46dc-9850-1f100be25013 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:16.544445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-98dec686-e994-46dc-9850-1f100be25013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:16.644831 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3916/7840] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:16.767049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:16.768844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:16.889773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9905-c345-457c-b3af-19873d78059b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:16.895091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:16.895892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:16.896274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:16.896659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:16.906923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:16.908544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:16.920122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3925/7841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:17.990421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dec686-e994-46dc-9850-1f100be25013 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:17.992015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-98dec686-e994-46dc-9850-1f100be25013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:18.086115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dec686-e994-46dc-9850-1f100be25013 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:18.094431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:18.095243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:18.095864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:18.096379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] PATH_INFO: `/v3/projects/243ca72d18a44bd2aaebe1f3fe62a55d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:18.097958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243ca72d18a44bd2aaebe1f3fe62a55d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:18.100369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:18.174148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243ca72d18a44bd2aaebe1f3fe62a55d', 'request_id': 'req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.183681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:18.191470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243ca72d18a44bd2aaebe1f3fe62a55d', 'request_id': 'req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.209098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243ca72d18a44bd2aaebe1f3fe62a55d', 'request_id': 'req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.236761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] The token cache is being invalidate because project 243ca72d18a44bd2aaebe1f3fe62a55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:18.238039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.241309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.244190 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3917/7842] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:17 2022] DELETE /identity/v3/projects/243ca72d18a44bd2aaebe1f3fe62a55d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:18.248021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:18.395415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb049ff-cb39-4316-bb2e-19681b77ad4b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:18.605777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:18.606442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:18.606721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:18.606991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] PATH_INFO: `/v3/users/6f7e5d16c39c41d89d857f0dcf06cc53` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:18.621836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7e5d16c39c41d89d857f0dcf06cc53)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:18.623829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:18.761980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:18.771164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7e5d16c39c41d89d857f0dcf06cc53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.772082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7e5d16c39c41d89d857f0dcf06cc53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.800176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7e5d16c39c41d89d857f0dcf06cc53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.819433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7e5d16c39c41d89d857f0dcf06cc53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.821456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-34db7aa3-decf-46cf-9b54-306d28a2af60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7e5d16c39c41d89d857f0dcf06cc53'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:18.870292 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3926/7843] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:18 2022] DELETE /identity/v3/users/6f7e5d16c39c41d89d857f0dcf06cc53 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:19.460963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:19.462565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:19.539948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1aa0-90ef-40eb-90cd-8ab9c4596576 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:19.634424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:19.635579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:19.636101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:19.636973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] PATH_INFO: `/v3/projects/89d4deabf18648548fd788bcc8e35287` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:19.638891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d4deabf18648548fd788bcc8e35287)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:19.641290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:19.844841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d4deabf18648548fd788bcc8e35287', 'request_id': 'req-08218dc3-8210-4536-85cc-22beeb77bdb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:19.878632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d4deabf18648548fd788bcc8e35287', 'request_id': 'req-08218dc3-8210-4536-85cc-22beeb77bdb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:19.907888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d4deabf18648548fd788bcc8e35287', 'request_id': 'req-08218dc3-8210-4536-85cc-22beeb77bdb1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:19.923074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] The token cache is being invalidate because project 89d4deabf18648548fd788bcc8e35287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:19.923464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:19.924252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08218dc3-8210-4536-85cc-22beeb77bdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:19.930152 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3918/7844] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:19 2022] DELETE /identity/v3/projects/89d4deabf18648548fd788bcc8e35287 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:19.931623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:19.932072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:19.932266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:19.983483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:19.985053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:20.093883 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3927/7845] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:20.102351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.102646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.102929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.166558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:20.173265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:20.194014 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3919/7846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:20.194925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.227954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a4a7d-b0dc-466f-b383-193b1ce6b938 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.245158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.245884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.248493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.248739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.249448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:28:20.252451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.254748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.294074 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3928/7847] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:28:20.295967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.314568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efbcda-fa2b-4dc3-90a1-95b1c201b906 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.324846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.325515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.325797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.326067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.326713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.328709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.419034 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3920/7848] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:20 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:20.420861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.435790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc78b-d503-4e33-8385-2a905e37e996 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.614216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.615547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.615823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.616091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.616729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.623172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.681711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3929/7849] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:20 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:20.687389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.701231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18898c-e6ad-492c-aa1a-bd3eaffa31da admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.717723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.719031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.719325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.719603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.720245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.722130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.750477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.751181 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3921/7850] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:20.768034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2d94-00c0-480e-adab-f4ac01f2d262 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.779390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.780172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.780556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.781580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.782436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.784401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3859899-e894-43ca-adaf-cf7da8ad587b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.811354 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3930/7851] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:28:20.815352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:20.836397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bdc69-c6f0-482a-b486-8e786bbb5006 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:20.846354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:20.846953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.847226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.847499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] PATH_INFO: `/v3/projects/ac060d6a2d3a4bcea08d1791ebf5b4a2/users/297db1a0215144ffafd52353489931d8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:20.854975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:20.893085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac060d6a2d3a4bcea08d1791ebf5b4a2, user_id=297db1a0215144ffafd52353489931d8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:20.895791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:20.936629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3922/7852] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:20 2022] PUT /identity/v3/projects/ac060d6a2d3a4bcea08d1791ebf5b4a2/users/297db1a0215144ffafd52353489931d8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:20.948260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:20.949425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:20.949909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.018383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] MFA Rules not processed for user `297db1a0215144ffafd52353489931d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:21.020014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:21.062686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:21.232327 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3931/7853] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:21.237109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:21.377076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb577f9-d5c1-43e5-b8c0-da28d3abcddc admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:21.389466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:21.390143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:21.390481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:21.390762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.391406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:21.393766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:21.455173 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3923/7854] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:21 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:21.460073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:21.498230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18889-f482-4cd0-9d6a-37b87bc79761 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:21.689457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:21.690080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:21.690357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:21.692723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.697861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:21.700991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:21.760876 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3932/7855] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:21 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:21.766122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:21.807491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4fe5-e201-4f2a-8b6c-3f59decbf25e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:21.825771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:21.827935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:21.828361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:21.828802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.829645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:21.832445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:21.849687 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3924/7856] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:21.853287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:21.870809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b823e-aa01-4bf0-8ece-96acbe9b6fdc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:21.885473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:21.888238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:21.888794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:21.889400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.891242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:21.895544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4432a4-0630-4888-9d03-7360f325fab5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:21.939547 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3933/7857] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:21.943761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:21.955713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec07ee-287c-4bf1-ab44-8ec12705362f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:21.969830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:21.970636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:21.971635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:21.972963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] PATH_INFO: `/v3/projects/b2c4ec21592a41ab8ab2cec65e06c640/users/dfda7769cf7e4f6f929ceb3f411e0fba/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:21.998532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4ec21592a41ab8ab2cec65e06c640, user_id=dfda7769cf7e4f6f929ceb3f411e0fba, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.001830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.036860 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3925/7858] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:21 2022] PUT /identity/v3/projects/b2c4ec21592a41ab8ab2cec65e06c640/users/dfda7769cf7e4f6f929ceb3f411e0fba/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:22.038775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.039228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.039524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.104686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] MFA Rules not processed for user `dfda7769cf7e4f6f929ceb3f411e0fba`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:22.106703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:22.284325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3934/7859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:22.292874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:22.364828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:22.366358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:22.429502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:22.459661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa353-385d-4355-aa9f-8606d135d608 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:22.470157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:22.473142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.477979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.479522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.480707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.483292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.574315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3926/7860] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:22 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:22.575702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:22.670695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:22.704586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294169ae-d3c5-4f54-bb96-f367ff148b9a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:22.822333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8fa62-56a9-458f-8964-9f1371cf1269 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:22.845215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:22.846135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.846594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.847028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.850015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:22.851375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:22.852103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.853657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.853937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.854584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.857935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.881761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.883783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.891422 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3927/7861] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:22 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:22.891422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:22.891982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:22.909080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f798-627a-4f0e-a394-44dcf470d46e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:22.915874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:22.917036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.917478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.917759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] PATH_INFO: `/v3/users/5985661c15e84fb38ef71f176e0028b5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.918912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5985661c15e84fb38ef71f176e0028b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.921010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.922612 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3935/7862] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:28:22.923487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:22.935624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d11f-0f11-4fd3-8636-0d0259528acf service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:22.951568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:22.958212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:22.958637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:22.959022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:22.959879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:22.961789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:22.986363 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3936/7863] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:22.992424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.003052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5985661c15e84fb38ef71f176e0028b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.004058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5985661c15e84fb38ef71f176e0028b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.005083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5985661c15e84fb38ef71f176e0028b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.013111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0aaa3-81ba-476d-b8c5-98396ffc3928 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:23.019525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5985661c15e84fb38ef71f176e0028b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.023097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:23.023919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:23.024310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:23.024686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] PATH_INFO: `/v3/projects/8eba9e72d1a7455fbdd212287a35389f/users/68fbf8014a334cc998b68ef5d0e5eb67/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:23.043133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5985661c15e84fb38ef71f176e0028b5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.059223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eba9e72d1a7455fbdd212287a35389f, user_id=68fbf8014a334cc998b68ef5d0e5eb67, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:23.062687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:23.089332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3928/7864] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:22 2022] DELETE /identity/v3/users/5985661c15e84fb38ef71f176e0028b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:23.090561 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3937/7865] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:22 2022] PUT /identity/v3/projects/8eba9e72d1a7455fbdd212287a35389f/users/68fbf8014a334cc998b68ef5d0e5eb67/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:23.094542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.096009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:23.174084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a584e-ef22-4de0-84c6-291b91e90c7f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:23.182469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:23.183285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:23.183730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:23.184157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:23.185629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:23.188372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:23.215818 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3929/7866] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:23.216749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.458299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec997-cd9b-4d25-9b47-46948c6d9d6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:23.479835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:23.480886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:23.483889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:23.484357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] PATH_INFO: `/v3/projects/8eba9e72d1a7455fbdd212287a35389f/users/68fbf8014a334cc998b68ef5d0e5eb67/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:23.490734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eba9e72d1a7455fbdd212287a35389f, user_id=68fbf8014a334cc998b68ef5d0e5eb67, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:23.503310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c52864-030b-4cea-bf90-d4190db2d32c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:23.526161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:23.533469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.535401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:23.566819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3938/7867] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:23 2022] PUT /identity/v3/projects/8eba9e72d1a7455fbdd212287a35389f/users/68fbf8014a334cc998b68ef5d0e5eb67/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:23.569767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:23.570177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:23.570313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:23.573909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89acc52-1050-426f-b187-d5deb2f17f86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:23.605909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:23.651760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] MFA Rules not processed for user `68fbf8014a334cc998b68ef5d0e5eb67`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:23.654598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:23.758368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:23.760969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:23.764405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:23.765551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] PATH_INFO: `/v3/projects/d5e8356c0d9142a6a4476f882e5ff9ca` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:23.767470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e8356c0d9142a6a4476f882e5ff9ca)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:23.769804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:23.875190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e8356c0d9142a6a4476f882e5ff9ca', 'request_id': 'req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.885053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e8356c0d9142a6a4476f882e5ff9ca', 'request_id': 'req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.896826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e8356c0d9142a6a4476f882e5ff9ca', 'request_id': 'req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.915273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] The token cache is being invalidate because project d5e8356c0d9142a6a4476f882e5ff9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:23.915580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.916333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:23.918875 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3930/7868] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:23 2022] DELETE /identity/v3/projects/d5e8356c0d9142a6a4476f882e5ff9ca => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:23.930498 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3939/7869] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:23.936843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.943720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:23.945180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:23.953235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:24.090672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa088-d5aa-4fef-9de5-e7f17fa64a2e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:24.123984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99bfc-e18f-4cbe-86b2-0e8f05ce3757 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:24.136138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:24.136806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:24.137141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:24.137421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] PATH_INFO: `/v3/users/66da35bfcd6843c28758fc2b33a647b4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:24.138604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66da35bfcd6843c28758fc2b33a647b4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:24.140664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:24.166965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:24.167966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:24.168355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:24.168739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:24.172593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:24.245450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:24.263837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:24.265305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66da35bfcd6843c28758fc2b33a647b4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:24.266030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66da35bfcd6843c28758fc2b33a647b4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:24.266668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66da35bfcd6843c28758fc2b33a647b4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:24.281367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66da35bfcd6843c28758fc2b33a647b4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:24.290428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:24.292502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:24.295351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66da35bfcd6843c28758fc2b33a647b4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:24.309594 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3940/7870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:28:24.361109 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3931/7871] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:23 2022] DELETE /identity/v3/users/66da35bfcd6843c28758fc2b33a647b4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:24.454870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:24.456754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:24.506328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3182-c68e-47ab-9ffa-39f95c0f85df service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:24.683013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:24.683945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:24.684234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:24.684648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:24.690202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:24.834354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:24.836811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f82c2-2acc-4f81-ae7b-08459dbf8f32 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:24.851390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3941/7872] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:29.117338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:29.118809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:29.193524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0583883-8c9a-4cf3-a298-8f1e3de59520 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:29.198522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:29.199230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:29.199576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:29.199916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] PATH_INFO: `/v3/users/297db1a0215144ffafd52353489931d8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:29.201122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297db1a0215144ffafd52353489931d8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:29.203484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:29.262461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297db1a0215144ffafd52353489931d8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:29.263146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297db1a0215144ffafd52353489931d8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:29.263926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297db1a0215144ffafd52353489931d8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:29.274038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297db1a0215144ffafd52353489931d8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:29.285162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297db1a0215144ffafd52353489931d8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:29.315462 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3932/7873] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:29 2022] DELETE /identity/v3/users/297db1a0215144ffafd52353489931d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:29.317588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:29.318061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:29.318696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:29.340536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:29.341918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:29.407510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3942/7874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:29.417639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:29.419129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:29.474208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:29.502583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6d37-f7b4-4188-bbae-2f4883ffc093 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:29.507291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:29.507958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:29.508284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:29.508566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:29.519841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:29.521394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:29.535309 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3933/7875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:29.885320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:29.886941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:29.927545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260b3e-0541-4315-a23c-313f5f445048 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:29.933605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:29.934311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:29.934598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:29.935132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] PATH_INFO: `/v3/projects/ac060d6a2d3a4bcea08d1791ebf5b4a2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:29.936293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac060d6a2d3a4bcea08d1791ebf5b4a2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:29.938346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:29.998099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:30.010996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac060d6a2d3a4bcea08d1791ebf5b4a2', 'request_id': 'req-8e599e8b-8de4-44a9-be80-29f270f69777'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.019363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac060d6a2d3a4bcea08d1791ebf5b4a2', 'request_id': 'req-8e599e8b-8de4-44a9-be80-29f270f69777'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.031249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac060d6a2d3a4bcea08d1791ebf5b4a2', 'request_id': 'req-8e599e8b-8de4-44a9-be80-29f270f69777'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.052981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] The token cache is being invalidate because project ac060d6a2d3a4bcea08d1791ebf5b4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:30.053457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.054290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.056448 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3943/7876] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:29 2022] DELETE /identity/v3/projects/ac060d6a2d3a4bcea08d1791ebf5b4a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:30.060416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:30.071452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aae51-0dc0-401c-b1fa-6932f7fc22e6 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:30.132068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:30.132749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:30.133046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:30.133322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] PATH_INFO: `/v3/users/dfda7769cf7e4f6f929ceb3f411e0fba` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:30.134778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfda7769cf7e4f6f929ceb3f411e0fba)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:30.136833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:30.231452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfda7769cf7e4f6f929ceb3f411e0fba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.232476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfda7769cf7e4f6f929ceb3f411e0fba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.233340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfda7769cf7e4f6f929ceb3f411e0fba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.244198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfda7769cf7e4f6f929ceb3f411e0fba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.255043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfda7769cf7e4f6f929ceb3f411e0fba'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.283475 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3934/7877] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:30 2022] DELETE /identity/v3/users/dfda7769cf7e4f6f929ceb3f411e0fba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:30.705796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:30.707306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:30.724017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e8b-8de4-44a9-be80-29f270f69777 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:30.788515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:30.789189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:30.789471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:30.789742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] PATH_INFO: `/v3/projects/b2c4ec21592a41ab8ab2cec65e06c640` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:30.791058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c4ec21592a41ab8ab2cec65e06c640)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:30.793141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:30.862496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c4ec21592a41ab8ab2cec65e06c640', 'request_id': 'req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.871595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c4ec21592a41ab8ab2cec65e06c640', 'request_id': 'req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.883803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c4ec21592a41ab8ab2cec65e06c640', 'request_id': 'req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.895947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] The token cache is being invalidate because project b2c4ec21592a41ab8ab2cec65e06c640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:30.896206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.896847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:30.899107 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3944/7878] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:30 2022] DELETE /identity/v3/projects/b2c4ec21592a41ab8ab2cec65e06c640 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:30.903426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:30.904894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:30.919889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98afa2-def3-4f67-a239-d5e23b3e84ae admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:30.975713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:30.983900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:30.985216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:30.985786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:30.986079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] PATH_INFO: `/v3/users/68fbf8014a334cc998b68ef5d0e5eb67` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:30.987913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fbf8014a334cc998b68ef5d0e5eb67)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:30.990261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:31.040792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fbf8014a334cc998b68ef5d0e5eb67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.041509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fbf8014a334cc998b68ef5d0e5eb67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.042143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fbf8014a334cc998b68ef5d0e5eb67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.050631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fbf8014a334cc998b68ef5d0e5eb67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.058376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-96e618df-5c7e-488e-a078-295bb885846d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fbf8014a334cc998b68ef5d0e5eb67'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.077684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3935/7879] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:28:30 2022] DELETE /identity/v3/users/68fbf8014a334cc998b68ef5d0e5eb67 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:31.442150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:31.443586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:31.459241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc62d-4d7a-4c1f-86bb-ba2bf5712add admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:31.519154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:31.527685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:31.528604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.529123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.529461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] PATH_INFO: `/v3/projects/8eba9e72d1a7455fbdd212287a35389f` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.531388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eba9e72d1a7455fbdd212287a35389f)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:31.533528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:31.590330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eba9e72d1a7455fbdd212287a35389f', 'request_id': 'req-43703122-ed41-4082-a3cc-0529d21edaf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.599485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eba9e72d1a7455fbdd212287a35389f', 'request_id': 'req-43703122-ed41-4082-a3cc-0529d21edaf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.625085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eba9e72d1a7455fbdd212287a35389f', 'request_id': 'req-43703122-ed41-4082-a3cc-0529d21edaf7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.641038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] The token cache is being invalidate because project 8eba9e72d1a7455fbdd212287a35389f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:28:31.641596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.642430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-43703122-ed41-4082-a3cc-0529d21edaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:28:31.644227 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3945/7880] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:28:31 2022] DELETE /identity/v3/projects/8eba9e72d1a7455fbdd212287a35389f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:28:31.650652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.651590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.652020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.686188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:31.688188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:31.758286 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3936/7881] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:28:31.767377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af089-3462-4dca-8ae4-657f69647829 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.767928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af089-3462-4dca-8ae4-657f69647829 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.767928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af089-3462-4dca-8ae4-657f69647829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.791594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-918af089-3462-4dca-8ae4-657f69647829 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:31.792811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-918af089-3462-4dca-8ae4-657f69647829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:31.801983 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3946/7882] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:31.806571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:31.818136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e260c4-c00b-44ae-b82a-9673a4d9c7fe None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:31.823179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:31.823881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.824257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.824665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.825475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:28:31.825881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:31.828142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:31.840784 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3937/7883] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:28:31.845909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918af089-3462-4dca-8ae4-657f69647829 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:31.855380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918af089-3462-4dca-8ae4-657f69647829 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:31.860878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:31.863135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.863135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.863135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.871089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:31.873221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:31.920175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3947/7884] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:28:31 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:31.924728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:31.935500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d149b7-32e5-415a-950e-228978be4739 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:31.995335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:32.005010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:32.006012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.007053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.007417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.008349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:32.011405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:32.037199 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3938/7885] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:28:31 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:28:32.038975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:32.050669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8ffe4-8889-45e4-bb31-5674db5213fb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:32.055771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:32.056571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.056840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.057176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.057789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:32.059360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:32.073782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3948/7886] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:32.074967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:32.085609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460fe3-a940-43e5-a2b5-b2c567ea0700 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:32.090832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:32.092411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.092411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.092411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.092678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:32.094230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374aa0-570f-4d42-bc7a-80b74579a50a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:32.104965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3939/7887] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:28:32.109927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:32.119716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33ce7-fdd2-49b2-a154-ad9e6aa75f80 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:32.125256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:32.125910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.126182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.126459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] PATH_INFO: `/v3/projects/3b0dea03ca9d4c5b99c4c26b31b6fb27/users/eb2442f7f47e4bff8e1ab9d3547550fe/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.142837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0dea03ca9d4c5b99c4c26b31b6fb27, user_id=eb2442f7f47e4bff8e1ab9d3547550fe, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:32.145636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:32.160755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3949/7888] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:28:32 2022] PUT /identity/v3/projects/3b0dea03ca9d4c5b99c4c26b31b6fb27/users/eb2442f7f47e4bff8e1ab9d3547550fe/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:28:32.173122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96ad-7e57-4e78-8318-97e31325414c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.173408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96ad-7e57-4e78-8318-97e31325414c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.173687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96ad-7e57-4e78-8318-97e31325414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.204123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-37de96ad-7e57-4e78-8318-97e31325414c None None] MFA Rules not processed for user `eb2442f7f47e4bff8e1ab9d3547550fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:32.205675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-37de96ad-7e57-4e78-8318-97e31325414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:32.274301 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3940/7889] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:32.286760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:32.288563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:32.367151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e684-b001-475a-bb6a-3bfb2c57579e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:32.371299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:32.371915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:32.372189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:32.372588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:32.386285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:32.389079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:32.423645 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3950/7890] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:33.944379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:33.946253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:33.946253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:33.967074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] MFA Rules not processed for user `eb2442f7f47e4bff8e1ab9d3547550fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:33.968269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:33.983002 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3941/7891] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:42.405001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:43.960951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:54.298100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:54.299595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:54.391165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ff15-f012-490d-971c-ca5163048c4a service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:54.396370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:54.397026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:54.397308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:54.397577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:54.399358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:54.414421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:54.416037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f81a1-e1a1-45a1-87ff-b028a0bce1da service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:54.440245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3951/7892] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:04.422337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=37 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:07.104275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:07.105992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:07.293381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bcf7-4fe2-40a2-9c3f-6468c942c328 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:07.314366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:07.316191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:07.319153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:07.320151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] PATH_INFO: `/v3/users/9ada2d444d9444769736896f92af01d0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:07.324749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ada2d444d9444769736896f92af01d0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:07.330456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:07.414001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ada2d444d9444769736896f92af01d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:07.415155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ada2d444d9444769736896f92af01d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:07.415905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ada2d444d9444769736896f92af01d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:07.426088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ada2d444d9444769736896f92af01d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:07.435021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ada2d444d9444769736896f92af01d0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:07.455308 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3942/7893] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:29:07 2022] DELETE /identity/v3/users/9ada2d444d9444769736896f92af01d0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:07.460018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:07.460502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:07.460596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:07.490516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:07.491851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:07.581819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3952/7894] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:29:07.591827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:07.600042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:07.701215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:07.707961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94373-c9a3-451e-a6e6-fc71cc296742 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:07.720007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:07.721113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:07.721775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:07.722417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:07.734020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:07.737814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc06ec-7739-4964-a3f6-996d42911918 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:07.750191 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3943/7895] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:08.162060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.165977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:08.188719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e8be4-20e4-40aa-8f49-408f90232771 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.201346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.202039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.202319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.202593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] PATH_INFO: `/v3/projects/e26f288a72124147a70a71d5c17b9f86` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.203759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26f288a72124147a70a71d5c17b9f86)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.205793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.298278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26f288a72124147a70a71d5c17b9f86', 'request_id': 'req-9784bf67-1d83-42a6-add6-9ffb13480a42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:08.303838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26f288a72124147a70a71d5c17b9f86', 'request_id': 'req-9784bf67-1d83-42a6-add6-9ffb13480a42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:08.318414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26f288a72124147a70a71d5c17b9f86', 'request_id': 'req-9784bf67-1d83-42a6-add6-9ffb13480a42'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:08.356024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] The token cache is being invalidate because project e26f288a72124147a70a71d5c17b9f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:29:08.356457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:08.357163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9784bf67-1d83-42a6-add6-9ffb13480a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:29:08.360951 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3953/7896] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:29:08 2022] DELETE /identity/v3/projects/e26f288a72124147a70a71d5c17b9f86 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:08.367861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.368382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.368382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.414495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:08.415786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:08.493506 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3944/7897] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:29:08.501210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.501708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.501823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.522050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:08.523258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:08.531880 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3954/7898] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:08.536156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.546768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4e27-e72c-453b-9d9b-d66896e97e13 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.551594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.552227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.552520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.552776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.553470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:29:08.553774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.555432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.567504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3945/7899] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:29:08.571783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.581096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daf98a-0216-4648-b281-66d2d4e0a1d9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.586116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.586754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.587034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.587305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.587948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.589893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.618956 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3955/7900] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:08.623189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.633409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ed6b-994e-4dda-8815-feb74f825deb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.704227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.704843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.705166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.705437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.706063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.708084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.732127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3946/7901] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:08.734082 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.745300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec63e-7503-425d-a4dc-cea878308fa8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.750091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.750693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.751003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.751275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.751906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.753545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.763471 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3956/7902] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:29:08.768117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.779175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4fa40-7693-4fc8-806b-541d8a5011d5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.784430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.785171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.785540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.785876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.786572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.788295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094267ca-c749-4193-b0bf-8da325bd6238 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.799707 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3947/7903] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:29:08.803815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.813750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413473f-193f-4583-9b15-8bb2e44901c9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:08.818561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:08.819199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.819474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.819741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] PATH_INFO: `/v3/projects/2807e06b2fea49d0b35bd4f227bb8b79/users/f777312225d24ba7b8c686e49d0cd4f7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.834901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2807e06b2fea49d0b35bd4f227bb8b79, user_id=f777312225d24ba7b8c686e49d0cd4f7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:08.837579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:08.851827 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3957/7904] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:29:08 2022] PUT /identity/v3/projects/2807e06b2fea49d0b35bd4f227bb8b79/users/f777312225d24ba7b8c686e49d0cd4f7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:08.862120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:08.862402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:08.862672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:08.892004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] MFA Rules not processed for user `f777312225d24ba7b8c686e49d0cd4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:08.893224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:08.923253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:08.960523 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3948/7905] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:08.965005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:08.979121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:09.041818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60912-dbeb-4417-9b3b-0a856a3554d5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.047127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.047779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.048059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.048329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.049010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.051138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.085789 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3958/7906] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:29:08 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:09.090090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.102402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1695-733b-4a83-9466-bac9ca3c9c15 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.165086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.165705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.165985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.166255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.166884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.168811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.191644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3949/7907] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:29:09 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:09.195449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.207289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106047-eb18-431f-bd36-d9dbc1ed595d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.212189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.212830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.213153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.213425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.214076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.215746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.235863 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3959/7908] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:29:09.237214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.250585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a166d8-1b8a-493e-bbfe-e333356c294c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.256195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.256809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.257142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.257415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.258090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.259682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f96d-de3a-4224-8f8b-d7582e38f3bf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.270771 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3950/7909] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:29:09.274630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.285287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ec93-013c-41c5-a991-f4b34b96f086 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.290269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.291500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.291500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.291500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] PATH_INFO: `/v3/projects/701d87ec98f44f798caf2d4b62d0bb8e/users/81b01ee51ef74ae2a111ec2018b2d556/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.308419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701d87ec98f44f798caf2d4b62d0bb8e, user_id=81b01ee51ef74ae2a111ec2018b2d556, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.314017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.329869 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3960/7910] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:29:09 2022] PUT /identity/v3/projects/701d87ec98f44f798caf2d4b62d0bb8e/users/81b01ee51ef74ae2a111ec2018b2d556/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:09.342077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.343265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.343547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.374272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] MFA Rules not processed for user `81b01ee51ef74ae2a111ec2018b2d556`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:09.375501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:09.449664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3951/7911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:09.455246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.522468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79801cb-711c-4d2a-bc6d-58f281f7a387 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.527228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.527840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.528120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.528389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.529044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.531505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.558306 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3961/7912] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:29:09 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:09.562321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.573607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18406d-2865-472d-b900-2ba79c1e9fa7 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.614359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:09.633515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.634348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.634628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.634898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.635528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.637498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.663742 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3952/7913] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:29:09 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:29:09.664999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.675593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1558-41d1-40ae-aa7b-afc18135611e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.680300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.680927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.681863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.682140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.682781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.684383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.695462 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3962/7914] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:29:09.699823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.710641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e33a9f-a871-4ce2-a0cb-12cd08f49eb3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.715497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.716152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.716432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.716703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] PATH_INFO: `/v3/projects/59a80936c67746c6acf18dc438646d3b/users/7fa568e33f604e76991d40163e070c89/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.732718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a80936c67746c6acf18dc438646d3b, user_id=7fa568e33f604e76991d40163e070c89, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.735516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.749463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3953/7915] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:29:09 2022] PUT /identity/v3/projects/59a80936c67746c6acf18dc438646d3b/users/7fa568e33f604e76991d40163e070c89/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:09.753463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.763789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35e07-8e55-4532-979c-adb29513f853 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.800212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:09.824299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.824827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.825134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.825401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.826028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.828141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e4c5-4bdc-4bd8-887a-bb778800a4f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.841140 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3963/7916] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:29:09.842363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:09.853495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f213b5-6b0b-479a-bd15-bc96a7af94d7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:09.858304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:09.858959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.859237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.859509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] PATH_INFO: `/v3/projects/59a80936c67746c6acf18dc438646d3b/users/7fa568e33f604e76991d40163e070c89/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.861514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a80936c67746c6acf18dc438646d3b, user_id=7fa568e33f604e76991d40163e070c89, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:09.864262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:09.875529 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3954/7917] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:29:09 2022] PUT /identity/v3/projects/59a80936c67746c6acf18dc438646d3b/users/7fa568e33f604e76991d40163e070c89/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:29:09.886090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:09.886411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:09.886651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:09.914964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] MFA Rules not processed for user `7fa568e33f604e76991d40163e070c89`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:09.916205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:09.987444 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3964/7918] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:10.002332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:10.004211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:10.086651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa8bc-6eb9-4cb8-b597-cce06d0da6a7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:10.092738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:10.093410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:10.093721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:10.093996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:10.152223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:10.153847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc393-b1ea-4a37-8f58-a5f880561379 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:10.163111 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3955/7919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:12.125902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:12.127375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:12.197207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e01a5-026e-49b3-a778-621b5f7dc428 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:12.201642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:12.202330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:12.202696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:12.202974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:12.213741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:12.215552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:12.228933 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3965/7920] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:16.045515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:16.046010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:16.046291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:16.067299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] MFA Rules not processed for user `f777312225d24ba7b8c686e49d0cd4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:16.068182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:16.077963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3956/7921] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:16.461227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:16.478302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b3f6-44e0-4f01-b358-82b17e31c870 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:16.483610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:16.484489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:16.484940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:16.485295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:16.495765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:16.513038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:16.514466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:16.528565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3966/7922] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:16.530223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:16.531666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:16.562639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:16.640226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6ea5-a6e8-451b-9c9a-e729426203a8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:16.646427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:16.647131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:16.647414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:16.647690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:16.649493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:16.716858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:16.719314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:16.728650 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3957/7923] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:29:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:29:26.520132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=78 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:26.731834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=53 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:36.130360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:36.132497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:36.207372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc376-c7e2-4fd5-892f-9321bab58ad1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:36.212655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:36.213222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:36.213500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:36.213774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:36.215551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:36.231203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:36.233382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c07ee2-5084-4726-b71a-e3ca42e50112 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:36.246459 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3967/7924] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:46.239288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=32 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:06.821331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:06.823615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:06.923546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c901-cfde-4d5b-9b6e-0183388ddb4e service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:06.929573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:06.930197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:06.930372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:06.930777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] PATH_INFO: `/v3/users/608b9dc1a00d489a94524f99820022f6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:06.931926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=608b9dc1a00d489a94524f99820022f6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:06.934512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.006513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608b9dc1a00d489a94524f99820022f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.007256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608b9dc1a00d489a94524f99820022f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.007923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608b9dc1a00d489a94524f99820022f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.018288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608b9dc1a00d489a94524f99820022f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.026765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608b9dc1a00d489a94524f99820022f6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.046376 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3958/7925] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:06 2022] DELETE /identity/v3/users/608b9dc1a00d489a94524f99820022f6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:07.050925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.051457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.051457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.073163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:07.074607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.146201 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3968/7926] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:07.156783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.158298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.230467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b71f-a644-4151-88d6-375818f9b22d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:07.238703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:07.239342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.239619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.239883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.251470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:07.252857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.264963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3959/7927] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:07.471288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.473120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.487457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe47fd-5c50-45ce-af7f-586f75e65696 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:07.492313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:07.492977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.493435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.493715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] PATH_INFO: `/v3/projects/43f3d1244dc147c398fc24ddcfc6da34` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.506208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f3d1244dc147c398fc24ddcfc6da34)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:07.508646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.559126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f3d1244dc147c398fc24ddcfc6da34', 'request_id': 'req-1321caec-2892-42a8-9364-e8a26b884055'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.565430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f3d1244dc147c398fc24ddcfc6da34', 'request_id': 'req-1321caec-2892-42a8-9364-e8a26b884055'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.573867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f3d1244dc147c398fc24ddcfc6da34', 'request_id': 'req-1321caec-2892-42a8-9364-e8a26b884055'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.589697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] The token cache is being invalidate because project 43f3d1244dc147c398fc24ddcfc6da34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:07.589989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.591309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.593805 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3969/7928] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:07 2022] DELETE /identity/v3/projects/43f3d1244dc147c398fc24ddcfc6da34 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:07.598310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.610853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c9fe0-2fa2-4b9d-985f-9f317ef87a77 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:07.631755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:07.675986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:07.676615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.676889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.677184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] PATH_INFO: `/v3/users/9af7e368832b4ccfa10ac8539b8723ef` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.678468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af7e368832b4ccfa10ac8539b8723ef)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:07.680411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.730227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af7e368832b4ccfa10ac8539b8723ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.730985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af7e368832b4ccfa10ac8539b8723ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.731676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af7e368832b4ccfa10ac8539b8723ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.739662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af7e368832b4ccfa10ac8539b8723ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.747419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a2104436-349a-49a2-b138-11c31fe7f132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af7e368832b4ccfa10ac8539b8723ef'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.767536 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3960/7929] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:07 2022] DELETE /identity/v3/users/9af7e368832b4ccfa10ac8539b8723ef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:07.954621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.956157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.971894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321caec-2892-42a8-9364-e8a26b884055 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.046668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.047304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.047583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.047856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] PATH_INFO: `/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.049088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66ba8a4e3c8436aae7b71a9d9266255)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.051112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.072481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:08.104620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66ba8a4e3c8436aae7b71a9d9266255', 'request_id': 'req-d79755be-0ab2-444e-ac08-f3d32180afee'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:08.111163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66ba8a4e3c8436aae7b71a9d9266255', 'request_id': 'req-d79755be-0ab2-444e-ac08-f3d32180afee'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:08.118844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66ba8a4e3c8436aae7b71a9d9266255', 'request_id': 'req-d79755be-0ab2-444e-ac08-f3d32180afee'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:08.131770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] The token cache is being invalidate because project b66ba8a4e3c8436aae7b71a9d9266255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:08.132058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:08.132736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d79755be-0ab2-444e-ac08-f3d32180afee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:08.134285 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3970/7930] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:07 2022] DELETE /identity/v3/projects/b66ba8a4e3c8436aae7b71a9d9266255 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:08.139578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.140063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.140161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.160768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.161993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.225253 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3961/7931] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:30:08.234565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.234841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.235105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.255647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.256851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.264884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3971/7932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:08.269186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.279287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbc32-07af-49cb-b3d1-395139079916 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.284178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.284857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.285159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.285429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.286068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:30:08.286369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.287951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.304472 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3962/7933] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:30:08.305272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.315283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d113c2-6d76-427c-9a74-c7cfb6210cc1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.320542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.321157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.321435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.321697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.322318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.324215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.353688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3972/7934] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:30:08.358221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.368525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe32c-c9a6-49b2-af86-e3c0dd04b440 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.398191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:08.432057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.432667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.432973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.433285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.433916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.435850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.460614 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3963/7935] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:30:08.462085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.473354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602fd2c-de6a-4600-8599-aa68a327a4ad admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.478042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.478583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.478855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.479123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.479793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.481565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.492963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3973/7936] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:08.496592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.507118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984f74-55b3-4188-945e-9745ff1447cf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.514208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.514829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.515151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.515385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.516032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.517683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc760b-669c-439f-aa9d-9230a0fbe1bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.530070 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3964/7937] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:08.534325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.545591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5b102-523f-4005-b25f-148d08a7e542 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.551063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.551857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.552214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.552592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] PATH_INFO: `/v3/projects/7b98d113d6914d01a909378c1c96e3fa/users/8b2ad8fbe36e43358ba644627ebb1d8b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.568035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b98d113d6914d01a909378c1c96e3fa, user_id=8b2ad8fbe36e43358ba644627ebb1d8b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.570733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.589508 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3974/7938] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:08 2022] PUT /identity/v3/projects/7b98d113d6914d01a909378c1c96e3fa/users/8b2ad8fbe36e43358ba644627ebb1d8b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:08.601146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9bbd6-d674-4853-8c16-4d368bf8608e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.601443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9bbd6-d674-4853-8c16-4d368bf8608e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.601705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9bbd6-d674-4853-8c16-4d368bf8608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.623903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-31d9bbd6-d674-4853-8c16-4d368bf8608e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.625166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-31d9bbd6-d674-4853-8c16-4d368bf8608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.698274 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3965/7939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:08.710065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.711778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.776929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62de96-9948-47c6-ab8a-423ccf10f70d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.781951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.782569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.782846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.783116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.792946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.794419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.804313 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3975/7940] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:13.414426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.414957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.414957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.452704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:13.452704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:13.601303 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3966/7941] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:13.605850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:13.618784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e719cc-baad-4e74-b174-a2755ed76a24 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:13.624302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:13.624956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.625396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.625680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.626299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:13.628423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:13.662487 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3976/7942] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:30:13 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:30:13.666398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:13.682941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235a92-9053-4cba-998c-70e1b8450faa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:13.726599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:13.754736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:13.756179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.756562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.756969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.757772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:13.759541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:13.786867 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3967/7943] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:30:13 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:30:13.790951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:13.804111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698be0-7669-44d3-abf8-6c11391f318f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:13.809479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:13.810217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.810582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.810925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.811649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:13.813471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:13.829748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3977/7944] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:13.831493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:13.844236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a5bc6-7c5a-45b6-a0c5-09bea208f97d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:13.853947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:13.854665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.854946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.855220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] PATH_INFO: `/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb/users/79447fae5bdd4c368087107d3bf0fef1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.876950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90bea95b7524d9e928d690f7a8f7dbb, user_id=79447fae5bdd4c368087107d3bf0fef1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:13.879964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:13.899315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3968/7945] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:13 2022] PUT /identity/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb/users/79447fae5bdd4c368087107d3bf0fef1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:13.900310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:13.911708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb622670-38eb-486a-82fb-87a8947a4d50 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:13.920762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:13.985578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:13.986143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:13.986425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:13.986704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:13.987539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:13.989251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e3161-b9d8-40b1-bcfd-593717ebe059 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.001285 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3978/7946] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:30:14.005321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.016224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d500-9571-4608-9d86-6cb63ba9937f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.021565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.022856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.024947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.024947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] PATH_INFO: `/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb/users/79447fae5bdd4c368087107d3bf0fef1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.025620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90bea95b7524d9e928d690f7a8f7dbb, user_id=79447fae5bdd4c368087107d3bf0fef1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.028365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.045245 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3969/7947] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:14 2022] PUT /identity/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb/users/79447fae5bdd4c368087107d3bf0fef1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:19.331867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:19.332820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:19.333241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:19.392419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] MFA Rules not processed for user `79447fae5bdd4c368087107d3bf0fef1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:19.394154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:19.522818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3979/7948] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:19.535218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:19.537094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:19.656158 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9b50-e377-4db9-9bed-27a256287ab5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:19.661599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:19.662125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:19.662404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:19.662719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:19.673109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:19.674559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205bafb-2ca6-416a-a642-a0a573d6d69f service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:19.686935 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3970/7949] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:19.787045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:19.800788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfd61-8b49-4ea7-b644-07dac43eee46 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:19.813657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:19.820823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:19.822252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:19.822737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:19.960956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:19.962430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:19.972478 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3980/7950] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:21.538066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:21.538564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:21.538680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:21.561411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:21.562738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:21.570884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3971/7951] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:21.956152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:21.966567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:22.017253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:22.050341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1140d7-7ffb-49d6-b4d3-cb77ba491cbc service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:22.054822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:22.055148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:22.055427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:22.055698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:22.057521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:22.072161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:22.073710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:22.086341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3981/7952] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:22.625360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:22.640842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97b0c8-bc61-47d1-8f1c-5db43d1f5cb5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:22.645946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:22.646913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:22.647261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:22.647624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:22.649556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:22.749356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:22.788391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:22.791070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:22.820789 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3972/7953] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:23.912499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:23.914733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:23.965242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9b0e-30a0-4860-926a-12fcc92f4b60 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:23.989515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:23.992678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:23.995897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:23.996313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:24.002695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:24.117745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:24.119701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:24.146600 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3982/7954] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:30.493876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:30.510992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648ee3-d979-483e-bf44-2b4fe47c45ff service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:30.517039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:30.517857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:30.519930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:30.520490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:30.522530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:30.595737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:30.597312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:30.608195 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3973/7955] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:33.251101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:33.265840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2824-51e6-47ac-b994-7de007dd4221 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:33.271718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:33.272376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:33.272661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:33.272960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:33.274905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:33.296805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:33.298409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:33.312803 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3983/7956] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:38.142250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:38.144179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:38.166506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fed27-8b9b-48d6-beed-86852c263ac1 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:38.172206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:38.173041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:38.173454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:38.173796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] PATH_INFO: `/v3/users/ea05b9cbccbe4fa298503a412b287e1b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:38.175117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea05b9cbccbe4fa298503a412b287e1b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:38.177210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:38.225229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea05b9cbccbe4fa298503a412b287e1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.225991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea05b9cbccbe4fa298503a412b287e1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.226601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea05b9cbccbe4fa298503a412b287e1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.233999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea05b9cbccbe4fa298503a412b287e1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.241074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea05b9cbccbe4fa298503a412b287e1b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.259441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3974/7957] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:38 2022] DELETE /identity/v3/users/ea05b9cbccbe4fa298503a412b287e1b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:38.463802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:38.483159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ea0a-efc0-466a-94b6-8617e35b4fe7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:38.556837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:38.557525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:38.557802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:38.558216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] PATH_INFO: `/v3/projects/c2e7594ffba04a4bb687919ae7227733` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:38.561885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e7594ffba04a4bb687919ae7227733)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:38.569242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:38.617865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e7594ffba04a4bb687919ae7227733', 'request_id': 'req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.624225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e7594ffba04a4bb687919ae7227733', 'request_id': 'req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.626874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:38.633797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e7594ffba04a4bb687919ae7227733', 'request_id': 'req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.647053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] The token cache is being invalidate because project c2e7594ffba04a4bb687919ae7227733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:38.647424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.648131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.649974 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3984/7958] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:38 2022] DELETE /identity/v3/projects/c2e7594ffba04a4bb687919ae7227733 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:38.654616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:38.656109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:38.671102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0078e4-61b2-417c-8a8a-853a097733f7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:38.722437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:38.741518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:38.742389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:38.742815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:38.743242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] PATH_INFO: `/v3/users/bd7f6a57e50a43a7a397eaf20085734a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:38.744702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7f6a57e50a43a7a397eaf20085734a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:38.748943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:38.805525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7f6a57e50a43a7a397eaf20085734a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.806635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7f6a57e50a43a7a397eaf20085734a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.807627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7f6a57e50a43a7a397eaf20085734a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.823818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7f6a57e50a43a7a397eaf20085734a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.836031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9f33e09f-a894-4421-8943-7eb82bdde602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7f6a57e50a43a7a397eaf20085734a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:38.858470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3975/7959] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:38 2022] DELETE /identity/v3/users/bd7f6a57e50a43a7a397eaf20085734a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:30:39.058443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:39.060174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:39.079681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529fe0-26e2-4fb9-addc-e4c71d39c9ed admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:39.147853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:39.148480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:39.148752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:39.149189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] PATH_INFO: `/v3/projects/9150fac4c5314ca9835ef91edddc8516` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:39.151211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9150fac4c5314ca9835ef91edddc8516)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:39.153140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:39.206168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9150fac4c5314ca9835ef91edddc8516', 'request_id': 'req-ccd845d5-1485-47ae-b4e3-c05c239c162e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:39.213180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9150fac4c5314ca9835ef91edddc8516', 'request_id': 'req-ccd845d5-1485-47ae-b4e3-c05c239c162e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:39.221464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9150fac4c5314ca9835ef91edddc8516', 'request_id': 'req-ccd845d5-1485-47ae-b4e3-c05c239c162e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:39.232640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] The token cache is being invalidate because project 9150fac4c5314ca9835ef91edddc8516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:39.232952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:39.233595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ccd845d5-1485-47ae-b4e3-c05c239c162e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:39.235076 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3985/7960] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:39 2022] DELETE /identity/v3/projects/9150fac4c5314ca9835ef91edddc8516 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:48.853479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:49.230118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=8,keystone:SELECT=55,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:56.489997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618fb7-6163-4393-a6e1-16afb3dd90f0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:56.491051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618fb7-6163-4393-a6e1-16afb3dd90f0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:56.491051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618fb7-6163-4393-a6e1-16afb3dd90f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:56.542208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-93618fb7-6163-4393-a6e1-16afb3dd90f0 None None] MFA Rules not processed for user `c3a28b4dcd9f4cdfb724f5b29ce26b16`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:56.543492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-93618fb7-6163-4393-a6e1-16afb3dd90f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:56.664978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3976/7961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:56.738586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:56.739113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:56.739113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:56.776708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] MFA Rules not processed for user `f777312225d24ba7b8c686e49d0cd4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:56.777985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:56.922245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3986/7962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:57.343281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:57.343552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:57.343831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:57.372600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:57.373864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:57.630745 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3977/7963] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:31:03.672278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:03.675800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:03.812233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2d962-2349-4251-9a7d-ade8649d33a8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:03.822704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:03.824465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:03.825008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:03.826063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:03.828840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:03.854402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:03.857448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:03.870626 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3987/7964] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:07.609463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=50 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:13.865543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=59 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:23.735399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:23.736955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:23.801448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c355f5-7034-48a2-a655-d67fc8b29019 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:23.805116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:23.805786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:23.806126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:23.806476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:23.808280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:23.822300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:23.823839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7635c-50fc-43cb-983b-2735e1ea9c3b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:23.836112 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3978/7965] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:30.219644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:30.221812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:30.307803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f072-28fd-4d1a-b482-c512f713dd1e service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:30.313018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:30.313681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:30.314150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:30.314424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] PATH_INFO: `/v3/users/f777312225d24ba7b8c686e49d0cd4f7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:30.315610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f777312225d24ba7b8c686e49d0cd4f7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:30.317597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:30.369124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f777312225d24ba7b8c686e49d0cd4f7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.369783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f777312225d24ba7b8c686e49d0cd4f7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.377464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f777312225d24ba7b8c686e49d0cd4f7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.384738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f777312225d24ba7b8c686e49d0cd4f7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.385435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f777312225d24ba7b8c686e49d0cd4f7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.402434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3988/7966] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:31:30 2022] DELETE /identity/v3/users/f777312225d24ba7b8c686e49d0cd4f7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:31:30.407546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:30.408008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:30.408106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:30.430088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:31:30.431419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:30.491919 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3979/7967] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:31:30.502417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:30.503946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:30.567125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf550ed6-7432-4e04-b1a9-a3767283841b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:30.571203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:30.572040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:30.572317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:30.572580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:30.592267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:30.594017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:30.608142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3989/7968] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:30.814804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:30.816293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:30.837440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892880-c0e1-4a77-bf6b-dd134ccba9f1 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:30.843257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:30.845098 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:30.845888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:30.846364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] PATH_INFO: `/v3/projects/2807e06b2fea49d0b35bd4f227bb8b79` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:30.847760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2807e06b2fea49d0b35bd4f227bb8b79)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:30.849788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:30.904552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2807e06b2fea49d0b35bd4f227bb8b79', 'request_id': 'req-7d57c223-3411-49d1-989d-af2983067355'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.910302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2807e06b2fea49d0b35bd4f227bb8b79', 'request_id': 'req-7d57c223-3411-49d1-989d-af2983067355'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.918484 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2807e06b2fea49d0b35bd4f227bb8b79', 'request_id': 'req-7d57c223-3411-49d1-989d-af2983067355'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.931059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] The token cache is being invalidate because project 2807e06b2fea49d0b35bd4f227bb8b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:31:30.931348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.932092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:30.933923 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3980/7969] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:31:30 2022] DELETE /identity/v3/projects/2807e06b2fea49d0b35bd4f227bb8b79 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:31:30.938592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:30.949692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065a6f0-1630-4827-9424-96aefc1381dd service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:30.970997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:31.026413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:31.027247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:31.029114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:31.029495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] PATH_INFO: `/v3/users/81b01ee51ef74ae2a111ec2018b2d556` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:31.030776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b01ee51ef74ae2a111ec2018b2d556)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:31.032790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:31.107947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b01ee51ef74ae2a111ec2018b2d556'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.108569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b01ee51ef74ae2a111ec2018b2d556'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.119645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b01ee51ef74ae2a111ec2018b2d556'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.129366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b01ee51ef74ae2a111ec2018b2d556'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.130188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b01ee51ef74ae2a111ec2018b2d556'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.150796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3990/7970] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:31:30 2022] DELETE /identity/v3/users/81b01ee51ef74ae2a111ec2018b2d556 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:31:31.471683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:31.474145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:31.492776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c223-3411-49d1-989d-af2983067355 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:31.537021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:31.566173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:31.566173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:31.566173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:31.566173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] PATH_INFO: `/v3/projects/701d87ec98f44f798caf2d4b62d0bb8e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:31.567683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701d87ec98f44f798caf2d4b62d0bb8e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:31.569991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:31.624705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701d87ec98f44f798caf2d4b62d0bb8e', 'request_id': 'req-af1f2349-2276-4856-bdef-3f714271cf81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.630982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701d87ec98f44f798caf2d4b62d0bb8e', 'request_id': 'req-af1f2349-2276-4856-bdef-3f714271cf81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.640146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701d87ec98f44f798caf2d4b62d0bb8e', 'request_id': 'req-af1f2349-2276-4856-bdef-3f714271cf81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.652859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] The token cache is being invalidate because project 701d87ec98f44f798caf2d4b62d0bb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:31:31.653709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.654534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.656974 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3981/7971] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:31:31 2022] DELETE /identity/v3/projects/701d87ec98f44f798caf2d4b62d0bb8e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:31:31.660195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:31.661659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:31.676831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b34562-f4e2-41d9-8d87-1ec2842878c3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:31.753368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:31.754235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:31.754580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:31.754917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] PATH_INFO: `/v3/users/7fa568e33f604e76991d40163e070c89` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:31.756786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa568e33f604e76991d40163e070c89)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:31.758946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:31.821284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:31.824940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa568e33f604e76991d40163e070c89'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.826312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa568e33f604e76991d40163e070c89'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.838354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa568e33f604e76991d40163e070c89'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.847254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa568e33f604e76991d40163e070c89'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.847992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa568e33f604e76991d40163e070c89'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:31.867558 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3991/7972] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:31:31 2022] DELETE /identity/v3/users/7fa568e33f604e76991d40163e070c89 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:31:32.062762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:32.064814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:32.097123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2349-2276-4856-bdef-3f714271cf81 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:32.181613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:32.182527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:32.182998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:32.183777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] PATH_INFO: `/v3/projects/59a80936c67746c6acf18dc438646d3b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:32.185298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a80936c67746c6acf18dc438646d3b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:32.188526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:32.253063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a80936c67746c6acf18dc438646d3b', 'request_id': 'req-08ebd8e5-e416-419a-a063-a18c649051f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:32.259248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a80936c67746c6acf18dc438646d3b', 'request_id': 'req-08ebd8e5-e416-419a-a063-a18c649051f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:32.261081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:32.269383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a80936c67746c6acf18dc438646d3b', 'request_id': 'req-08ebd8e5-e416-419a-a063-a18c649051f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:32.284498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] The token cache is being invalidate because project 59a80936c67746c6acf18dc438646d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:31:32.284801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:32.285463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08ebd8e5-e416-419a-a063-a18c649051f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:31:32.287187 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3982/7973] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:31:32 2022] DELETE /identity/v3/projects/59a80936c67746c6acf18dc438646d3b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:31:41.863858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:42.281633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:42.799635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:42.801149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:42.871053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fc4bb-a249-4603-986e-6d7093e31b2d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:42.924863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:42.925517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:42.925796 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:42.926067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:42.928166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:42.941271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:42.942697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:42.956844 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3992/7974] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:52.947955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=46 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:53.326579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:53.327543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:53.327816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:53.349552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:31:53.351004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:53.413913 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3983/7975] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:31:57.155022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:57.157864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:57.277411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2755be-bf18-4377-b3ed-c0a472d7dee5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:57.284363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:57.285308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:57.285308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:57.285588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:57.288369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:57.304964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:57.306743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:57.334510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3993/7976] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:32:03.406489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=25 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:07.315024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=34 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:29.853800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:29.857245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:29.878414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f30e8-1213-493d-83bc-2badf78c693a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:29.884075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:29.884682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:29.884988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:29.885255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:29.887023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:29.902983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:29.904568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:29.919504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3984/7977] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:32:39.913026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:49.398215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:49.400171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:49.423166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628205e5-02fe-400d-bd02-be20e6e7507f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:49.427067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:49.427876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:49.428313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:49.428739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:49.430700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:49.553556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:49.567603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:49.618638 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3994/7978] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:32:53.915399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:53.918159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:53.986272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:53.988662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:54.009162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ae30-bf9d-46f4-9238-b55b6b955f85 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.016648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.017570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.018063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.018530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] PATH_INFO: `/v3/users/c3a28b4dcd9f4cdfb724f5b29ce26b16` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.019961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a28b4dcd9f4cdfb724f5b29ce26b16)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.022487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.028408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a376d7-2f1d-4376-89bf-06c43e408241 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.035937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.036847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.037204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.037486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.039676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:54.068987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.068987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.082909 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3985/7979] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:32:54.094857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a28b4dcd9f4cdfb724f5b29ce26b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.095557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a28b4dcd9f4cdfb724f5b29ce26b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.105940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a28b4dcd9f4cdfb724f5b29ce26b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.120373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a28b4dcd9f4cdfb724f5b29ce26b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.121153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-834b4126-03e1-4d8d-a0cd-044ec591369d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a28b4dcd9f4cdfb724f5b29ce26b16'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.144451 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3995/7980] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:32:53 2022] DELETE /identity/v3/users/c3a28b4dcd9f4cdfb724f5b29ce26b16 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:54.335421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.348379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e267ef-0a3d-4330-b555-55011864ccbe service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.438922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.439674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.439954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.440227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] PATH_INFO: `/v3/projects/d1abb2b7300b44b4af7b177c76b74216` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.441419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1abb2b7300b44b4af7b177c76b74216)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.443338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.499850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1abb2b7300b44b4af7b177c76b74216', 'request_id': 'req-59a29f4d-c3cf-4b12-badd-471504fe2fff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.506240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1abb2b7300b44b4af7b177c76b74216', 'request_id': 'req-59a29f4d-c3cf-4b12-badd-471504fe2fff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.515403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1abb2b7300b44b4af7b177c76b74216', 'request_id': 'req-59a29f4d-c3cf-4b12-badd-471504fe2fff'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.530442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] The token cache is being invalidate because project d1abb2b7300b44b4af7b177c76b74216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:32:54.530733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.531396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59a29f4d-c3cf-4b12-badd-471504fe2fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:54.533054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3986/7981] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:32:54 2022] DELETE /identity/v3/projects/d1abb2b7300b44b4af7b177c76b74216 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:32:54.537886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.538361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.538645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.565178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:32:54.566416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:54.649439 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3996/7982] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:32:54.657351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.657885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.658328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.683870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:32:54.685421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:54.707643 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3987/7983] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:32:54.711918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.722808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14d391-934a-4407-bff0-c3e554dd4e42 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.734268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.734902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.735183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.735458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.736121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:32:54.736421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.738464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.740584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:54.757011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3997/7984] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:54.761324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.771168 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b87ea-8ba7-467b-a2f6-92932f53ad68 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.776130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.776727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.777473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.777755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.778379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.780296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.796175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:54.828176 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3988/7985] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:32:54 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:54.832425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.844003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb2b3-132b-4668-83de-c0805427ddd9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.926944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.927594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.927875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.928173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.928769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.930866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.959576 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3998/7986] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:32:54 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:54.963974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.975857 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371c03-2020-4b7d-b757-332702ab0602 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.981812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.982580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.982923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.983263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.984002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.985714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.996469 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3989/7987] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:32:55.000793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.015919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f86d7-6544-4519-b4bb-bf6dd6017af1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.020734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.021412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.021681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.021952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.022587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.024182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0d3a7-b81a-453c-b7fe-b22e6fb86fe9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.041393 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 3999/7988] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:32:55.043153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.054549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788264d-1ab2-4266-b414-757188da726c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.060617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.061642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.062007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.062356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] PATH_INFO: `/v3/projects/7ab2ae3a2cba4001aef760abe91999f4/users/7886b37bc66d4f01a389dc439e9ca988/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.083327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab2ae3a2cba4001aef760abe91999f4, user_id=7886b37bc66d4f01a389dc439e9ca988, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.086185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.105004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3990/7989] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:32:55 2022] PUT /identity/v3/projects/7ab2ae3a2cba4001aef760abe91999f4/users/7886b37bc66d4f01a389dc439e9ca988/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:55.114808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.115307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.115745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.153613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] MFA Rules not processed for user `7886b37bc66d4f01a389dc439e9ca988`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:32:55.154890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:55.238326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4000/7990] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:32:55.242577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.317813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306e5f-301d-47d0-9037-970590eabc4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.323210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.324170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.324628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.324935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.325584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.327616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.362095 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3991/7991] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:32:55 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:32:55.363328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.376327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635522b5-f3b3-4032-9f6e-9dad0c55f35a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.446846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.447530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.447803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.448190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.448975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.451245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.461850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:55.477376 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4001/7992] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:32:55 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:55.481719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.493787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b95c-8dd4-4919-8f99-4497161aa3e1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.500115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.500675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.500982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.501258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.501907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.503510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.519592 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3992/7993] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:32:55.523820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.535724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683d9b-6e8d-42b1-9239-ad4cf44ede7d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.543803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.543803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.543803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.543803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] PATH_INFO: `/v3/projects/c0af7a91cd03482cadadf6dd9b386702/users/0b1c31547a41486dbd012cdea5c6fb12/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.560256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0af7a91cd03482cadadf6dd9b386702, user_id=0b1c31547a41486dbd012cdea5c6fb12, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.562980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.579057 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4002/7994] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:32:55 2022] PUT /identity/v3/projects/c0af7a91cd03482cadadf6dd9b386702/users/0b1c31547a41486dbd012cdea5c6fb12/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:55.583005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.593944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239227e-de40-4f8a-a790-57744c7b977f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.682562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.683214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.683492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.683764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.684401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.686250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c559c-3c72-414b-be5a-0f7f77f256a2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.699823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3993/7995] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:32:55.703974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.718039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dead-1c51-4fd7-81a3-26005cd86c65 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.723423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.724087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.724358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.724622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] PATH_INFO: `/v3/projects/c0af7a91cd03482cadadf6dd9b386702/users/0b1c31547a41486dbd012cdea5c6fb12/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.729547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0af7a91cd03482cadadf6dd9b386702, user_id=0b1c31547a41486dbd012cdea5c6fb12, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.734940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.755584 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4003/7996] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:32:55 2022] PUT /identity/v3/projects/c0af7a91cd03482cadadf6dd9b386702/users/0b1c31547a41486dbd012cdea5c6fb12/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:55.757354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.757665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.757920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.793391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] MFA Rules not processed for user `0b1c31547a41486dbd012cdea5c6fb12`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:32:55.794619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:55.800641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:55.891008 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3994/7997] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:32:55.895835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.909555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415f804-7737-48bd-8d7e-305e4146ca74 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:55.914296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:55.914883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:55.915160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:55.915426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:55.916077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:55.918328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:55.935753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4004/7998] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:32:55 2022] POST /identity/v3/domains => generated 276 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:32:55.940014 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:55.951041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687a30f-e8f9-431d-bd6f-b60d196762f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.019399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.021241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.021480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.022238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.022650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.023735 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:56.023735 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:32:56.023735 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:32:56.024814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.083930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3995/7999] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:32:55 2022] PUT /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config => generated 138 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:32:56.086671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.099659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72f96-b4b1-43e5-8a58-94f19d459148 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.105238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.105965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.106253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.106676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.107838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb, group=identity)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.109048 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:56.109048 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:32:56.109048 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:32:56.110234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.120816 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4005/8000] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/identity => generated 45 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:56.124278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.136880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e68728-7f68-412e-b25f-63861b4c1404 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.141387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.141976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.142263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.142541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/identity/driver` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.143701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb, group=identity, option=driver)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.144725 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:56.144725 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:32:56.144725 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:32:56.145664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.153282 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3996/8001] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/identity/driver => generated 31 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:56.157204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.169499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35b23-52a4-4672-b950-f119e23421dd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.174857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.176043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.176648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.177183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.178738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb, group=ldap)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.180354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.188065 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4006/8002] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap => generated 106 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:56.191921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.203460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12614-a1ee-43df-be94-2bb3761ccb91 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.208545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.209244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.209527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.209803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap/url` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.210960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb, group=ldap, option=url)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.212730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.221463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3997/8003] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap/url => generated 46 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:56.223165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.235799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc58e7-b26a-4bba-85db-ed729c51fde5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.241541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.242201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.242535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.242810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap/user_tree_dn` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.243956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb, group=ldap, option=user_tree_dn)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.245615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.253739 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4007/8004] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config/ldap/user_tree_dn => generated 63 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:56.256984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.268640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292ce8-79d3-4193-b809-39ae713dd6d5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.273601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.274311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.274489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.275047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.275631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2272d9dca7344e6a84c91a980fe5b1fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.276631 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:56.276631 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:32:56.276631 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:32:56.278481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.289165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3998/8005] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:56 2022] DELETE /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb/config => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:32:56.293102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.305858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6fb63-5aab-428e-b39c-55ea89f3fc81 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.313482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.314158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.314398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.314751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.316497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2272d9dca7344e6a84c91a980fe5b1fb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.318143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.341749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.342681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.379424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.380060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.382776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4008/8006] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:32:56 2022] PATCH /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb => generated 277 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:56.389758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.392151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:56.408372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d304f7-4097-4455-a3ac-7ae77ebc8360 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.459237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:56.479742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.481169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.481660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.482354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.496942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2272d9dca7344e6a84c91a980fe5b1fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.499156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.529277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.533583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.590164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.600805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.610700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.623953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] The token cache is being invalidate because project 2272d9dca7344e6a84c91a980fe5b1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:32:56.624248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.624965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.633840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.638166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.638922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2272d9dca7344e6a84c91a980fe5b1fb', 'request_id': 'req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:56.645424 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 3999/8007] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:32:56 2022] DELETE /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:56.651101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.663374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49044b3-66e3-457b-8182-b70a77e2589d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.741138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.741758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.742127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.742684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.743393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.745339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.767068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4009/8008] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:32:56 2022] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:56.771448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.772937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:56.798152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff542d-72d7-4de6-a5fe-7e896fe0baf5 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.873684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.874532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.874821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.875102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.875786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.877421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.901152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:56.923054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4000/8009] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:32:56 2022] PUT /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 138 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:56.924871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:56.947254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b7a7f-296f-43f5-8f43-64a088c52cb8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:56.952265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:56.952932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:56.953251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:56.954555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:56.955250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:56.956446 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:56.956446 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:32:56.956446 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:32:56.957363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:56.978269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=9,keystone:SELECT=84,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:56.994943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4010/8010] 10.222.0.16 () {60 vars in 1271 bytes} [Fri Oct 28 10:32:56 2022] PATCH /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 141 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:56.998150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.010071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce668ab-9f31-4d79-9b1f-fb8fc86261a8 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.021449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.022130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.022413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.022687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.023844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.025474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.030861 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4001/8011] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:56 2022] GET /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 141 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:57.034865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.045943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f86cd-efa1-473a-85ac-946d7b5d3914 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.050936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.051778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.052238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.052682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.053677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.055528 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:57.055528 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:32:57.055528 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:32:57.056417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.069422 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4011/8012] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:57 2022] DELETE /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:32:57.071006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.082985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016e33-eacc-465b-82d9-a2526a879eee tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.087655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.088493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.089077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.089485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.091152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.092773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find any options in domain configuration for domain 7487904c57d04dc8a4735c110ab2a394.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7487904c57d04dc8a4735c110ab2a394. Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 28 10:32:57.102872 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7487904c57d04dc8a4735c110ab2a394. Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:32:57.107427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4002/8013] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:57 2022] GET /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 151 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:32:57.108363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.119074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d03-7dcf-4a17-bdd9-f3a7661aff11 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.127692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.128439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.128827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.129195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394/config` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.129910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.131756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.139125 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4012/8014] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:57 2022] DELETE /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394/config => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:57.143422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.154913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf801-eacd-4639-9885-1960f051ed22 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.159582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.160511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.160793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.161112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.162396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.163994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.188363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.189163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.236305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.237248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.244788 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4003/8015] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:32:57 2022] PATCH /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394 => generated 277 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:57.245736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.247680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:57.261302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c371b6d-3c00-4ee8-90cb-51aef77d26a7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.326193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.327117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.327547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.327988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.340014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7487904c57d04dc8a4735c110ab2a394)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.342175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.369477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.375779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7487904c57d04dc8a4735c110ab2a394'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.434764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.441085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.458205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.474280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] The token cache is being invalidate because project 7487904c57d04dc8a4735c110ab2a394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:32:57.474626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.475961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.484360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.488568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.489520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7487904c57d04dc8a4735c110ab2a394', 'request_id': 'req-76a4a589-f5db-48af-a43f-bf757cad0ba4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:57.499613 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4013/8016] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:32:57 2022] DELETE /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:57.504782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.516015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975d7a-a3be-419e-b8e3-2c1a864b2c7d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.579223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.579911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.580283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.580625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.581366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.583405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.601718 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4004/8017] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:32:57 2022] POST /identity/v3/domains => generated 276 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:32:57.606395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.607979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:57.626356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a589-f5db-48af-a43f-bf757cad0ba4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.635320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:57.698547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.699231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.699515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.699815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.700489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.702332 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:57.702332 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:32:57.702332 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:32:57.702778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.756643 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4014/8018] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Oct 28 10:32:57 2022] PUT /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config => generated 138 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:32:57.757799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.769753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef63f-a708-4167-b42f-0e41c02c26c1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.775847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.777132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.777442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.777719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.778420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.779464 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:57.779464 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:32:57.779464 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:32:57.780544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.817470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4005/8019] 10.222.0.16 () {60 vars in 1297 bytes} [Fri Oct 28 10:32:57 2022] PATCH /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity => generated 177 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:32:57.821808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.832691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18950055-eb16-4d13-9f94-0df9934d5874 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.837565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.838462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.838731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.839008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.840206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity, option=driver)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.841847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.870052 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4015/8020] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Oct 28 10:32:57 2022] PATCH /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver => generated 176 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:57.873849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.886125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17522-f6c0-4d7c-901e-2b06be26ed32 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.895152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.895831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.896517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.896832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.897469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity, option=driver)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.899526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.926213 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4006/8021] 10.222.0.16 () {58 vars in 1299 bytes} [Fri Oct 28 10:32:57 2022] DELETE /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:57.930885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.942070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8cc56-98f2-469f-91b8-42a61dcfed13 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.947283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.948010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.948367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.948735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.950111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity, option=driver)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.951793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find option driver in group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:32:57.963777 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:32:57.965459 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:32:57.969192 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4016/8022] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 10:32:57 2022] GET /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity/driver => generated 171 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:32:57.970883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:57.982163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9a55-23ee-4b6f-ba3d-76d3a613adbb tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:57.994435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:57.995109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:57.995393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:57.995709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:57.996308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:57.997955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.022369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4007/8023] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:32:57 2022] DELETE /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:58.023847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.038496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355f8b-4b26-49dd-b801-db4efa4a137b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.059852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.060550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.060833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.061315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.062534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7, group=identity)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.064162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:32:58.075727 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:32:58.076797 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:32:58.077438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4017/8024] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config/identity => generated 154 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:32:58.081378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.092562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9ac9-1de5-4b18-932c-867fa080cbba tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.097982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.098894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.099409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.099922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7/config` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.100765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=467f28bb1387463b886740ab2fb11dc7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.103972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.120063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4008/8025] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:58 2022] DELETE /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7/config => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:32:58.121286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.132729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e746a-d887-480f-b869-028b35fba0b6 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.137674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.138304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.138585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.138862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.140114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=467f28bb1387463b886740ab2fb11dc7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.141760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.166237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.166912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.197657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.198568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.204098 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4018/8026] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:32:58 2022] PATCH /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7 => generated 277 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:32:58.208247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.210082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:58.228764 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ef4e-ce5c-47df-a68c-1186517baf35 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.235093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:58.315987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.316639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.316938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.317230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.348968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=467f28bb1387463b886740ab2fb11dc7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.350773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.407515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.412520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '467f28bb1387463b886740ab2fb11dc7'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.503867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.511798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.522656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.539606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] The token cache is being invalidate because project 467f28bb1387463b886740ab2fb11dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:32:58.539905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.540664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.549650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.553079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.553739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '467f28bb1387463b886740ab2fb11dc7', 'request_id': 'req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:32:58.566214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4009/8027] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:32:58 2022] DELETE /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:32:58.567415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.578782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c90b7-0a62-4fcd-a34c-6bc7d57365da tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.660181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:58.680759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.682041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.682764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.683260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.683859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.685116 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:58.685116 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:32:58.685116 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:32:58.692994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.693246 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4019/8028] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:32:58.702090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.703587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:58.721991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca80d82-b8d6-406a-b0b1-d398d423ab3b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.727622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.729099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.729390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.729657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.730866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.731945 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:32:58.731945 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:32:58.731945 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:32:58.732848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.738547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4010/8029] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.739765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.751754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1430e63-5cf5-4b55-aaf4-5f13ac8cb353 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.759217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.759867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.760145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.760413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.761025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.762807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.764113 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4020/8030] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.767950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.779667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926971-ad53-44c8-bf05-1812a42ec348 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.785871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.786605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.786884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.787153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.787733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.789569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.790684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4011/8031] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.795158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.805480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def637d5-37e4-4877-ad45-864ddb55de7b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.810197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.810822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.811099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.811382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.811937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.813631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.815606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4021/8032] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:32:58.819660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.831278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c97c3-fed4-43ea-bf48-5d770a1368ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.835969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.836610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.836887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.837421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.838031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.840172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.844315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4012/8033] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.845547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.859222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5312e-b42b-4563-b27b-25cfca17201f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.863987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.864651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.864957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.865240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.865813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.867407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.868650 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4022/8034] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.872842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.885318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6379-32f8-421b-9d88-4ee599d50ee0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.890803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.891447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.891726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.892008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.893031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.894633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.898783 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4013/8035] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:58.900076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.911498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc967-a9e0-4ce9-8d62-08dff1e698c3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.920001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.920668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.921018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.921307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.921903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.923593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.924782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4023/8036] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:58.928968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.941408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e670b-4470-4af2-994e-55b7aa397e88 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.946524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.947218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.947492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.947767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.948349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.950688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.951878 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4014/8037] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:58.956089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:58.969046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41869da-734e-4615-b723-ce034145395c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:58.976522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:58.977536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:58.977820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:58.978089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:58.978674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:58.981071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:58.984865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4024/8038] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:58.988404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.000199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5d6bb-7847-4227-a3f5-2a7f194264d4 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.005086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.005834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.006183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.006533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.007193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.008880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.010666 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4015/8039] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:32:58 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.014913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.025466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aa21c-ed4a-4929-b343-def722ae2d9e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.030748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.031387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.031670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.031947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.032529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.034179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.035297 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4025/8040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.039286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.050716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f265573-980f-4d41-b791-aeb54015938a tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.056939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.058442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.058741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.059025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.059628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.061273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.064941 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4016/8041] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.066570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.079080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7baaa-61b8-4978-922e-34586686168b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.086009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.086793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.087077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.087352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.087944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.090168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.091560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4026/8042] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.095281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.106196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266cba-b387-4663-bd40-f7905ad4d66f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.115801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.116609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.117034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.117314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.117917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.119996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.140439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4017/8043] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.142124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.154332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4dde-a292-47dc-9a35-db5d28b4c62e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.159976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.160726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.161140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.161529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.164717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.166480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.171130 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4027/8044] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.171841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.183079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b27c-4c58-40fa-8055-3cf6ef516c2c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.188052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.190507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.190507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.190507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.190507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.192155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.196500 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4018/8045] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.198211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.209115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13150-983e-49b5-b11a-799a07e89e60 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.218244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.220723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.220723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.220723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.220723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.221989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.223141 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4028/8046] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.227165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.234500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:59.240241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac920d-e8ff-4def-afc9-5efe6473653c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.247501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.248271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.248646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.249011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.249695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.251432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.252730 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4019/8047] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.256959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.268458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf9951-e872-43d9-8504-bfa16fd20f30 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.274935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.275804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.276155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.276494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.277781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.279527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.280712 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4029/8048] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.284763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.295782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89147962-2d8f-4493-a84a-d87d26b6d7cd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.302200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.303001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.303352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.303748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.304405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.306426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.307665 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4020/8049] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.311945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.323572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35630a-1d33-4d17-b109-7bfc7c0b095f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.330007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.330650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.330928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.331197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.331781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.333894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.334482 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4030/8050] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.338763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.351571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4b93e-d661-4a97-a8d8-0baeee7122cc tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.356605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.357320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.357774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.358053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.358648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.360245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.364320 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4021/8051] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.365716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.384951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd79b6-350b-4dee-a184-f6cc327f64d3 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.396111 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.398550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.398899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.399242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.399909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.401651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.403060 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4031/8052] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.407233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.418116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6118-3ffa-4690-aed1-baca6b5f1d82 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.424421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.425110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.425395 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.425669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.426289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.427889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.431952 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4022/8053] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.435306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.455249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247720-7c45-41c6-bd73-765978ac2c6d tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.460510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.461298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.463563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.463563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.463563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.465526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.468954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4032/8054] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.470761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.486534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ecae7-0c9d-419e-8ac3-19ca8e6ff2f1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.491404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.492055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.492333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.492604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.493255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.494839 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.499448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4023/8055] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.500604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.512018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88761ca-fb4e-4ad9-b7c2-406ff4fb5aea tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.516733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.517507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.517804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.518081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.518670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.520352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.521617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4033/8056] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.525457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.537048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604ede-51ef-4b46-8c74-0139a3bcfc74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.542238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.543134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.543584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.544015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.544818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.546612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.548568 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4024/8057] 10.222.0.16 () {58 vars in 1308 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.552274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.563945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617dadc-efaa-4ee4-acea-84cfd789415f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.570808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.571744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.572135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.572475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.573204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.575550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.576954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4034/8058] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.587526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.607426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa0ac-9d75-4f8d-a0e1-006a7df0996b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.616047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.616662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.616982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.617259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.618264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.619899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.624486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4025/8059] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.625715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.638940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f560ee-d2f7-4273-9ada-77e257f3dff0 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.643851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.644533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.644815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.645135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.645744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.647371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.660409 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4035/8060] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.671300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.685617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e25c-34ee-40eb-a35e-7a1f7fd3e4a2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.691709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.692383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.692670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.693082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.693952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.696071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.697566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4026/8061] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.704506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.718109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fccb8-f26a-48af-8d91-075d3ee92e74 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.724310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.725026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.725316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.725593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.726487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.728414 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.732955 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4036/8062] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.734496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.745412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cf8f-3ef8-41b7-9dd1-863a6a711b8e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.754740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.755449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.756394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.756673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.757336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.758930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.760337 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4027/8063] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.764249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.776275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f972d-3d0f-4000-bc95-b56a785c9df1 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.782543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.783425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.783877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.784326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.785376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.787628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.791620 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4037/8064] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.801508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.813789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6c0a-b055-45b2-b30f-5782382aeb03 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.818695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.819405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.819767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.820363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.821066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.822713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.824022 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4028/8065] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.828943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.839470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d824-3fa8-48df-9048-c303c8cbc01b tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.844265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.845091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.845439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.845778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.846418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.848064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.849270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4038/8066] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.853305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.867230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eeccf-6b4d-4aaa-83b9-7b09ca31c781 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.873525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.874105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.874386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.874767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.875237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.876957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.878310 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4029/8067] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:32:59.882247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.894876 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03542e0-aa7d-421f-bdfb-2291375b399f tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.904340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.905027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.905310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.905585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.906178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.907784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.909219 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4039/8068] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.913537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.925164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964f089-b986-4488-af08-8ca1eaa439ff tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.929978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.930629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.930911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.931183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.931767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.933984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.940754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.944598 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4030/8069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.952208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4c3f2-b3f5-40f4-b936-568fa1022b29 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.962363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.963057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.963649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.963649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.967550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.967550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.967550 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4040/8070] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:32:59.971265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:59.983689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e263afc-aaeb-4c87-a66d-b195450979fd tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:59.988651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:59.989674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:59.990056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:59.990429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:59.991130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:59.994727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:59.997476 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4031/8071] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.000536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.012068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767063e9-b46c-4113-bf21-8a136b9d51c2 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.018583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.019365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.019747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.020133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.020831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.022760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.024320 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4041/8072] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:32:59 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.028302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.040939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa7e0e-870f-4245-ad20-bcb292ccb201 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.051036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.051700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.051984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.052261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.052852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.054628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.056064 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4032/8073] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 28 10:33:00.062757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.073978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02905e4-e511-4b34-b443-12b967a81b54 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.079920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.080565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.080848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.081150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.081720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.083362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.084623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4042/8074] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.088936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.099865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0cbc9-4bfa-4f5e-96ea-9f873afd65db tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.104559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.105817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.106097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.106360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.106952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.108784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.110419 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4033/8075] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.114223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.125004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632c3c-1fba-4bce-b0ed-1c2af39fb5a9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.132667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.133370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.133647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.133912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.134856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.136550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.137688 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4043/8076] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.141783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.152699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f48c-3f33-4856-bd6e-3b71f8ed2fa9 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.157464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.158103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.158442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.158719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.159302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.161092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.166408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.166913 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4034/8077] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.178182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d86ad-4a4a-4850-91ff-184dd851d716 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.183813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.184465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.184757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.185028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.185629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.187254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.188558 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4044/8078] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.192448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.204541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b7c25-da0a-4e3a-ba12-f1fbe368bac7 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.210423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.211182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.211530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.211873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.212530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.214248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.215986 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4035/8079] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.219994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.231456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fb12e-5eec-4315-8207-9c2b1dc12d6e tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.236284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.236954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.237281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.237533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.238113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.239708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.240790 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4045/8080] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.245031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.256772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151fb95-75c9-4c86-a92b-794a4fe27b6c tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.262466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.263302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.263594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.263895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.264502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.266246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.267489 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4036/8081] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:00.276672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.290981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d55e-592f-4954-b783-860c73d86555 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.297191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.297837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.298122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.298393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/467f28bb1387463b886740ab2fb11dc7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.306493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find domain: 467f28bb1387463b886740ab2fb11dc7.: keystone.exception.DomainNotFound: Could not find domain: 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:00.311576 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:00.312782 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:33:00.314083 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 467f28bb1387463b886740ab2fb11dc7. Oct 28 10:33:00.315500 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.315500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4046/8082] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:33:00 2022] PATCH /identity/v3/domains/467f28bb1387463b886740ab2fb11dc7 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:33:00.316716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.327906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6a22-6b28-4239-8b00-3798dd5b8c83 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.332733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.333473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.333824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.334101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/7487904c57d04dc8a4735c110ab2a394` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.342191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find domain: 7487904c57d04dc8a4735c110ab2a394.: keystone.exception.DomainNotFound: Could not find domain: 7487904c57d04dc8a4735c110ab2a394. Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7487904c57d04dc8a4735c110ab2a394. Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:00.347311 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:00.348537 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application with Lock( Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:33:00.349700 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7487904c57d04dc8a4735c110ab2a394. Oct 28 10:33:00.350825 n-d-zed-1 devstack@keystone.service[88451]: ERROR keystone.server.flask.application Oct 28 10:33:00.350825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4037/8083] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:33:00 2022] PATCH /identity/v3/domains/7487904c57d04dc8a4735c110ab2a394 => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:33:00.353122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.363953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f3b23-8ecb-4057-86a6-e55d4853ad18 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.368694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1c31547a41486dbd012cdea5c6fb12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0af7a91cd03482cadadf6dd9b386702', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.369385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.369673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.369945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] PATH_INFO: `/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.378657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-93bbfa52-cd31-4d07-a4fa-e33ec3ff57de tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Could not find domain: 2272d9dca7344e6a84c91a980fe5b1fb.: keystone.exception.DomainNotFound: Could not find domain: 2272d9dca7344e6a84c91a980fe5b1fb. Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2272d9dca7344e6a84c91a980fe5b1fb. Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:00.383738 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:00.384953 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 10:33:00.385956 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2272d9dca7344e6a84c91a980fe5b1fb. Oct 28 10:33:00.387095 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:00.387095 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4047/8084] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:33:00 2022] PATCH /identity/v3/domains/2272d9dca7344e6a84c91a980fe5b1fb => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:33:00.389046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.391414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:00.468230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31adec2-57fd-46df-9c03-2e538f5e3538 tempest-DomainConfigurationTestJSON-512402907 tempest-DomainConfigurationTestJSON-512402907-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.473707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.474209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.474490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.474765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] PATH_INFO: `/v3/users/7886b37bc66d4f01a389dc439e9ca988` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.476132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7886b37bc66d4f01a389dc439e9ca988)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.478327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.540397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7886b37bc66d4f01a389dc439e9ca988'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:00.542075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7886b37bc66d4f01a389dc439e9ca988'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:00.542291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7886b37bc66d4f01a389dc439e9ca988'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:00.553826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7886b37bc66d4f01a389dc439e9ca988'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:00.569757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7886b37bc66d4f01a389dc439e9ca988'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:00.584339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:00.608731 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4038/8085] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:00 2022] DELETE /identity/v3/users/7886b37bc66d4f01a389dc439e9ca988 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:00.613345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.613667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.613937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.634881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:00.636948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:00.705277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4048/8086] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:00.717443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:00.719175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:00.786295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c7b2-f1a9-4e17-894a-f47c54aa2a2d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:00.791600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:00.792239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:00.792568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:00.793001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:00.807472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:00.809079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:00.821479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4039/8087] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:01.155830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:01.157769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:01.179394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5860630-9912-4d51-b56c-9be10dd25ad8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:01.186035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:01.186681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:01.186959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:01.187230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] PATH_INFO: `/v3/projects/7ab2ae3a2cba4001aef760abe91999f4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:01.188384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab2ae3a2cba4001aef760abe91999f4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:01.190528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:01.222275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:01.249249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab2ae3a2cba4001aef760abe91999f4', 'request_id': 'req-476f483b-4504-4481-b319-5cc8a088ab65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.255237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab2ae3a2cba4001aef760abe91999f4', 'request_id': 'req-476f483b-4504-4481-b319-5cc8a088ab65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.264246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab2ae3a2cba4001aef760abe91999f4', 'request_id': 'req-476f483b-4504-4481-b319-5cc8a088ab65'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.277060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] The token cache is being invalidate because project 7ab2ae3a2cba4001aef760abe91999f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:01.277402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.278004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.282839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4049/8088] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:01 2022] DELETE /identity/v3/projects/7ab2ae3a2cba4001aef760abe91999f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:01.283612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:01.296971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d98b-e431-4d12-9e1e-5188b4aa5d23 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:01.368498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:01.369280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:01.369541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:01.369863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] PATH_INFO: `/v3/users/0b1c31547a41486dbd012cdea5c6fb12` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:01.372514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1c31547a41486dbd012cdea5c6fb12)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:01.374648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:01.428804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1c31547a41486dbd012cdea5c6fb12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.429762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1c31547a41486dbd012cdea5c6fb12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.430543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1c31547a41486dbd012cdea5c6fb12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.449636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1c31547a41486dbd012cdea5c6fb12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.460806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-563ff49b-180a-4a6b-ba2f-ec36a8d3e44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1c31547a41486dbd012cdea5c6fb12'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.485779 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4040/8089] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:01 2022] DELETE /identity/v3/users/0b1c31547a41486dbd012cdea5c6fb12 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:01.807837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:01.810115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:01.834195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f483b-4504-4481-b319-5cc8a088ab65 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:01.914207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:01.914849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:01.915133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:01.915408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] PATH_INFO: `/v3/projects/c0af7a91cd03482cadadf6dd9b386702` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:01.916543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0af7a91cd03482cadadf6dd9b386702)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:01.918528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:01.972610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0af7a91cd03482cadadf6dd9b386702', 'request_id': 'req-c12292b8-8e95-484c-b323-6027469c9cbd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.978707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0af7a91cd03482cadadf6dd9b386702', 'request_id': 'req-c12292b8-8e95-484c-b323-6027469c9cbd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:01.989661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0af7a91cd03482cadadf6dd9b386702', 'request_id': 'req-c12292b8-8e95-484c-b323-6027469c9cbd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:02.002474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] The token cache is being invalidate because project c0af7a91cd03482cadadf6dd9b386702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:02.002782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:02.003673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c12292b8-8e95-484c-b323-6027469c9cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:02.005267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4050/8090] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:01 2022] DELETE /identity/v3/projects/c0af7a91cd03482cadadf6dd9b386702 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:02.010547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.010912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.011278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.033710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:02.034941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:02.049358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:02.112384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4041/8091] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:02.119915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.120203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.120480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.152983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:02.154298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:02.167075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.173912 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4051/8092] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:02.178230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd4ee-509c-48f5-a23a-433f36e8bc05 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.187062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.187678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.187958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.188228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.188992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:02.189302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.190899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.211151 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4042/8093] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:02.212172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.222211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb626-e9fe-4982-8a50-73b70d4ad045 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.230861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.231514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.231792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.232061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.232706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.234663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.268665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4052/8094] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:02.272600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.282770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679aa3-ae4c-4685-8e7d-2bd3ee601937 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.348489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.349257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.349481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.349751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.350394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.352346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.379607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4043/8095] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:02.383809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.394609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873cae-912d-4a32-a89c-da3f2da6c8a0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.399390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.399970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.400257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.400526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.401211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.403381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.424849 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4053/8096] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:02.431021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.441515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95466ce-3d23-4d2e-afdc-4863c54468f5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.446574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.447171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.447451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.447726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.448367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.450036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df566ea-141b-4955-b7b7-4783811c4e70 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.460865 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4044/8097] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:02.465374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.475705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:02.478882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895557-4d77-403d-8aae-4d6c0e497054 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.487389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.488720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.489290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.491940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] PATH_INFO: `/v3/projects/4061a7ca016b428aa843d5fc3af8b698/users/9be11114082c4ce4880300bae03c16fd/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.514829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4061a7ca016b428aa843d5fc3af8b698, user_id=9be11114082c4ce4880300bae03c16fd, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.517703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.533679 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4054/8098] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:02 2022] PUT /identity/v3/projects/4061a7ca016b428aa843d5fc3af8b698/users/9be11114082c4ce4880300bae03c16fd/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:02.545430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.545793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.545979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.577275 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] MFA Rules not processed for user `9be11114082c4ce4880300bae03c16fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:02.578491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:02.671043 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4045/8099] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:02.675473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.742377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86248a2b-fb98-43b2-8d37-d5084dd10ad9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.747133 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.747741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.748022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.748293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.748969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.750923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.783609 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4055/8100] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:02.787477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.798632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ff4ff-a0f0-4ab9-a827-7265a225e7e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.808387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:02.871909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.872960 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.873483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.874026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.874953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.878136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.920525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4046/8101] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:02 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:02.923210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.940171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cee77-c832-4f4a-bed6-39c9b346e886 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.945944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.946574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.946867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.947128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:02.947778 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:02.949960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:02.965082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4056/8102] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:02.966870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:02.977488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346560-542f-46fa-bf96-530cc2d1d3e5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:02.982179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:02.982829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:02.983109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:02.983385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] PATH_INFO: `/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3/users/d9dc432cd2c94faaaca71874c8571899/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.000451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc1d6398d0a4c5ea7b0167a3c6718a3, user_id=d9dc432cd2c94faaaca71874c8571899, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.003347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.019114 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4047/8103] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:02 2022] PUT /identity/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3/users/d9dc432cd2c94faaaca71874c8571899/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:03.023190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.034841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292976-12f9-44f8-b16c-170dd6c62e40 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.103411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.104031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.104389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.104568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.105267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.106938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523e713-259a-46fe-9b38-8dfe4e431329 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.119258 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4057/8104] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:03.123841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.135063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90060f14-742b-4997-9445-980877552fa2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.141956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.142661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.142943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.143217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] PATH_INFO: `/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3/users/d9dc432cd2c94faaaca71874c8571899/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.146343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc1d6398d0a4c5ea7b0167a3c6718a3, user_id=d9dc432cd2c94faaaca71874c8571899, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.149398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.160766 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4048/8105] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:03 2022] PUT /identity/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3/users/d9dc432cd2c94faaaca71874c8571899/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:03.171174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.171719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.172022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.212049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] MFA Rules not processed for user `d9dc432cd2c94faaaca71874c8571899`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:03.213550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:03.257981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:03.298560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4058/8106] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:03.302456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.315244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376685a-aa94-49cc-97a3-39e32a7b4301 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.320510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.321239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.321527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.321916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.322644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.324862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.343304 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4049/8107] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/domains => generated 276 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:03.347314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.374506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c659f-2d4d-41e0-93a5-2ecd527c0e9d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.443226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.443765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.444046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.444385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.445353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.447269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.490300 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4059/8108] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/projects => generated 398 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:03.491829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.515804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0b3c-3c31-4c18-8ad9-8ba8cde083e1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.585836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.586987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.587468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.587961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/groups` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.588798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.591787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.613497 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4050/8109] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/groups => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:03.617721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.630663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab378511-32af-46ac-a508-3906a0f17be8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.635934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.636563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.636849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.637169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.637825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.639777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.668238 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4060/8110] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/users => generated 445 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:03.669574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.680143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41685f0-1d81-48c2-b9c6-7764822c0279 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.685041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.685654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.685941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.686216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.686876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.688486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.707963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4051/8111] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:03 2022] POST /identity/v3/roles => generated 239 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:03.712471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.726956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2389af-52cb-4dc2-8ece-4de21ee35418 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.733688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.734600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.734923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.735297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.742432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, group_id=160c794590bb451e829c5d689ed50406, role_id=91a8798885de40cba46eea9922a93376)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.745849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.764976 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4061/8112] 10.222.0.16 () {60 vars in 1585 bytes} [Fri Oct 28 10:33:03 2022] PUT /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:03.774606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.790796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8856af-c28f-4992-a3a9-92395b4aa32b tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.831474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:03.863082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.863756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.864037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.864309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.866685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, group_id=160c794590bb451e829c5d689ed50406, role_id=91a8798885de40cba46eea9922a93376)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.869394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.878119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4052/8113] 10.222.0.16 () {58 vars in 1567 bytes} [Fri Oct 28 10:33:03 2022] HEAD /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:03.882061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.893255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe3bb-3760-4a68-a2ca-eb762e52face tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:03.898411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:03.899169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:03.899452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:03.899728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:03.902024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, group_id=160c794590bb451e829c5d689ed50406, role_id=91a8798885de40cba46eea9922a93376)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:03.904847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:03.917924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 91a8798885de40cba46eea9922a93376 was removed from group 160c794590bb451e829c5d689ed50406 on project 7a13d6d9cf1a4336a5ef69f819ff0141. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:03.918225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:03.918965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:03.938662 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4062/8114] 10.222.0.16 () {58 vars in 1569 bytes} [Fri Oct 28 10:33:03 2022] DELETE /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/groups/160c794590bb451e829c5d689ed50406/roles/91a8798885de40cba46eea9922a93376/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:03.942736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:03.944814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:03.968980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c6dce-7b53-4cf2-a290-0ff3c9ded0e8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.032459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.033133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.033557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.033842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/91a8798885de40cba46eea9922a93376` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.038661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=91a8798885de40cba46eea9922a93376)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.038661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.085172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 91a8798885de40cba46eea9922a93376 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:04.085597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.086449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.089119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4053/8115] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:03 2022] DELETE /identity/v3/roles/91a8798885de40cba46eea9922a93376 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.094452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.105905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238d09-217a-4ccc-98e2-ce445a4fa148 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.162366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:04.171366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.172513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.172795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.173097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.173755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.176729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.196175 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4063/8116] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:04 2022] POST /identity/v3/roles => generated 239 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:04.197633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.199793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:04.212793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd18cd9-7aa7-4666-9035-d74ce2d29878 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.218145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.218803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.219083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.219353 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.238027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=ae5677118bf04603a496dfd462fe9386)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.241169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.258965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4054/8117] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Oct 28 10:33:04 2022] PUT /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.263411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.275490 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0051e-572b-4a9d-a52e-7ff06c11518d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.365313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.366379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.366754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.367132 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.369690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=ae5677118bf04603a496dfd462fe9386)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.372532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.379391 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4064/8118] 10.222.0.16 () {58 vars in 1564 bytes} [Fri Oct 28 10:33:04 2022] HEAD /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.383701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.395427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cb5eb-fdf7-43a0-934b-714abe5c22a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.405828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.406492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.406771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.407046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.409587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=ae5677118bf04603a496dfd462fe9386)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.412287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.419123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role ae5677118bf04603a496dfd462fe9386 was removed from user 3ce40f8476254b5ba7855d0615193d53 on project 7a13d6d9cf1a4336a5ef69f819ff0141. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:04.419405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.420104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.435664 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4055/8119] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Oct 28 10:33:04 2022] DELETE /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/ae5677118bf04603a496dfd462fe9386/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.439746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.441514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:04.456576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04d30-b034-4dfe-a656-8421afcc2c71 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.547767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.548444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.548777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.549091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/ae5677118bf04603a496dfd462fe9386` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.550740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ae5677118bf04603a496dfd462fe9386)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.552708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.608301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role ae5677118bf04603a496dfd462fe9386 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:04.608697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.609510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.612206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4065/8120] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:04 2022] DELETE /identity/v3/roles/ae5677118bf04603a496dfd462fe9386 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:04.617020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.628050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e3146-b3e2-4d3f-b57b-f530d6a40e54 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.712216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:04.720708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.721915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.722309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.722657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.723662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.726836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.745114 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4056/8121] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:04 2022] POST /identity/v3/roles => generated 238 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:04.749680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.751230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:04.765118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9858bd-5cac-46ea-989e-99447241d185 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.769884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.770557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.770841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.771150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.773360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, group_id=160c794590bb451e829c5d689ed50406, role_id=8fe58a139a814a18be50b67eb13a0bab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.776189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.789684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4066/8122] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Oct 28 10:33:04 2022] PUT /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:04.794347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.805900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f56ca-cc67-4c6d-826a-4075664f22c9 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.871493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.872624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.873283 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.873723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.875551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, group_id=160c794590bb451e829c5d689ed50406)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.878593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.893286 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4057/8123] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Oct 28 10:33:04 2022] GET /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/inherited_to_projects => generated 446 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:04.898936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.913026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3287-279a-4dec-b800-c0ff0e3acebe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.918302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.919001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.919274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.919547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.921814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, group_id=160c794590bb451e829c5d689ed50406, role_id=8fe58a139a814a18be50b67eb13a0bab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.924488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.931771 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4067/8124] 10.222.0.16 () {58 vars in 1564 bytes} [Fri Oct 28 10:33:04 2022] HEAD /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.936408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.947183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999541-781a-4fc4-939b-0c039ee42c18 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:04.952559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:04.953369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:04.953747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:04.954125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:04.956612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, group_id=160c794590bb451e829c5d689ed50406, role_id=8fe58a139a814a18be50b67eb13a0bab)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:04.959515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:04.967796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 8fe58a139a814a18be50b67eb13a0bab was removed from group 160c794590bb451e829c5d689ed50406 on domain 6e642bda9aa04d9cb5eca13f43a28db4. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:04.968135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.968962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:04.987396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4058/8125] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Oct 28 10:33:04 2022] DELETE /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/groups/160c794590bb451e829c5d689ed50406/roles/8fe58a139a814a18be50b67eb13a0bab/inherited_to_projects => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:04.991298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:04.993151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:05.013833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7591-4132-4728-944e-8107e86744d6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.050427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:05.090159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.090811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.091087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.091360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/8fe58a139a814a18be50b67eb13a0bab` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.092781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8fe58a139a814a18be50b67eb13a0bab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.095309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.143266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 8fe58a139a814a18be50b67eb13a0bab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:05.143561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.144229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.150105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4068/8126] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:04 2022] DELETE /identity/v3/roles/8fe58a139a814a18be50b67eb13a0bab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:05.151573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.161995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38846a1b-c1e1-4d42-860a-693bf17411a5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.244491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.245059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.245343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.246190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.247007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.248623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.267801 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4059/8127] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:05 2022] POST /identity/v3/roles => generated 240 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:05.269045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.270549 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:05.284651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbac4-0d0b-4b92-81b9-cf5b128e457e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.290307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.291332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.291968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.293382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.295964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=d666a5722590405e9e4aed7a1442d5b5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.299218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.318429 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4069/8128] 10.222.0.16 () {60 vars in 1579 bytes} [Fri Oct 28 10:33:05 2022] PUT /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:05.322826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.333605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aeb5b-ab02-40aa-95df-65362836d5b4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.396069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:05.408891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.409763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.410536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.410664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.413228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.415771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.431703 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4060/8129] 10.222.0.16 () {58 vars in 1461 bytes} [Fri Oct 28 10:33:05 2022] GET /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/inherited_to_projects => generated 447 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:05.436339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.450254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f9fa-ad0c-4329-a3d3-9c4aa73456e3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.455033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.455781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.456122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.456613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.458862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=d666a5722590405e9e4aed7a1442d5b5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.461608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.477302 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4070/8130] 10.222.0.16 () {58 vars in 1561 bytes} [Fri Oct 28 10:33:05 2022] HEAD /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:05.477438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.494074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c78-ba61-4146-8e12-8cca05dd01f6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.499803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.501481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.501870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.502264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.504966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=d666a5722590405e9e4aed7a1442d5b5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.508890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.517638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role d666a5722590405e9e4aed7a1442d5b5 was removed from user 3ce40f8476254b5ba7855d0615193d53 on domain 6e642bda9aa04d9cb5eca13f43a28db4. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:05.518083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.518945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.539829 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4061/8131] 10.222.0.16 () {58 vars in 1563 bytes} [Fri Oct 28 10:33:05 2022] DELETE /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/d666a5722590405e9e4aed7a1442d5b5/inherited_to_projects => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:05.544683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.546411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:05.560423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf151a-7770-47b1-91d5-2b93ab61728a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.625614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.626252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.626531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.626804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/d666a5722590405e9e4aed7a1442d5b5` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.628172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d666a5722590405e9e4aed7a1442d5b5)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.629808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.666423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role d666a5722590405e9e4aed7a1442d5b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:05.666743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.668075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:05.673975 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4071/8132] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:05 2022] DELETE /identity/v3/roles/d666a5722590405e9e4aed7a1442d5b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:05.675584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.688940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb33c83-8ed4-4732-ad83-ed5394d611e5 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.756532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.757264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.757623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.758099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.758850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.760526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.780403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4062/8133] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:05 2022] POST /identity/v3/roles => generated 239 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:05.781815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.783608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:05.806448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cf4-7f9a-4061-9262-29b56f211d63 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.815765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.816614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.817138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.817610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.818265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.820756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.859957 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4072/8134] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:05 2022] POST /identity/v3/projects => generated 408 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:05.864656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.876272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482f5b0-3a14-44b0-91c2-9066f718398c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.940011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:05.940856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:05.941274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:05.941680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/c5d98214500141e49956f72782c316cc/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:05.944220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=c5d98214500141e49956f72782c316cc)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:05.947829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:05.962881 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4063/8135] 10.222.0.16 () {60 vars in 1579 bytes} [Fri Oct 28 10:33:05 2022] PUT /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/c5d98214500141e49956f72782c316cc/inherited_to_projects => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:05.967301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:05.980448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a27b-b4c5-42ee-95d8-587d7103f718 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:05.990816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:06.050581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.051202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.051489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.051765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.052494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=7a13d6d9cf1a4336a5ef69f819ff0141, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:06.052801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.054695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.117520 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4073/8136] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:05 2022] GET /identity/v3/role_assignments?scope.project.id=7a13d6d9cf1a4336a5ef69f819ff0141&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 648 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:06.121901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.132813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bbfde-1b27-4cb9-8890-9fc1694a3fbe tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.137567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.138224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.138512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.138789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.140310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=634f3a743268475b831d6cd15247a6fb, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:06.140628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.142519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.203607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4064/8137] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:06 2022] GET /identity/v3/role_assignments?scope.project.id=634f3a743268475b831d6cd15247a6fb&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 648 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:06.207777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.218115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf343-8110-4132-9d0a-aec9eadde2d8 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.222980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.223722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.224180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.224534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/c5d98214500141e49956f72782c316cc/inherited_to_projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.226827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6e642bda9aa04d9cb5eca13f43a28db4, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=c5d98214500141e49956f72782c316cc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.229649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.235410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role c5d98214500141e49956f72782c316cc was removed from user 3ce40f8476254b5ba7855d0615193d53 on domain 6e642bda9aa04d9cb5eca13f43a28db4. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:06.235777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.236539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.254118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4074/8138] 10.222.0.16 () {58 vars in 1563 bytes} [Fri Oct 28 10:33:06 2022] DELETE /identity/v3/OS-INHERIT/domains/6e642bda9aa04d9cb5eca13f43a28db4/users/3ce40f8476254b5ba7855d0615193d53/roles/c5d98214500141e49956f72782c316cc/inherited_to_projects => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:06.255314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.257162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:06.269398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:06.282170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240745f4-0d0c-48c6-ab50-897d3b99b481 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.347887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.347887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.348197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.348310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.349090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=7a13d6d9cf1a4336a5ef69f819ff0141, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:06.349420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.351257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.405375 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4065/8139] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:06 2022] GET /identity/v3/role_assignments?scope.project.id=7a13d6d9cf1a4336a5ef69f819ff0141&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 228 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:06.406857 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.418031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f102-d2af-4f07-a097-e8e3546a2bc3 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.422934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.423559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.423839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.424114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.424835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=634f3a743268475b831d6cd15247a6fb, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:06.425203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.427057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.498828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.500180 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4075/8140] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:06 2022] GET /identity/v3/role_assignments?scope.project.id=634f3a743268475b831d6cd15247a6fb&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 228 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:06.522855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ddc2-45bb-44a2-b706-4aefad862f4f tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.543262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.544069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.544452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.544847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects/634f3a743268475b831d6cd15247a6fb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.548295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=634f3a743268475b831d6cd15247a6fb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.550379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.629677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634f3a743268475b831d6cd15247a6fb', 'request_id': 'req-16f272a8-b854-4845-9396-ca81640950b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.636794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634f3a743268475b831d6cd15247a6fb', 'request_id': 'req-16f272a8-b854-4845-9396-ca81640950b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.646807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634f3a743268475b831d6cd15247a6fb', 'request_id': 'req-16f272a8-b854-4845-9396-ca81640950b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.659380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] The token cache is being invalidate because project 634f3a743268475b831d6cd15247a6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:06.659800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.660576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.664994 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4066/8141] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:06 2022] DELETE /identity/v3/projects/634f3a743268475b831d6cd15247a6fb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:06.667244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.670600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:06.686130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74b1d-e801-460a-b05e-2dbd2f294c9e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.750056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.750806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.751172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.751522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/c5d98214500141e49956f72782c316cc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.753047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5d98214500141e49956f72782c316cc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.754753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.760296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:06.798460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role c5d98214500141e49956f72782c316cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:06.798822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.799610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:06.801943 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4076/8142] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:06 2022] DELETE /identity/v3/roles/c5d98214500141e49956f72782c316cc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:06.806750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.818789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f272a8-b854-4845-9396-ca81640950b6 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.875684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:06.888049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.888802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.889236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.889762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.890548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.892258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.908738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4067/8143] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Oct 28 10:33:06 2022] POST /identity/v3/roles => generated 240 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:06.912681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.914376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:06.928267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c029-e1f4-414d-8df7-884aa3899745 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:06.932974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:06.933601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:06.933881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:06.934152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:06.934788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:06.936726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:06.976776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4077/8144] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:06 2022] POST /identity/v3/projects => generated 410 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:06.981431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:06.992547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367ad01-c226-4e2f-b1e4-8c8fecbc7d52 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.079584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.080388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.081017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.081371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/480a8132643b403dac017beac3a892e3/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.084806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=480a8132643b403dac017beac3a892e3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.088297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.109957 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4068/8145] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Oct 28 10:33:06 2022] PUT /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/480a8132643b403dac017beac3a892e3/inherited_to_projects => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:07.115056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.134367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340e6e-b57a-48ba-8846-80c13b9a4ec0 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.212825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.213844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.214881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.215330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.216228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=ab8de7ba09d14b7787780bb443f47129, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:07.216556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.218770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.307994 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4078/8146] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:07 2022] GET /identity/v3/role_assignments?scope.project.id=ab8de7ba09d14b7787780bb443f47129&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 649 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:07.309564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.325980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bda1e9-c076-4421-a4ae-6ea1648407a4 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.332286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.333282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.333566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.334063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/480a8132643b403dac017beac3a892e3/inherited_to_projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.336661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7a13d6d9cf1a4336a5ef69f819ff0141, user_id=3ce40f8476254b5ba7855d0615193d53, role_id=480a8132643b403dac017beac3a892e3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.340462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.347388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 480a8132643b403dac017beac3a892e3 was removed from user 3ce40f8476254b5ba7855d0615193d53 on project 7a13d6d9cf1a4336a5ef69f819ff0141. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:07.347782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.348638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.368312 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4069/8147] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Oct 28 10:33:07 2022] DELETE /identity/v3/OS-INHERIT/projects/7a13d6d9cf1a4336a5ef69f819ff0141/users/3ce40f8476254b5ba7855d0615193d53/roles/480a8132643b403dac017beac3a892e3/inherited_to_projects => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:07.372755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.374952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:07.390279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5932a2-2f2e-416a-bf55-3696cd1de211 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.461423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:07.476001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.476831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.477202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.477486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.478232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Adding query filter params (scope.project.id=ab8de7ba09d14b7787780bb443f47129, user.id=3ce40f8476254b5ba7855d0615193d53) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:07.478541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.481187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.556776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4079/8148] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Oct 28 10:33:07 2022] GET /identity/v3/role_assignments?scope.project.id=ab8de7ba09d14b7787780bb443f47129&user.id=3ce40f8476254b5ba7855d0615193d53&effective => generated 228 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:07.557434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.570107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4f9e-fa7c-4dd0-9b5f-7e5df9ceb404 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.576864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.577541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.577820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.578094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects/ab8de7ba09d14b7787780bb443f47129` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.579526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab8de7ba09d14b7787780bb443f47129)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.583100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.664534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8de7ba09d14b7787780bb443f47129', 'request_id': 'req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.672546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8de7ba09d14b7787780bb443f47129', 'request_id': 'req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.681782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8de7ba09d14b7787780bb443f47129', 'request_id': 'req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.698200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] The token cache is being invalidate because project ab8de7ba09d14b7787780bb443f47129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:07.698473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.699804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.701375 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4070/8149] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:07 2022] DELETE /identity/v3/projects/ab8de7ba09d14b7787780bb443f47129 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:07.705897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.707666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:07.721689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a667db-ec2c-413f-ae81-e5b2d7d5dd3a tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.795583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.796325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.796667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.797085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/roles/480a8132643b403dac017beac3a892e3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.798546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_role(role_id=480a8132643b403dac017beac3a892e3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.800288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.840171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invalidating the token cache because role 480a8132643b403dac017beac3a892e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:07.840605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.841396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.843335 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4080/8150] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:07 2022] DELETE /identity/v3/roles/480a8132643b403dac017beac3a892e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:07.848750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:07.861451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98c12-cd50-4ed1-9083-08a2f0d7b9f1 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:07.910309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:07.929893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:07.930730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:07.931138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:07.931506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/users/3ce40f8476254b5ba7855d0615193d53` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:07.932870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3ce40f8476254b5ba7855d0615193d53)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:07.935692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:07.992412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce40f8476254b5ba7855d0615193d53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.993334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce40f8476254b5ba7855d0615193d53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:07.994156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce40f8476254b5ba7855d0615193d53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.003211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce40f8476254b5ba7855d0615193d53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.012218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce40f8476254b5ba7855d0615193d53'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.035891 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4071/8151] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:07 2022] DELETE /identity/v3/users/3ce40f8476254b5ba7855d0615193d53 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:08.037268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:08.039618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:08.056941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305665-57b6-4a8e-b4b9-8f80ef81651d tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:08.130564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:08.131353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.131759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.132222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/groups/160c794590bb451e829c5d689ed50406` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.133556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_group(group_id=160c794590bb451e829c5d689ed50406)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:08.135578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:08.155790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:08.190461 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4081/8152] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Oct 28 10:33:08 2022] DELETE /identity/v3/groups/160c794590bb451e829c5d689ed50406 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:08.195472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:08.197096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:08.211511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ec29d-89a1-44f6-aaed-8059d73d2f40 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:08.279831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:08.280523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.280802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.281200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/projects/7a13d6d9cf1a4336a5ef69f819ff0141` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.282610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a13d6d9cf1a4336a5ef69f819ff0141)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:08.284608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:08.343191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a13d6d9cf1a4336a5ef69f819ff0141', 'request_id': 'req-73a8fa7e-4e47-4d71-94f8-64873f40d27e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.349975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a13d6d9cf1a4336a5ef69f819ff0141', 'request_id': 'req-73a8fa7e-4e47-4d71-94f8-64873f40d27e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.359343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a13d6d9cf1a4336a5ef69f819ff0141', 'request_id': 'req-73a8fa7e-4e47-4d71-94f8-64873f40d27e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.360705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:08.374512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] The token cache is being invalidate because project 7a13d6d9cf1a4336a5ef69f819ff0141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:08.375585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.376377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.378119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4072/8153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:08 2022] DELETE /identity/v3/projects/7a13d6d9cf1a4336a5ef69f819ff0141 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:08.382492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:08.384969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:08.398871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e45a-f7f3-42c5-825c-4ac1ee49ec2c tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:08.466871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:08.467692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.468067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.468438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/domains/6e642bda9aa04d9cb5eca13f43a28db4` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.470123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6e642bda9aa04d9cb5eca13f43a28db4)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:08.471969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:08.505001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.505707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.538014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.538738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-187bffee-ff38-4ee0-bc21-491b7f708b57 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.541627 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4082/8154] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Oct 28 10:33:08 2022] PATCH /identity/v3/domains/6e642bda9aa04d9cb5eca13f43a28db4 => generated 277 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:08.546277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:08.556936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8fa7e-4e47-4d71-94f8-64873f40d27e tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:08.634304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9dc432cd2c94faaaca71874c8571899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:08.634882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.635420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.635739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] PATH_INFO: `/v3/domains/6e642bda9aa04d9cb5eca13f43a28db4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.649093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6e642bda9aa04d9cb5eca13f43a28db4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:08.650796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:08.679562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.683336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.748122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.763761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.774498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.775815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367359-0152-4ceb-9edd-a765d2b9eeaa None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.776173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367359-0152-4ceb-9edd-a765d2b9eeaa None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.776370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36367359-0152-4ceb-9edd-a765d2b9eeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.789933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] The token cache is being invalidate because project 6e642bda9aa04d9cb5eca13f43a28db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:08.790317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.791580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.796964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-36367359-0152-4ceb-9edd-a765d2b9eeaa None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:08.798165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-36367359-0152-4ceb-9edd-a765d2b9eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:08.800799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.804964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.805762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6e642bda9aa04d9cb5eca13f43a28db4', 'request_id': 'req-fae03a5d-42a4-481f-87b5-82ffc802bc15'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.812883 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4073/8155] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:08 2022] DELETE /identity/v3/domains/6e642bda9aa04d9cb5eca13f43a28db4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:08.817393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:08.820562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:08.862346 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4083/8156] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:08.873509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:08.912817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03a5d-42a4-481f-87b5-82ffc802bc15 tempest-InheritsV3TestJSON-761160085 tempest-InheritsV3TestJSON-761160085-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:08.919237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:08.919883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:08.920162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:08.920435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] PATH_INFO: `/v3/users/9be11114082c4ce4880300bae03c16fd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:08.921615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be11114082c4ce4880300bae03c16fd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:08.923535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:08.974854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be11114082c4ce4880300bae03c16fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.975629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be11114082c4ce4880300bae03c16fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.976314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be11114082c4ce4880300bae03c16fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.985758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be11114082c4ce4880300bae03c16fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:08.993547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be11114082c4ce4880300bae03c16fd'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.013063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4074/8157] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:08 2022] DELETE /identity/v3/users/9be11114082c4ce4880300bae03c16fd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:09.018026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:09.018421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:09.018794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:09.040371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:09.041598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:09.085109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:09.110548 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4084/8158] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:09.121388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:09.122880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:09.203621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776cab2-a559-495c-a79b-48fc8b72521c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:09.207841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:09.208705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:09.209214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:09.209682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:09.219856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:09.221582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:09.236225 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4075/8159] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:09.540977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:09.542976 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:09.557456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22448b-345d-4d05-a625-b38202d0bb25 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:09.563081 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:09.563861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:09.564220 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:09.564561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] PATH_INFO: `/v3/projects/4061a7ca016b428aa843d5fc3af8b698` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:09.566559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4061a7ca016b428aa843d5fc3af8b698)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:09.568568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:09.645645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4061a7ca016b428aa843d5fc3af8b698', 'request_id': 'req-d2e2f94c-b39f-4da9-aca6-9d901b567b90'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.655553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4061a7ca016b428aa843d5fc3af8b698', 'request_id': 'req-d2e2f94c-b39f-4da9-aca6-9d901b567b90'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.664120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4061a7ca016b428aa843d5fc3af8b698', 'request_id': 'req-d2e2f94c-b39f-4da9-aca6-9d901b567b90'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.684523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] The token cache is being invalidate because project 4061a7ca016b428aa843d5fc3af8b698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:09.684863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.685585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.687756 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4085/8160] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:09 2022] DELETE /identity/v3/projects/4061a7ca016b428aa843d5fc3af8b698 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:09.692680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:09.706674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f990178-246d-40fe-8f8e-6be331bf9d62 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:09.715765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:09.717500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:09.788331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:09.802292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:09.803520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:09.804003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:09.804342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] PATH_INFO: `/v3/users/d9dc432cd2c94faaaca71874c8571899` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:09.805579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9dc432cd2c94faaaca71874c8571899)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:09.807606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:09.815672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f94c-b39f-4da9-aca6-9d901b567b90 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:09.821420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:09.822251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:09.822630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:09.823029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:09.825175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:09.841442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:09.843240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:09.857725 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4086/8161] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:09.860678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9dc432cd2c94faaaca71874c8571899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.861475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9dc432cd2c94faaaca71874c8571899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.862172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9dc432cd2c94faaaca71874c8571899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.870700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9dc432cd2c94faaaca71874c8571899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.879050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9e7d55ce-30b2-4fbf-a57d-06dbb88fb0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9dc432cd2c94faaaca71874c8571899'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:09.899254 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4076/8162] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:09 2022] DELETE /identity/v3/users/d9dc432cd2c94faaaca71874c8571899 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:10.244797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.246560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:10.264407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41be34-bbbb-4020-a4b6-93e226239bd4 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.326365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:10.335001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.336170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.336824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.337798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] PATH_INFO: `/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.341212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc1d6398d0a4c5ea7b0167a3c6718a3)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.344717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.411057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'request_id': 'req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:10.418264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'request_id': 'req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:10.426944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc1d6398d0a4c5ea7b0167a3c6718a3', 'request_id': 'req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:10.440069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] The token cache is being invalidate because project 8dc1d6398d0a4c5ea7b0167a3c6718a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:10.440354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:10.441038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-17eb7ccc-a344-4ad0-ad29-a006b3ce9271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:10.442714 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4087/8163] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:10 2022] DELETE /identity/v3/projects/8dc1d6398d0a4c5ea7b0167a3c6718a3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:10.447655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.448006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.448339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.469301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:10.470592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:10.542585 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4077/8164] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:10.555025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.555939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.556218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.581511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:10.582979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:10.593009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4088/8165] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:10.601571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.611978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f520-70ba-487c-ba4f-b91a5ecead95 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.617045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.617662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.617942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.618270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.618997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:10.619315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.621511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.636967 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4078/8166] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:10.639007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.648706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202598-8622-4370-bf09-2de79412d4ca None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.653877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.654458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.654695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.655079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.655704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.657644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.685266 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4089/8167] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:10 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:10.689461 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.700620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a870-7493-48b2-b632-1a707cb82f6b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.757697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.758319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.758600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.758873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.759498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.762081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.770679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:10.784835 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4079/8168] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:10 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:10.788770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.800257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00e308-7f9e-4d52-8dc6-9225ec9d413d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.806492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.807336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.807621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.808413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.809067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.810669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.821455 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4090/8169] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:10.826090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.836888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad55ab-c953-4a57-a8e6-68d29f49bdb0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.843697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.844318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.844596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.844933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.845536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.847143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28574af-48dc-4bc4-a72b-3fe23fe0f668 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.861700 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4080/8170] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:10.862903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:10.874176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030dbfe-2ced-4267-a57d-1e52c27c0da3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:10.884313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:10.885026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.885310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.885585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] PATH_INFO: `/v3/projects/13166dedb79746d9955691231962c505/users/576a2aa141394679b10c4f6646f6857a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.907256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13166dedb79746d9955691231962c505, user_id=576a2aa141394679b10c4f6646f6857a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:10.912114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:10.934481 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4091/8171] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:10 2022] PUT /identity/v3/projects/13166dedb79746d9955691231962c505/users/576a2aa141394679b10c4f6646f6857a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:10.945516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:10.945999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:10.946138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:10.976075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] MFA Rules not processed for user `576a2aa141394679b10c4f6646f6857a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:10.977318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:11.056928 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4081/8172] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:11.062144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.141982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85bf0e-62ac-43ce-b1ae-6a7e6c6ff9e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.153021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.153647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.153923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.154413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.155461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.157680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.201101 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4092/8173] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:11 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:11.202951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.232788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a37cd-8ca4-48c8-b700-107cd589e988 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.308671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.309493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.310030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.310387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.311110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.313250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.336988 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4082/8174] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:11 2022] POST /identity/v3/users => generated 301 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:11.341482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.352443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ed7ee-fc52-498b-bb8a-f8fb8a390d7d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.358741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.359483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.359856 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.360233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.361116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.362808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.365952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:11.378727 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4093/8175] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:11.380437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.395541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79940a3-cd8d-4008-8f09-8b435ad7e06c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.401189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.403119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.403582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.404204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] PATH_INFO: `/v3/projects/86cb1061be634ac5be0666bbac6828b6/users/51d9aa8420614e80a94c890b49622990/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.432302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cb1061be634ac5be0666bbac6828b6, user_id=51d9aa8420614e80a94c890b49622990, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.436385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.457823 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4083/8176] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:11 2022] PUT /identity/v3/projects/86cb1061be634ac5be0666bbac6828b6/users/51d9aa8420614e80a94c890b49622990/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:11.461492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.473306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9919-7bdb-4a4f-bda9-dc806ff28ac2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.543450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.544343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.544727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.545124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.546722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.547732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b919f4-9652-432a-910f-0c9198e09ce7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.563202 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4094/8177] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:11.567212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.583898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1d6a-9055-42cc-8756-d58a57bfa559 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.590827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.592480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.592983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.593503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] PATH_INFO: `/v3/projects/86cb1061be634ac5be0666bbac6828b6/users/51d9aa8420614e80a94c890b49622990/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.595859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cb1061be634ac5be0666bbac6828b6, user_id=51d9aa8420614e80a94c890b49622990, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.599833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.614537 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4084/8178] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:11 2022] PUT /identity/v3/projects/86cb1061be634ac5be0666bbac6828b6/users/51d9aa8420614e80a94c890b49622990/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:11.625122 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.627409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.627898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.670801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] MFA Rules not processed for user `51d9aa8420614e80a94c890b49622990`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:11.672491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:11.780696 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4095/8179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:11.782316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.800346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ffa28-c192-440c-abf7-ce0df421184e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.807215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.808567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.809591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.810063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects/13166dedb79746d9955691231962c505` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.812034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:get_project(project_id=13166dedb79746d9955691231962c505)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.817072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.822514 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4085/8180] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:11 2022] GET /identity/v3/projects/13166dedb79746d9955691231962c505 => generated 389 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:11.824600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.844933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac610e-48c1-4dda-8b90-d9ade2d04aad None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.862211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:11.862920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:11.863136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:11.863411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:11.864050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:11.866004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:11.925712 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4096/8181] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:33:11 2022] POST /identity/v3/projects => generated 339 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:11.927571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:11.947489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2905e-cdd1-47c7-ae9c-323500a0e745 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:11.987239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:12.064685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.065519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.065982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.066327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.068228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.071783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.108410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4086/8182] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:33:11 2022] GET /identity/v3/projects => generated 4725 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.109329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.125167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3fe6-f11a-493e-ae27-9754d70ef456 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.141772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.142445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.142727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.143002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects/13166dedb79746d9955691231962c505` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.144238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:get_project(project_id=13166dedb79746d9955691231962c505)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.146380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.151323 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4097/8183] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects/13166dedb79746d9955691231962c505 => generated 389 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:12.153247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.174669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b43b-61dc-4b44-b6eb-b1f55a0a0b2b tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.188976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.189928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.190407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.190777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects/94123b06e3b443838947dbcfe0fcfc23` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.192875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:get_project(project_id=94123b06e3b443838947dbcfe0fcfc23)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.198582 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.207258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.208847 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4087/8184] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects/94123b06e3b443838947dbcfe0fcfc23 => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:12.225238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763794e1-5795-473c-ab6a-7aeae55e6c69 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.247837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.248436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.248774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.249113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.249752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.251723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.288534 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4098/8185] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects => generated 4725 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.294117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.305662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253bd8-f5ec-400f-8842-756877332e09 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.311146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.311775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.312057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.312863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.313023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:12.313328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.315384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.360451 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4088/8186] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects?domain_id=default => generated 4394 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.365127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.378005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277209e-710c-438a-a014-56075c3cd74a tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.384579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.385404 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.385689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.385958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.386668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.388609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.408951 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4099/8187] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects => generated 4725 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.412233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.427828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadd4c7-564f-4ebc-acb6-55deca54deb6 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.442178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.442807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.443090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.443366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.444046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:12.444354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.446556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.466276 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4089/8188] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects?domain_id=default => generated 4394 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.471939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.483154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2d84-11b0-42ea-95d8-ab9ee1854006 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.488860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.489506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.489792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.490072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.490729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.492657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.516013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.516986 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4100/8189] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects => generated 4725 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:12.527854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ef7f-4b24-4c92-bb72-2702bac53d7d tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.532681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.533331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.533617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.533894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.534566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-2045952166) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:12.534872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.536727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.558596 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4090/8190] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Oct 28 10:33:12 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-2045952166 => generated 537 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:12.559880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.571053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cb13-aeaa-431f-aebe-39183f35f1cb tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.576766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9aa8420614e80a94c890b49622990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cb1061be634ac5be0666bbac6828b6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.577434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.577827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.578024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] PATH_INFO: `/v3/projects/94123b06e3b443838947dbcfe0fcfc23` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.579091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94123b06e3b443838947dbcfe0fcfc23)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.583723 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.593188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:12.645143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94123b06e3b443838947dbcfe0fcfc23', 'request_id': 'req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.652776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94123b06e3b443838947dbcfe0fcfc23', 'request_id': 'req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.662117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94123b06e3b443838947dbcfe0fcfc23', 'request_id': 'req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.686624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] The token cache is being invalidate because project 94123b06e3b443838947dbcfe0fcfc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:12.686995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.687759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-87cad88a-5bf1-4bb2-a34e-78f4e4c8b0af tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.690415 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4101/8191] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:12 2022] DELETE /identity/v3/projects/94123b06e3b443838947dbcfe0fcfc23 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:12.694321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:12.697687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:12.782084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728e64-28ad-4596-9eb9-8ff0d43a1f41 tempest-ListProjectsStaticTestJSON-1387722581 tempest-ListProjectsStaticTestJSON-1387722581-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:12.844406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:12.845079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.845360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.845628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] PATH_INFO: `/v3/users/576a2aa141394679b10c4f6646f6857a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.846999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=576a2aa141394679b10c4f6646f6857a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:12.848970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:12.864233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:12.908517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576a2aa141394679b10c4f6646f6857a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.909246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576a2aa141394679b10c4f6646f6857a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.909825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576a2aa141394679b10c4f6646f6857a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.917694 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576a2aa141394679b10c4f6646f6857a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.925308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576a2aa141394679b10c4f6646f6857a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:12.947315 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4091/8192] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:12 2022] DELETE /identity/v3/users/576a2aa141394679b10c4f6646f6857a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:12.952626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:12.952984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:12.953298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:12.975758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:12.977124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:13.043348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4102/8193] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:13.053627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:13.055232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:13.129130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa51d-cc0d-4750-8c12-35f7243b03bf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:13.133371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:13.134140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:13.134575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:13.134851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:13.146387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:13.148006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:13.160478 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4092/8194] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:13.752442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:13.755146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:13.795415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4f09-15e3-4e8f-84a3-a620fdab063b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:13.801566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:13.802526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:13.803018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:13.803927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] PATH_INFO: `/v3/projects/13166dedb79746d9955691231962c505` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:13.805378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13166dedb79746d9955691231962c505)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:13.808121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:13.874633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13166dedb79746d9955691231962c505', 'request_id': 'req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:13.883255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13166dedb79746d9955691231962c505', 'request_id': 'req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:13.904635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13166dedb79746d9955691231962c505', 'request_id': 'req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:13.927068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] The token cache is being invalidate because project 13166dedb79746d9955691231962c505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:13.927559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:13.928204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:13.930186 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4103/8195] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:13 2022] DELETE /identity/v3/projects/13166dedb79746d9955691231962c505 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:13.934270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:13.955733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609047d-5dbd-413b-bae8-a28b6a2a321d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:14.025075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:14.026001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.026552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.027712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] PATH_INFO: `/v3/users/51d9aa8420614e80a94c890b49622990` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.029460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d9aa8420614e80a94c890b49622990)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:14.031621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:14.076758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:14.087541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d9aa8420614e80a94c890b49622990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.088641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d9aa8420614e80a94c890b49622990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.090068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d9aa8420614e80a94c890b49622990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.098192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d9aa8420614e80a94c890b49622990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.105825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1e7d4f58-4aba-4f8b-878f-3b472224a757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d9aa8420614e80a94c890b49622990'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.124168 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4093/8196] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:13 2022] DELETE /identity/v3/users/51d9aa8420614e80a94c890b49622990 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:14.425579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:14.427060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:14.463959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e800ab-97d7-49b1-bfef-bc06f3a2f3e3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:14.482789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:14.530877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:14.531669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.531946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.532217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] PATH_INFO: `/v3/projects/86cb1061be634ac5be0666bbac6828b6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.533387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cb1061be634ac5be0666bbac6828b6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:14.535313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:14.625832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cb1061be634ac5be0666bbac6828b6', 'request_id': 'req-16cf9ba0-8104-4d62-8821-3b306386c139'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.632855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cb1061be634ac5be0666bbac6828b6', 'request_id': 'req-16cf9ba0-8104-4d62-8821-3b306386c139'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.658055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cb1061be634ac5be0666bbac6828b6', 'request_id': 'req-16cf9ba0-8104-4d62-8821-3b306386c139'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.685423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] The token cache is being invalidate because project 86cb1061be634ac5be0666bbac6828b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:14.686268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.686955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-16cf9ba0-8104-4d62-8821-3b306386c139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:14.688759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4104/8197] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:14 2022] DELETE /identity/v3/projects/86cb1061be634ac5be0666bbac6828b6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:14.693911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.694286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.694475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.724515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:14.733680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:14.806077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4094/8198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:14.902042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.902707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.902707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.927304 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:14.928548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:14.937223 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4105/8199] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:14.941800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:14.952470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482a9c6-310e-4794-a192-e761bc7cfce3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:14.957410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:14.958021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.958331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.958763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.959420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:14.959720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:14.961780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:14.977684 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4095/8200] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:14.978771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:14.989331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5955-8b2d-4092-9753-95eb13b5529e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:14.994596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:14.995199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:14.996044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:14.996312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:14.997012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:14.998865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.026329 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4106/8201] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:14 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:15.030726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.041675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb501b-5e0e-48ca-bdda-26f8dfa32c0a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.102648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.103341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.103522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.103794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.104430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.107029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.128995 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4096/8202] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:15.133129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.143472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfe0f7-9b6e-4b19-a1f5-a363d8f210c3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.148058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.148661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.148965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.149271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.149871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.151477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.163239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4107/8203] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:15.167070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.178557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d1008-441f-4c49-8ab5-62fdeb07d4af admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.183217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.183818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.184096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.184379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.185035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.186624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f5cb-5980-4363-a441-56d61e929f04 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.197713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4097/8204] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:15.202096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.212570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145cbe2-38d8-4717-b734-ff58ebdd437f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.218634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.219355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.219633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.219905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] PATH_INFO: `/v3/projects/b53fafb0541b47908b912c3cf95c7a94/users/abb457781eab4532a99dc79fe8345a9b/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.235397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53fafb0541b47908b912c3cf95c7a94, user_id=abb457781eab4532a99dc79fe8345a9b, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.238134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.250692 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4108/8205] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:15 2022] PUT /identity/v3/projects/b53fafb0541b47908b912c3cf95c7a94/users/abb457781eab4532a99dc79fe8345a9b/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:15.260567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.260867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.261253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.289823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] MFA Rules not processed for user `abb457781eab4532a99dc79fe8345a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:15.291032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:15.300001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:15.358028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4098/8206] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:15.362494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.412126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:15.428933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28fd8-5bb3-4f35-80e0-af6ab2efbaa2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.433569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.434168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.434450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.434714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.435332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.437406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.465753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4109/8207] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:15.469836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.480928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7518-1242-42ce-b63d-de1a0ae76631 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.541807 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.542414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.542687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.542950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.543581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.545521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.569846 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4099/8208] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:15.571372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.587308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78579-849b-478f-a140-1f7d71d091df admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.592629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.593317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.593602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.593877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.594577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.596315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.607889 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4110/8209] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:15.612279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.622689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd018a0-c330-495c-a190-745e9fc03748 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.627376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.628025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.628307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.628579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] PATH_INFO: `/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426/users/29243cfe1a5d49828643d999ba6ff9de/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.644124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbb241ebf1a4e1faae0aced5d1cf426, user_id=29243cfe1a5d49828643d999ba6ff9de, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.646829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.661908 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4100/8210] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:15 2022] PUT /identity/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426/users/29243cfe1a5d49828643d999ba6ff9de/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:15.666048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.676592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f966-fddc-4d29-9b41-c163374bb602 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.737463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.737990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.738263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.738533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.739166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.740762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92f4f0-4e86-4f07-b1fa-e0ef87faa697 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.751129 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4111/8211] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:15.755300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.768657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dca319-4d7f-4818-9e41-dd8d28c5c54c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.773682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.774402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.774687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.774965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] PATH_INFO: `/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426/users/29243cfe1a5d49828643d999ba6ff9de/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.777468 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbb241ebf1a4e1faae0aced5d1cf426, user_id=29243cfe1a5d49828643d999ba6ff9de, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.780092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:15.791458 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4101/8212] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:15 2022] PUT /identity/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426/users/29243cfe1a5d49828643d999ba6ff9de/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:15.801487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.801776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.802051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.852794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] MFA Rules not processed for user `29243cfe1a5d49828643d999ba6ff9de`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:15.854127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:15.945814 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4112/8213] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:15.951289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:15.970708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f235e-2936-4e84-8493-266111b88e4c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:15.977444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:15.978149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:15.978519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:15.978864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:15.980546 n-d-zed-1 devstack@keystone.service[88451]: WARNING oslo_log.versionutils [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:15.981137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:15.982451 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:15.982451 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:33:15.982451 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:33:15.983723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.027901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.028288 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4102/8214] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:33:15 2022] POST /identity/v3/policies => generated 230 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:16.038028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea61a4-4c15-4863-adb9-be0fe85d369c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.043445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.044093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.044399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.044681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.045681 n-d-zed-1 devstack@keystone.service[88452]: WARNING oslo_log.versionutils [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.046175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=15c7c4f251214df1a392d27a9ce0c9bd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.047779 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.047779 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:33:16.047779 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:33:16.048476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.072503 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4113/8215] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Oct 28 10:33:16 2022] PATCH /identity/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd => generated 237 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:16.076686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.088482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc0bd-9997-4825-a708-b3ded67ea7e7 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.093702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.094332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.094608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.094878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.095642 n-d-zed-1 devstack@keystone.service[88451]: WARNING oslo_log.versionutils [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.096213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=15c7c4f251214df1a392d27a9ce0c9bd)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.097469 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.097469 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:33:16.097469 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:33:16.098350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.108753 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4103/8216] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:33:16 2022] GET /identity/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd => generated 237 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:16.113377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.123845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e122c-4866-4262-b83c-8317b73ff472 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.128461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.129126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.129405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.129672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.130427 n-d-zed-1 devstack@keystone.service[88452]: WARNING oslo_log.versionutils [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.130974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=15c7c4f251214df1a392d27a9ce0c9bd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.132851 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.132851 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:33:16.132851 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:33:16.133765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.150565 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4114/8217] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:16 2022] DELETE /identity/v3/policies/15c7c4f251214df1a392d27a9ce0c9bd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:16.156479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.168196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831263e-7150-49f1-b2e4-1337a53702b8 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.173636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.174241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.174517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.174785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.175934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.177933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.197697 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4104/8218] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:33:16 2022] POST /identity/v3/policies => generated 229 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:16.202533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.213284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0b2a-2b52-41af-b614-847c348d543b tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.217993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.218592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.218870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.219144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.220027 n-d-zed-1 devstack@keystone.service[88452]: WARNING oslo_log.versionutils [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.220510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.221766 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.221766 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:33:16.221766 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:33:16.222647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.233894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:16.248587 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4115/8219] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:33:16 2022] POST /identity/v3/policies => generated 228 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:16.250304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.262728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c659c4c-14ce-451d-b124-05d1155e7bad tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.267445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.268057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.268343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.268616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.269769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.271587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.292992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4105/8220] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Oct 28 10:33:16 2022] POST /identity/v3/policies => generated 228 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:16.294646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.305674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e288ea-77a3-43c0-b7d7-77265319a649 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.310950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.311553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.311835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.312116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.312874 n-d-zed-1 devstack@keystone.service[88452]: WARNING oslo_log.versionutils [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.313481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.314714 n-d-zed-1 devstack@keystone.service[88452]: WARNING py.warnings [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.314714 n-d-zed-1 devstack@keystone.service[88452]: warnings.warn(msg) Oct 28 10:33:16.314714 n-d-zed-1 devstack@keystone.service[88452]: Oct 28 10:33:16.315606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.325245 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4116/8221] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Oct 28 10:33:16 2022] GET /identity/v3/policies => generated 761 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:16.329507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.340189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc38fe-36ae-4c98-b5e1-c32cba4db5da tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.344991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.345625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.345908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.346181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/d425e4f8d9df4c6ca931cc47ad11fd1e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.346950 n-d-zed-1 devstack@keystone.service[88451]: WARNING oslo_log.versionutils [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 28 10:33:16.347504 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d425e4f8d9df4c6ca931cc47ad11fd1e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.348732 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:33:16.348732 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(msg) Oct 28 10:33:16.348732 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:33:16.349650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.360330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=8,keystone:DELETE=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:16.370463 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4106/8222] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:16 2022] DELETE /identity/v3/policies/d425e4f8d9df4c6ca931cc47ad11fd1e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:16.372765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.384679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbb26c-8600-4617-a092-10f60c98caa6 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.390104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.391032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.391032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.391296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/4a636d0c743e484fb04d3c96dfaf9798` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.392325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=4a636d0c743e484fb04d3c96dfaf9798)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.394343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.412231 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4117/8223] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:16 2022] DELETE /identity/v3/policies/4a636d0c743e484fb04d3c96dfaf9798 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:16.416414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.428197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc120-004e-4a81-a450-ff8202f92283 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.433737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29243cfe1a5d49828643d999ba6ff9de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adbb241ebf1a4e1faae0aced5d1cf426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.434379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.434662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.434939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] PATH_INFO: `/v3/policies/e8433c1d80cf4ade957fa65d4657479c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.435964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e8433c1d80cf4ade957fa65d4657479c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.437798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78126b-e34a-4b08-b929-7c76b233ff82 tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.453405 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4107/8224] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:16 2022] DELETE /identity/v3/policies/e8433c1d80cf4ade957fa65d4657479c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:16.458902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.529254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba98ab-864c-446b-9ba6-ed20f1b67e6d tempest-PoliciesTestJSON-1510132691 tempest-PoliciesTestJSON-1510132691-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.534107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.534760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.535042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.535315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] PATH_INFO: `/v3/users/abb457781eab4532a99dc79fe8345a9b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.536482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb457781eab4532a99dc79fe8345a9b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.538596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.608547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb457781eab4532a99dc79fe8345a9b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:16.609395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb457781eab4532a99dc79fe8345a9b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:16.619461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb457781eab4532a99dc79fe8345a9b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:16.628181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb457781eab4532a99dc79fe8345a9b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:16.629271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb457781eab4532a99dc79fe8345a9b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:16.654657 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4118/8225] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:16 2022] DELETE /identity/v3/users/abb457781eab4532a99dc79fe8345a9b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:16.659368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.659725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.660005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.682689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:16.684776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:16.749648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4108/8226] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:16.760874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:16.762812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:16.830044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9b48-6ab2-4f0e-9cec-3d78936e5a8b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:16.834772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:16.835460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:16.835727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:16.836010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:16.844607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:16.847249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:16.849018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:16.865607 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4119/8227] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:17.173347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:17.175032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:17.193773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64b5a-9880-4e84-9576-d1bf3e49812c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:17.204797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:17.205496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:17.205835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:17.206047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] PATH_INFO: `/v3/projects/b53fafb0541b47908b912c3cf95c7a94` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:17.207177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53fafb0541b47908b912c3cf95c7a94)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:17.209119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:17.263595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53fafb0541b47908b912c3cf95c7a94', 'request_id': 'req-017567bc-c0db-419a-9de7-2aba5b48b8c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.270016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53fafb0541b47908b912c3cf95c7a94', 'request_id': 'req-017567bc-c0db-419a-9de7-2aba5b48b8c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.278063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53fafb0541b47908b912c3cf95c7a94', 'request_id': 'req-017567bc-c0db-419a-9de7-2aba5b48b8c0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.289613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] The token cache is being invalidate because project b53fafb0541b47908b912c3cf95c7a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:17.289902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.290540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.292142 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4109/8228] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:17 2022] DELETE /identity/v3/projects/b53fafb0541b47908b912c3cf95c7a94 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:17.296660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:17.306578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fb9b-a87c-47e6-9df1-d03a39daee04 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:17.366697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:17.367250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:17.367576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:17.367877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] PATH_INFO: `/v3/users/29243cfe1a5d49828643d999ba6ff9de` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:17.369060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=29243cfe1a5d49828643d999ba6ff9de)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:17.371015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:17.419947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29243cfe1a5d49828643d999ba6ff9de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.420607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29243cfe1a5d49828643d999ba6ff9de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.429553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29243cfe1a5d49828643d999ba6ff9de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.438229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29243cfe1a5d49828643d999ba6ff9de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.438941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-56d6e916-2ddc-4c79-b93f-c350f9aff3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29243cfe1a5d49828643d999ba6ff9de'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.459250 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4120/8229] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:17 2022] DELETE /identity/v3/users/29243cfe1a5d49828643d999ba6ff9de => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:17.744522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:17.746130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:17.762555 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017567bc-c0db-419a-9de7-2aba5b48b8c0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:17.823410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:17.824591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:17.824849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:17.825145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] PATH_INFO: `/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:17.826263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbb241ebf1a4e1faae0aced5d1cf426)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:17.828148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:17.836327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:17.877791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbb241ebf1a4e1faae0aced5d1cf426', 'request_id': 'req-8f9d5bba-7818-42c9-b7cf-0d8086dec272'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.883520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbb241ebf1a4e1faae0aced5d1cf426', 'request_id': 'req-8f9d5bba-7818-42c9-b7cf-0d8086dec272'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.891703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbb241ebf1a4e1faae0aced5d1cf426', 'request_id': 'req-8f9d5bba-7818-42c9-b7cf-0d8086dec272'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.904744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] The token cache is being invalidate because project adbb241ebf1a4e1faae0aced5d1cf426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:17.905652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.906502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f9d5bba-7818-42c9-b7cf-0d8086dec272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:17.908792 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4110/8230] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:17 2022] DELETE /identity/v3/projects/adbb241ebf1a4e1faae0aced5d1cf426 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:17.913914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:17.914406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:17.914769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:17.934833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:17.936486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:18.001769 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4121/8231] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:18.010473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.010829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.011695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.033295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:18.034536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:18.042955 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4111/8232] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:18.047104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.057063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f48e9-89c3-4f2d-a9ec-7712df3f51ca None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.061612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.062217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.062489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.062750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.063382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:18.063674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.065403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.082058 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4122/8233] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:18.086422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.097292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ec800-545c-482c-b8af-32e85ef9a0de None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.102079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.102751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.103100 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.103442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.104136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.106647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.139323 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4112/8234] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:18.143412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.148585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:18.155519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7cf2-ddcf-44d7-b75e-fd1255065cb7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.220420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.221371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.221651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.221919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.222566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.224733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.250675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4123/8235] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:18.255194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.267307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07671a-06c2-4763-910f-2bca504cd742 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.274713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.275674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.276004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.276210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.277045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.278615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.290161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4113/8236] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:18.294639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.305677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51d6d-e3d8-43ad-8d81-a111b5af6802 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.311140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.311749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.312022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.312283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.312925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.314682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f4f32-9028-40ed-ac85-47b55ea45085 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.327945 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4124/8237] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:18.331825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.342937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8d1c-d2f7-44d6-a128-3ba2b077a59b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.347973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.348812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.349007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.349189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] PATH_INFO: `/v3/projects/3b30e2ad4b0f4dbdb2a64f2d4bac230a/users/ae242b58c7914ea592f41348564cc962/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.364869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b30e2ad4b0f4dbdb2a64f2d4bac230a, user_id=ae242b58c7914ea592f41348564cc962, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.367593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.381193 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4114/8238] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:18 2022] PUT /identity/v3/projects/3b30e2ad4b0f4dbdb2a64f2d4bac230a/users/ae242b58c7914ea592f41348564cc962/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:18.392115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.392336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.392611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.420139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] MFA Rules not processed for user `ae242b58c7914ea592f41348564cc962`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:18.421387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:18.487324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4125/8239] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:18.491877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.555056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7a18-594b-4366-9cb2-1369022e3749 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.561340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.562212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.562481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.562753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.563696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.566266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.609019 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4115/8240] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:18.610502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.622181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522a00-da71-49ad-b808-1a7e7167c6e3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.678305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.678911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.679191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.679462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.680097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.682058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.700232 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:18.708928 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4126/8241] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:18.711996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.724005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f79f-3a1f-4121-afd7-13b80b5c2efa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.728847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.729488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.730264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.730541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.731170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.732881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.744003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4116/8242] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:18.748714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.759075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d1e4-bc79-41f2-8b0a-0f928fdcb4f7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.763908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.764563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.764841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.765174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] PATH_INFO: `/v3/projects/b07bccfceec745b1b5091a4a924be15e/users/d09501aac9a74b32997cd13c035ed170/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.780418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07bccfceec745b1b5091a4a924be15e, user_id=d09501aac9a74b32997cd13c035ed170, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.783109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.797380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4127/8243] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:18 2022] PUT /identity/v3/projects/b07bccfceec745b1b5091a4a924be15e/users/d09501aac9a74b32997cd13c035ed170/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:18.801256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.811804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea2213-5e94-4a02-9b63-a6c2b5de5307 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.815366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:18.873095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.874017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.874295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.874567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.875204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.876786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5b15-3d1e-46d6-890a-430e675dc4fe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.886570 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4117/8244] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:18.890812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:18.901480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc07f-b097-47e0-b360-0f22baee8d50 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:18.908588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:18.909488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.909799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.910073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] PATH_INFO: `/v3/projects/b07bccfceec745b1b5091a4a924be15e/users/d09501aac9a74b32997cd13c035ed170/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.912069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07bccfceec745b1b5091a4a924be15e, user_id=d09501aac9a74b32997cd13c035ed170, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:18.914798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:18.926899 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4128/8245] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:18 2022] PUT /identity/v3/projects/b07bccfceec745b1b5091a4a924be15e/users/d09501aac9a74b32997cd13c035ed170/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:18.937871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:18.938092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:18.938368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:18.970270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] MFA Rules not processed for user `d09501aac9a74b32997cd13c035ed170`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:18.971459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:19.043812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4118/8246] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:19.048802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.060019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be9dee-e381-4149-804d-537f5a379d69 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.064743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.065394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.065673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.065946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.066615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.068488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.103723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4129/8247] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:19 2022] POST /identity/v3/projects => generated 360 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:19.108485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.118213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03796a-1bf7-450e-8717-0ace4c611be0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.177648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.178295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.178574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.178846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1446352055` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.180010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=b64da1b577164ae6adff4692d513bfdb, value=tempest-tag-1446352055)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.182185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.216769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:19.236076 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1446352055. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:33:19.236076 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:33:19.236076 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:33:19.242207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4119/8248] 10.222.0.16 () {60 vars in 1333 bytes} [Fri Oct 28 10:33:19 2022] PUT /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1446352055 => generated 0 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 28 10:33:19.246433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.257891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0210e7-0a43-48f0-9478-fd6e59eb8a82 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.263494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.264207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.264568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.264897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1446352055` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.276271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=b64da1b577164ae6adff4692d513bfdb, value=tempest-tag-1446352055)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.279190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.290034 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4130/8249] 10.222.0.16 () {58 vars in 1314 bytes} [Fri Oct 28 10:33:19 2022] GET /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1446352055 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:19.294135 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.304273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbb3c-a4bf-4b21-b5e1-24a6a8c31f1e tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.308879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.309535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.309811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.310080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.311254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=b64da1b577164ae6adff4692d513bfdb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.313392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.359971 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4120/8250] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 10:33:19 2022] PUT /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags => generated 142 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:19.364092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.375923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8cde7-1099-40cd-af79-22e8ec56105d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.380842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.381677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.381824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.382031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.393984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=b64da1b577164ae6adff4692d513bfdb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.396043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.413074 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4131/8251] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:33:19 2022] GET /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags => generated 142 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:19.418380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.429204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc9c1-81ae-4953-a15b-53e9ee42ef19 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.434419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.435077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.435361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.435641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1926329924` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.436800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=b64da1b577164ae6adff4692d513bfdb, value=tempest-tag-1926329924)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.439020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.485436 n-d-zed-1 devstack@keystone.service[88451]: WARNING py.warnings [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1926329924. To ensure interoperability, identifiers should be a valid uuid. Oct 28 10:33:19.485436 n-d-zed-1 devstack@keystone.service[88451]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 28 10:33:19.485436 n-d-zed-1 devstack@keystone.service[88451]: Oct 28 10:33:19.491549 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4121/8252] 10.222.0.16 () {58 vars in 1317 bytes} [Fri Oct 28 10:33:19 2022] DELETE /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1926329924 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:19.495326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.506037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a121b6-6b0d-443b-8c56-42cbb3be1b9d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.511657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.514774 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.515145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.515493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1926329924` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.527802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=b64da1b577164ae6adff4692d513bfdb, value=tempest-tag-1926329924)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.530031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Could not find project tag: tempest-tag-1926329924.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1926329924. Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 28 10:33:19.545849 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1926329924. Oct 28 10:33:19.546845 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:19.548018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4132/8253] 10.222.0.16 () {58 vars in 1314 bytes} [Fri Oct 28 10:33:19 2022] GET /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags/tempest-tag-1926329924 => generated 107 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 28 10:33:19.551401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.562264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e10f58-d27d-43b9-bfc4-321322723c02 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.568529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.569407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.569693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.569972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.571441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=b64da1b577164ae6adff4692d513bfdb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.574212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.618103 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4122/8254] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:33:19 2022] DELETE /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:19.622783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.633058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea01f-c473-465b-be63-f0c2cfe2045d tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.638355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.638982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.639264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.639536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.651233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=b64da1b577164ae6adff4692d513bfdb)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.653493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.664567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4133/8255] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:33:19 2022] GET /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb/tags => generated 66 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 28 10:33:19.668868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.679082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383988-1d44-4119-ab22-741f0bbadab6 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.684233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd09501aac9a74b32997cd13c035ed170', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07bccfceec745b1b5091a4a924be15e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.684860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.685166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.685435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] PATH_INFO: `/v3/projects/b64da1b577164ae6adff4692d513bfdb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.686549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b64da1b577164ae6adff4692d513bfdb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.688431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.736655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64da1b577164ae6adff4692d513bfdb', 'request_id': 'req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.742493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64da1b577164ae6adff4692d513bfdb', 'request_id': 'req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.750843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64da1b577164ae6adff4692d513bfdb', 'request_id': 'req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.764400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] The token cache is being invalidate because project b64da1b577164ae6adff4692d513bfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:19.764695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.765439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-e2955aa9-3a23-46d9-9993-fdbeaff6bfbe tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.766972 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4123/8256] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:19 2022] DELETE /identity/v3/projects/b64da1b577164ae6adff4692d513bfdb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:19.772421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:19.774439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:19.844445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2e25-ebe5-4805-b1ba-6364ccc47269 tempest-IdentityV3ProjectTagsTest-49723663 tempest-IdentityV3ProjectTagsTest-49723663-project-admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:19.861452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:19.905068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:19.905722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.905981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.906256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] PATH_INFO: `/v3/users/ae242b58c7914ea592f41348564cc962` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:19.907451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae242b58c7914ea592f41348564cc962)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:19.909516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:19.957071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae242b58c7914ea592f41348564cc962'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.958318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae242b58c7914ea592f41348564cc962'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.966501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae242b58c7914ea592f41348564cc962'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.973771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae242b58c7914ea592f41348564cc962'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.974866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae242b58c7914ea592f41348564cc962'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:19.993138 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4134/8257] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:19 2022] DELETE /identity/v3/users/ae242b58c7914ea592f41348564cc962 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:19.999299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:19.999902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:19.999902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:20.019798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:20.021034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:20.026284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:20.086353 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4124/8258] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:20.096230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:20.097639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:20.158241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9f97-0dd1-4346-b18d-86d1c4026fd1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:20.161898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:20.162502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:20.162781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:20.163055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:20.173227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:20.174669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:20.184944 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4135/8259] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:20.461451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:20.463076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:20.476855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a05f11-0ee0-4df7-9034-9f6e5838406c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:20.482530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:20.483170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:20.483539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:20.483718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] PATH_INFO: `/v3/projects/3b30e2ad4b0f4dbdb2a64f2d4bac230a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:20.484866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b30e2ad4b0f4dbdb2a64f2d4bac230a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:20.487130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:20.535753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b30e2ad4b0f4dbdb2a64f2d4bac230a', 'request_id': 'req-91dd7fba-abda-49e5-8105-27b936cf7f5e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.541458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b30e2ad4b0f4dbdb2a64f2d4bac230a', 'request_id': 'req-91dd7fba-abda-49e5-8105-27b936cf7f5e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.549949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b30e2ad4b0f4dbdb2a64f2d4bac230a', 'request_id': 'req-91dd7fba-abda-49e5-8105-27b936cf7f5e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.561766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] The token cache is being invalidate because project 3b30e2ad4b0f4dbdb2a64f2d4bac230a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:20.562102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.562792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.564307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4125/8260] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:20 2022] DELETE /identity/v3/projects/3b30e2ad4b0f4dbdb2a64f2d4bac230a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:20.568346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:20.581568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885072a-6874-4791-929e-7b8ec1463e38 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:20.641330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:20.671369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:20.672191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:20.672482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:20.672760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] PATH_INFO: `/v3/users/d09501aac9a74b32997cd13c035ed170` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:20.674009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09501aac9a74b32997cd13c035ed170)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:20.675987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:20.733051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09501aac9a74b32997cd13c035ed170'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.733775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09501aac9a74b32997cd13c035ed170'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.749706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09501aac9a74b32997cd13c035ed170'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.758970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09501aac9a74b32997cd13c035ed170'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.759807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c0d45c9f-1d2d-4225-a4cf-6dc2ecc03384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09501aac9a74b32997cd13c035ed170'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:20.783207 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4136/8261] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:20 2022] DELETE /identity/v3/users/d09501aac9a74b32997cd13c035ed170 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:21.085317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.087608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:21.106420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd7fba-abda-49e5-8105-27b936cf7f5e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.162487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.163115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.163396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.163667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] PATH_INFO: `/v3/projects/b07bccfceec745b1b5091a4a924be15e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.164781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07bccfceec745b1b5091a4a924be15e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.166722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.203908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:21.215859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07bccfceec745b1b5091a4a924be15e', 'request_id': 'req-ca69a3dc-a1db-4393-9192-731f0c91f140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:21.221383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07bccfceec745b1b5091a4a924be15e', 'request_id': 'req-ca69a3dc-a1db-4393-9192-731f0c91f140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:21.228502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07bccfceec745b1b5091a4a924be15e', 'request_id': 'req-ca69a3dc-a1db-4393-9192-731f0c91f140'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:21.240379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] The token cache is being invalidate because project b07bccfceec745b1b5091a4a924be15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:21.240671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:21.241455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ca69a3dc-a1db-4393-9192-731f0c91f140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:21.242943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4126/8262] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:21 2022] DELETE /identity/v3/projects/b07bccfceec745b1b5091a4a924be15e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:21.248692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.249015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.249307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.269297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:21.270487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:21.329401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4137/8263] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:21.337085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.337364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.337631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.358710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:21.359884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:21.367840 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4127/8264] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:21.372268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.381937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1072f4-8abe-4cc1-951d-f244475fd7c0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.386519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.387113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.387393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.387665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.388311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:21.388614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.390244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.402497 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4138/8265] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:21.406660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.415989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0dbb-6a5a-49cb-92aa-d01961d85052 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.421251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.421838 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.422138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.422402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.423048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.424932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.452232 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4128/8266] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:21.456020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.466583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798db3-d382-4e13-9028-a0db9d36dc7c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.510508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:21.524141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.524747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.525054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.525329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.525961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.528440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.549483 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4139/8267] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:21.553746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.564339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4d199-574c-4da4-b3db-9154d6d23035 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.569367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.569971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.570252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.570797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.571436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.573126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.583752 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4129/8268] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:21.587729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.599369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc2715-ff55-457c-892c-89f377f82aee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.604012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.604608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.604938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.605198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.605835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.607424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628307ce-a7ac-4b09-8364-08eef6796a48 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.619375 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4140/8269] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:21.624062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.634304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380603-0ddc-4003-8ae1-d6233ba6a100 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.639705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.640361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.640644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.640925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] PATH_INFO: `/v3/projects/9785fe6cc2a143b99245cd0e608e0223/users/9028ee75622f4559bad0e55a2feb7488/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.656097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9785fe6cc2a143b99245cd0e608e0223, user_id=9028ee75622f4559bad0e55a2feb7488, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.658793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.671396 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4130/8270] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:21 2022] PUT /identity/v3/projects/9785fe6cc2a143b99245cd0e608e0223/users/9028ee75622f4559bad0e55a2feb7488/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:21.681584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.681870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.682143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.710034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] MFA Rules not processed for user `9028ee75622f4559bad0e55a2feb7488`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:21.711255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:21.774753 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4141/8271] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:21.780375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.790557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302541ea-9d92-4ad8-8cff-0a758ba9e43d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.794828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.795458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.795744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.796016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.796679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:create_application_credential(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.797952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.879230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4131/8272] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:33:21 2022] POST /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials => generated 920 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:21.883281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.892709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ad509-8205-485a-8496-8ba796241ee9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.897358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.898052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.898337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.898634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/2e9a5c4bf77c419f88cef95c87915c02` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:21.899784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:delete_access_rule(user_id=9028ee75622f4559bad0e55a2feb7488, access_rule_id=2e9a5c4bf77c419f88cef95c87915c02)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:21.911033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application session.delete(ref) Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application yield resource Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application next(self.gen) Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:33:21.966381 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise self.value Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application session.commit() Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.session.flush() Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 10:33:21.967805 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application compat.raise_( Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self._synchronize( Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise AssertionError( Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 28 10:33:21.969097 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:21.970392 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 28 10:33:21.971710 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:21.972122 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4142/8273] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Oct 28 10:33:21 2022] DELETE /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/2e9a5c4bf77c419f88cef95c87915c02 => generated 89 bytes in 89 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 28 10:33:21.976256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:21.986086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27696fd6-fc41-4783-acfb-7114ec1a859e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:21.990328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:21.990970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:21.991253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:21.991556 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials/49bbe98979fc4b228d90cd9db50be9f7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.003859 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9028ee75622f4559bad0e55a2feb7488, application_credential_id=49bbe98979fc4b228d90cd9db50be9f7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.005476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.027239 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4132/8274] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 10:33:21 2022] DELETE /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials/49bbe98979fc4b228d90cd9db50be9f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:22.031272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.040771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd3641-8cac-4b18-ab4e-c03c50c6c4c1 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.044932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.045570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.045852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.046124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.047292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:list_access_rules(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.048770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.054137 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4143/8275] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:33:22 2022] GET /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules => generated 369 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:22.059079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.070140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a0b7-032e-43dd-91dd-52c6d3ec811f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.076035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.077002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.077228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.077382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/2e9a5c4bf77c419f88cef95c87915c02` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.078639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:delete_access_rule(user_id=9028ee75622f4559bad0e55a2feb7488, access_rule_id=2e9a5c4bf77c419f88cef95c87915c02)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.079989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.082963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=8,keystone:SELECT=85,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:22.102479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4133/8276] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Oct 28 10:33:22 2022] DELETE /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/2e9a5c4bf77c419f88cef95c87915c02 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:22.107008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.116620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61906f5a-b5db-4a1e-9e22-cf01009d0d98 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.121433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.122142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.122494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.122836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.124169 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:list_access_rules(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.125754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.130559 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4144/8277] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:33:22 2022] GET /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules => generated 158 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:22.137131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.146760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c6c0-7094-4cbc-8aee-eb2630e99b26 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.151109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.151810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.152124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.152398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.153192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:create_application_credential(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.154369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.236386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4134/8278] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:33:22 2022] POST /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials => generated 920 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:22.237627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.247937 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85297-2c8a-4f93-88ef-7ce8ca6fa07e tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.252162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.252782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.253103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.253376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.254527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:list_access_rules(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.255995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.265467 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4145/8279] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:33:22 2022] GET /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules => generated 369 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:22.266638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.276915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342bbfb-cb8c-4a72-9f65-1ed3d0e3fc54 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.281203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.281837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.282120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.282392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.283099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:create_application_credential(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.284239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.362607 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4135/8280] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Oct 28 10:33:22 2022] POST /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/application_credentials => generated 921 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:22.366726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.377398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5901d-a6cf-4e17-bbcd-1dfb47c578f7 tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.381985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9028ee75622f4559bad0e55a2feb7488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9785fe6cc2a143b99245cd0e608e0223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.382569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.382854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.383137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/c9579d1c185a4a998864c8755c5cfcee` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.384313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorizing `identity:get_access_rule(user_id=9028ee75622f4559bad0e55a2feb7488, access_rule_id=c9579d1c185a4a998864c8755c5cfcee)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.385890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6f6e-db02-45f7-8f3e-8b13dd107f1f tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.393046 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4146/8281] 10.222.0.16 () {58 vars in 1359 bytes} [Fri Oct 28 10:33:22 2022] GET /identity/v3/users/9028ee75622f4559bad0e55a2feb7488/access_rules/c9579d1c185a4a998864c8755c5cfcee => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:22.397802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.617235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9e32-2b3d-4335-88ee-48ff6a0880fc tempest-AccessRulesV3Test-230153845 tempest-AccessRulesV3Test-230153845-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.617235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.617235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] PATH_INFO: `/v3/users/9028ee75622f4559bad0e55a2feb7488` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9028ee75622f4559bad0e55a2feb7488)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=1,keystone:INSERT=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:22.622717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9028ee75622f4559bad0e55a2feb7488'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:22.623442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9028ee75622f4559bad0e55a2feb7488'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:22.623442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9028ee75622f4559bad0e55a2feb7488'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:22.623442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9028ee75622f4559bad0e55a2feb7488'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:22.623442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9028ee75622f4559bad0e55a2feb7488'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:22.631513 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4136/8282] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:22 2022] DELETE /identity/v3/users/9028ee75622f4559bad0e55a2feb7488 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:22.636676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.637195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.637323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.656726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:22.657977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:22.723505 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4147/8283] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:22.733403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:22.734812 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:22.805977 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cf30e-1723-4ec3-802a-8250f94d2aa4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:22.810511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:22.811117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:22.811424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:22.811866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:22.821500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:22.822914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2c31-9194-493b-9a39-8e68da53a538 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:22.833120 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4137/8284] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:23.231523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.233178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:23.246595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e075c-d540-4ec8-b9ed-a4c437b76002 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.251336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.251836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.252113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.252387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] PATH_INFO: `/v3/projects/9785fe6cc2a143b99245cd0e608e0223` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.253555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9785fe6cc2a143b99245cd0e608e0223)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.255430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.262880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:23.322623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9785fe6cc2a143b99245cd0e608e0223', 'request_id': 'req-59743851-bd0c-4282-922e-f1b62ed9a94f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:23.328305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9785fe6cc2a143b99245cd0e608e0223', 'request_id': 'req-59743851-bd0c-4282-922e-f1b62ed9a94f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:23.338273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9785fe6cc2a143b99245cd0e608e0223', 'request_id': 'req-59743851-bd0c-4282-922e-f1b62ed9a94f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:23.351744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] The token cache is being invalidate because project 9785fe6cc2a143b99245cd0e608e0223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:23.352104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:23.352836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-59743851-bd0c-4282-922e-f1b62ed9a94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:23.354644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4148/8285] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:23 2022] DELETE /identity/v3/projects/9785fe6cc2a143b99245cd0e608e0223 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:23.360330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.360613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.360885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.382719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:23.383908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:23.458765 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4138/8286] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:23.468145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.468787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.469156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.490428 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:23.491908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:23.509277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4149/8287] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:23.514599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.520313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:23.528736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7584e-c1f6-4290-a03c-9ae560ec5db5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.535928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.536543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.536817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.537114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.537755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:23.538051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.539758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.555100 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4139/8288] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:23.559626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.569427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3028b0-4f09-4fbc-862d-08729c9db6de None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.574460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.575075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.575351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.575620 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.576239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.578204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.614785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4150/8289] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:23 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:23.618968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.632288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c681-242a-4367-a45e-e7e5f4b640a9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.701170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.701712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.701972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.702239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.702875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.704849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.734350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4140/8290] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:23 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:23.743240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.758984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06db2-3219-4b5d-a0e7-9e89abd9279e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.774451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.775308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.775455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.775908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.777298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.779508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.790946 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4151/8291] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:23.795211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.806051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90d35-a17b-4484-9e7d-ede2e2d25d07 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.810919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.811601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.811942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.812276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.813022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.814679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e3ee-b2ea-44b0-997f-a36d718970b1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.827767 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4141/8292] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:23.832320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:23.843734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6b16-c1cc-405d-8d87-40d3ca3ef942 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:23.850057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:23.850458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.850735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.851339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] PATH_INFO: `/v3/projects/a5033f05892647c783da8d54e456cd36/users/4b1e6248167f4b57baf5eb1ec48cfe0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.867146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5033f05892647c783da8d54e456cd36, user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:23.869977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:23.884162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4152/8293] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:23 2022] PUT /identity/v3/projects/a5033f05892647c783da8d54e456cd36/users/4b1e6248167f4b57baf5eb1ec48cfe0a/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:23.895460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:23.895796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:23.896010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:23.929577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] MFA Rules not processed for user `4b1e6248167f4b57baf5eb1ec48cfe0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:23.930868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:24.021708 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4142/8294] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:24.026412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.037267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c1142-ff5c-430c-b1c5-dd4168f0dbb3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.042222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.043252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.043569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.043843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.044536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.046339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.074306 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4153/8295] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:24.078446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.087818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394d7c4-a5f9-497c-acb7-a0671fecb859 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.095973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.096964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.097291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.097571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/1a195d32f69e43629a5b8359c4d41763` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.099689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=1a195d32f69e43629a5b8359c4d41763)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.101146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.121470 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4143/8296] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/1a195d32f69e43629a5b8359c4d41763 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:24.126445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.139380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1af59-3a64-4d6b-b927-5efe3baf1be2 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.144489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.145188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.145474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.145900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.147653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.149819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.181555 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4154/8297] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:24.186341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.196488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e242a-e184-4d20-8bab-8023f94b5e31 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.202642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.203307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.203643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.203867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/34d0c04f31d14bff8e540daa0c1d9327` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.210324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=34d0c04f31d14bff8e540daa0c1d9327)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.212419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.256296 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4144/8298] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/34d0c04f31d14bff8e540daa0c1d9327 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:24.260285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.275303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02068-9e17-4921-9a2f-ef93ae66ef83 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.286328 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.286987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.287274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.287539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/34d0c04f31d14bff8e540daa0c1d9327` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Could not find credential: ec71d765dd763829204695f25836dd3731af681cb6b143787b220764f0885a9e.: keystone.exception.CredentialNotFound: Could not find credential: ec71d765dd763829204695f25836dd3731af681cb6b143787b220764f0885a9e. Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 28 10:33:24.309465 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application with Lock( Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 10:33:24.310632 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._enter() Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.creator() Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application created_value = creator( Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: ec71d765dd763829204695f25836dd3731af681cb6b143787b220764f0885a9e. Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: ERROR keystone.server.flask.application Oct 28 10:33:24.311765 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4155/8299] 10.222.0.16 () {58 vars in 1377 bytes} [Fri Oct 28 10:33:24 2022] GET /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/34d0c04f31d14bff8e540daa0c1d9327 => generated 148 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 28 10:33:24.315984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.327968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c28f-dc2d-4f69-b3a6-e760bf271bf9 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.340053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.340805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.341125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.341416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.342096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.344204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.369739 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4145/8300] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:24.374058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.384633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb9472-26ca-4bc8-88ad-af04bdc60004 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.393375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.394142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.394427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.397003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.398127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.400108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.421980 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4156/8301] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:24.426701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.436976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7654-a377-4d82-a484-5d676e05b691 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.441398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.442055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.442340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.442616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.443217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.454297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.466566 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4146/8302] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:33:24 2022] GET /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 865 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:24.472015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.482822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9465-751a-4a96-8170-b6b15d401741 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.487286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.488035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.488265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.488543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/4660e0db3a56425fa7a981abc1ea00ab` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.490604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=4660e0db3a56425fa7a981abc1ea00ab)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.492003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.510637 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4157/8303] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/4660e0db3a56425fa7a981abc1ea00ab => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:24.514796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.520771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:24.524366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b36fc-f150-4838-a124-00624eb49cad tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.529938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.530707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.531313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.531914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/07e352b7e271429cbbdcf4cd7c350a82` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.534278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=07e352b7e271429cbbdcf4cd7c350a82)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.535696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.557325 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4147/8304] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/07e352b7e271429cbbdcf4cd7c350a82 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:24.563417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.580789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50df4-3f1d-4317-a9b5-0ffbdcd2e129 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.586205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.586894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.587166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.587424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.588058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.590039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.616947 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4158/8305] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2 => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:24.618728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.630843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c61de-89e2-4187-a9d1-d3c5223f42c7 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.636755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.637264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.637595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.637872 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/0cd1fa0c58c243d18ac721b7634bd34a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.639849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=0cd1fa0c58c243d18ac721b7634bd34a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.641407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.644388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4148/8306] 10.222.0.16 () {58 vars in 1377 bytes} [Fri Oct 28 10:33:24 2022] GET /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/0cd1fa0c58c243d18ac721b7634bd34a => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:24.648547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.658583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d1d3-53a3-459e-a6ac-6ca88cbaf31d tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.663606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b1e6248167f4b57baf5eb1ec48cfe0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5033f05892647c783da8d54e456cd36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.664297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.664581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.665631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/0cd1fa0c58c243d18ac721b7634bd34a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.668263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a, credential_id=0cd1fa0c58c243d18ac721b7634bd34a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.669816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59322c1-a683-4ef6-ab8e-8d1173b87a96 tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.684573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=9,keystone:INSERT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:24.689886 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4159/8307] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a/credentials/OS-EC2/0cd1fa0c58c243d18ac721b7634bd34a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:24.695939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.761300 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1a7b7-2193-4f58-abf6-0bc6f315e8df tempest-EC2CredentialsTest-348496856 tempest-EC2CredentialsTest-348496856-project] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:24.766745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:24.767381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.767822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.769208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] PATH_INFO: `/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.770457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1e6248167f4b57baf5eb1ec48cfe0a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:24.772568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:24.826942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1e6248167f4b57baf5eb1ec48cfe0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:24.827603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1e6248167f4b57baf5eb1ec48cfe0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:24.828234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1e6248167f4b57baf5eb1ec48cfe0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:24.837795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1e6248167f4b57baf5eb1ec48cfe0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:24.846041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1e6248167f4b57baf5eb1ec48cfe0a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:24.865531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4149/8308] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:24 2022] DELETE /identity/v3/users/4b1e6248167f4b57baf5eb1ec48cfe0a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:24.870790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:24.871266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:24.871384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:24.893845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:24.895146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:24.972418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4160/8309] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:24.983186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:24.984598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:25.050925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b948e-8ece-4c6b-9c98-4a626aa6f012 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.054546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.055232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.055500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.055770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.065058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.066483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6837f-b8d4-4bb4-b549-8375fe1d3cc5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.076515 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4150/8310] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:25.381870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.383503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:25.399211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269502da-e49c-46d2-8bfd-5074475d9ee9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.405567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.406473 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.406872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.407245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] PATH_INFO: `/v3/projects/a5033f05892647c783da8d54e456cd36` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.408562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5033f05892647c783da8d54e456cd36)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.413375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.466098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5033f05892647c783da8d54e456cd36', 'request_id': 'req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:25.473262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5033f05892647c783da8d54e456cd36', 'request_id': 'req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:25.482871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5033f05892647c783da8d54e456cd36', 'request_id': 'req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:25.496609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] The token cache is being invalidate because project a5033f05892647c783da8d54e456cd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:25.496960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:25.497635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2d5a9a73-0711-4fda-a582-6dd4fafb6f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:25.499686 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4161/8311] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:25 2022] DELETE /identity/v3/projects/a5033f05892647c783da8d54e456cd36 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:25.504647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.505086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.505432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.532509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:25.541082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:25.543641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:25.638641 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4151/8312] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:25.646717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.647007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.647280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.670029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:25.671481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:25.682931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4162/8313] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:25.687448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.697616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607684-98e2-41d2-af07-7d8ad5b4634a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.702202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.702814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.703093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.703364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.704046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:25.704368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.706024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.720957 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4152/8314] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:25.724352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.735485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8f579-5a2c-4765-8691-62fd023579c2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.740399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.741037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.741315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.741585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.742201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.744103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.772599 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4163/8315] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:25 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:25.777533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.788048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952beede-3526-4806-aada-85e59d31bdbe admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.856463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.857122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.857403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.857676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.858311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.860225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.883517 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4153/8316] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:25 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:25.887755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.900971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744711f3-2437-45b3-bf82-61ee4b40003d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.907766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.908584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.909266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.909760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.910588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.912586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.934905 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4164/8317] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:25.935866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.946680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d488b-0df2-48f7-9e0e-436a1cf30b86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.955063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.955684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.956036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.956389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:25.957291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:25.959188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe80ce-fa00-4f94-a1aa-a6b879f5fd2f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:25.971760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4154/8318] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:25.976402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:25.987252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7027ca-0348-4b43-ab0e-676772f7f8d2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:25.992640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:25.993339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:25.993615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:25.993877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] PATH_INFO: `/v3/projects/6b67a77042914c388aefe9094d73f7ae/users/0db71cc57b824f0d91fb1086f1da7a52/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.009918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b67a77042914c388aefe9094d73f7ae, user_id=0db71cc57b824f0d91fb1086f1da7a52, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.013482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.029380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4165/8319] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:25 2022] PUT /identity/v3/projects/6b67a77042914c388aefe9094d73f7ae/users/0db71cc57b824f0d91fb1086f1da7a52/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:26.041074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.041557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.041985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.074144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] MFA Rules not processed for user `0db71cc57b824f0d91fb1086f1da7a52`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:26.075507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:26.156598 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4155/8320] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:26.161145 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.188157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:26.252399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262883-858e-4618-aac9-339c4a0bb378 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.257385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.257997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.258272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.258541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.259175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.261651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.292936 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4166/8321] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:26.294481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.300023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:26.307067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398bb7-af15-4366-a2dc-c738802b2cf6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.376717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.377356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.377664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.378079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.378709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.380619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.404936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4156/8322] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:26.406823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.417586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425f0-af7f-4ec2-8afd-2dcefd2b4ece admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.422477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.423101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.423380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.423648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.424383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.426064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.440142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4167/8323] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:26.444249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.456822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efb42-b96b-486f-9d10-4fb763c80d50 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.462628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.463238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.463518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.463785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.464453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.466132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094e17-d762-4584-8d38-9057a620fe83 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.487161 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4157/8324] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:26.488894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.500784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f11f6-04fa-4bc0-b226-c445600aca99 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.506183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.507042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.507315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.507582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] PATH_INFO: `/v3/projects/a48cb9666ee6465db0862a9e0eba949b/users/f42fa086e2884565a6a42c8c90e74556/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.524155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48cb9666ee6465db0862a9e0eba949b, user_id=f42fa086e2884565a6a42c8c90e74556, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.526973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.553248 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4168/8325] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:26 2022] PUT /identity/v3/projects/a48cb9666ee6465db0862a9e0eba949b/users/f42fa086e2884565a6a42c8c90e74556/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:26.564078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947afccd-b199-4994-95ae-052ede76f567 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.564369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947afccd-b199-4994-95ae-052ede76f567 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.564638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947afccd-b199-4994-95ae-052ede76f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.599935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-947afccd-b199-4994-95ae-052ede76f567 None None] MFA Rules not processed for user `f42fa086e2884565a6a42c8c90e74556`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:26.604159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-947afccd-b199-4994-95ae-052ede76f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:26.702384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4158/8326] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:26.707256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:26.780391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b139-2f92-42e5-91a0-b2fa0ac7ad67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:26.785754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db71cc57b824f0d91fb1086f1da7a52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b67a77042914c388aefe9094d73f7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:26.786586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.786966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.787334 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] PATH_INFO: `/v3/users/0db71cc57b824f0d91fb1086f1da7a52/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.788839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] RBAC: Authorizing `identity:list_user_projects(user_id=0db71cc57b824f0d91fb1086f1da7a52)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:26.791023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e73e69-2151-4a8f-9e72-f9a3d506c70a tempest-IdentityV3ProjectsTest-506450093 tempest-IdentityV3ProjectsTest-506450093-project] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:26.837651 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4169/8327] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:33:26 2022] GET /identity/v3/users/0db71cc57b824f0d91fb1086f1da7a52/projects => generated 515 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:26.841866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.842248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.842622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.884203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] MFA Rules not processed for user `0db71cc57b824f0d91fb1086f1da7a52`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:26.885494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:26.893012 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4159/8328] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:26.897680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:26.898166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:26.898386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:26.918703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] MFA Rules not processed for user `0db71cc57b824f0d91fb1086f1da7a52`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:26.919930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:26.955114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:26.971380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.models.token_model [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] User 0db71cc57b824f0d91fb1086f1da7a52 has no access to project a48cb9666ee6465db0862a9e0eba949b {{(pid=88452) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 28 10:33:26.975435 n-d-zed-1 devstack@keystone.service[88452]: WARNING keystone.server.flask.application [None req-a38b25a2-f59e-480b-975d-3b885a2f5437 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 28 10:33:26.976812 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4170/8329] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:26 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 80 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 28 10:33:26.982874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:27.044216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:27.048369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bacff-057d-4e56-a7d5-9f4255c2396a None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:27.066170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:27.066851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:27.067116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:27.067389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] PATH_INFO: `/v3/users/0db71cc57b824f0d91fb1086f1da7a52` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:27.068619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db71cc57b824f0d91fb1086f1da7a52)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:27.070992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:27.119705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db71cc57b824f0d91fb1086f1da7a52'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.120424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db71cc57b824f0d91fb1086f1da7a52'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.121197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db71cc57b824f0d91fb1086f1da7a52'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.129204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db71cc57b824f0d91fb1086f1da7a52'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.136891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db71cc57b824f0d91fb1086f1da7a52'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.156735 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4160/8330] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:26 2022] DELETE /identity/v3/users/0db71cc57b824f0d91fb1086f1da7a52 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:27.164126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:27.164582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:27.165126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:27.190128 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:27.191377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:27.257990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4171/8331] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:27.268983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:27.270404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:27.337052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085647d-a75c-4eba-b002-82a433196144 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:27.340746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:27.341409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:27.341690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:27.341963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:27.353121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:27.354707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:27.366595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4161/8332] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:27.666276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:27.667818 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:27.682023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11eb98-8d01-403e-b026-594bf66fedc2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:27.702185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:27.702997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:27.703344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:27.703680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] PATH_INFO: `/v3/projects/6b67a77042914c388aefe9094d73f7ae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:27.704943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b67a77042914c388aefe9094d73f7ae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:27.707026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:27.761199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b67a77042914c388aefe9094d73f7ae', 'request_id': 'req-6852519a-a653-4bd9-96f7-f4477f2c8c30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.767411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b67a77042914c388aefe9094d73f7ae', 'request_id': 'req-6852519a-a653-4bd9-96f7-f4477f2c8c30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.776465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b67a77042914c388aefe9094d73f7ae', 'request_id': 'req-6852519a-a653-4bd9-96f7-f4477f2c8c30'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.788071 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] The token cache is being invalidate because project 6b67a77042914c388aefe9094d73f7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:27.788356 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.789076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:27.792977 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4172/8333] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:27 2022] DELETE /identity/v3/projects/6b67a77042914c388aefe9094d73f7ae => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:27.795063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:27.804829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ddaa-2900-48a2-acd2-f6ec5550e957 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:27.907951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:27.909689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:27.910620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:27.911558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] PATH_INFO: `/v3/users/f42fa086e2884565a6a42c8c90e74556` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:27.914682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42fa086e2884565a6a42c8c90e74556)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:27.918668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:27.950679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:28.014913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42fa086e2884565a6a42c8c90e74556'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.016342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42fa086e2884565a6a42c8c90e74556'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.017343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42fa086e2884565a6a42c8c90e74556'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.027565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42fa086e2884565a6a42c8c90e74556'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.037927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1274f31f-79d6-4dc2-8f76-22c3ad0d8807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42fa086e2884565a6a42c8c90e74556'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.061595 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4162/8334] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:27 2022] DELETE /identity/v3/users/f42fa086e2884565a6a42c8c90e74556 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:28.470787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:28.472373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:28.489988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852519a-a653-4bd9-96f7-f4477f2c8c30 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:28.561123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:28.561760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:28.562036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:28.562305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] PATH_INFO: `/v3/projects/a48cb9666ee6465db0862a9e0eba949b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:28.563420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48cb9666ee6465db0862a9e0eba949b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:28.565372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:28.587254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:28.634316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48cb9666ee6465db0862a9e0eba949b', 'request_id': 'req-1a033b0b-7802-436a-9af3-548899006ec2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.640969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48cb9666ee6465db0862a9e0eba949b', 'request_id': 'req-1a033b0b-7802-436a-9af3-548899006ec2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.649026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48cb9666ee6465db0862a9e0eba949b', 'request_id': 'req-1a033b0b-7802-436a-9af3-548899006ec2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.662072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] The token cache is being invalidate because project a48cb9666ee6465db0862a9e0eba949b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:28.662351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.662993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-1a033b0b-7802-436a-9af3-548899006ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:28.664491 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4173/8335] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:28 2022] DELETE /identity/v3/projects/a48cb9666ee6465db0862a9e0eba949b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:28.670460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:28.670772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:28.671045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:28.694581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:28.696093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:28.770992 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4163/8336] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:28.783007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ac063-8925-4b30-b443-1693405df925 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:28.783416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ac063-8925-4b30-b443-1693405df925 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:28.783836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ac063-8925-4b30-b443-1693405df925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:28.813002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d21ac063-8925-4b30-b443-1693405df925 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:28.815047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d21ac063-8925-4b30-b443-1693405df925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:28.827489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4174/8337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:28.837005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:28.850762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a6af-f1bd-48d0-bd2b-1ec6424350a3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:28.858420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:28.858858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:28.859164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:28.859435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:28.860151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:28.860459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:28.862185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:28.877931 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4164/8338] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:28.882472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ac063-8925-4b30-b443-1693405df925 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:28.891797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ac063-8925-4b30-b443-1693405df925 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:28.896349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:28.896979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:28.897254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:28.897519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:28.898130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:28.900021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:28.930908 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4175/8339] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:28 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:28.935891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:28.951513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f450af-2243-47b0-b190-245c3a6a722a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.012847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.013584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.013873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.014162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.014783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.016851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.041147 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4165/8340] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:28 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:29.045552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:29.056782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24b8f8-9c87-49d8-89dc-7d56259e8951 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.062134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.062750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.063027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.063301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.063973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.065643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.078020 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4176/8341] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:29.082049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:29.093075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f07c-1da6-4a01-9549-906ac864adb2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.097865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.098472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.098783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.099054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.099688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.101495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb79a5b-5ec2-44cd-8a24-6460d2ee1af0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.112959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4166/8342] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:29.117430 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:29.133799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7051844-1c68-4d50-9089-cb985b10bb52 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.139028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.139703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.139975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.140243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] PATH_INFO: `/v3/projects/c34736ada9894c3dba55244123a0540b/users/8bad3ba7a0b346cfa209bc59dee98a1e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.161558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34736ada9894c3dba55244123a0540b, user_id=8bad3ba7a0b346cfa209bc59dee98a1e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.164704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.184954 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4177/8343] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:29 2022] PUT /identity/v3/projects/c34736ada9894c3dba55244123a0540b/users/8bad3ba7a0b346cfa209bc59dee98a1e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:29.192233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc390b1-5980-463e-acc5-2edb9462ddd1 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.192624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc390b1-5980-463e-acc5-2edb9462ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.193034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc390b1-5980-463e-acc5-2edb9462ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.202114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:29.228659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0dc390b1-5980-463e-acc5-2edb9462ddd1 None None] MFA Rules not processed for user `8bad3ba7a0b346cfa209bc59dee98a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:29.230287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0dc390b1-5980-463e-acc5-2edb9462ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:29.304975 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4167/8344] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:29.317036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:29.318894 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:29.406731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7241-c43f-431e-b920-d6b12e6d5e2c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.410318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.410929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.411214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.411479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.419980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.421450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.430598 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4178/8345] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:29.586710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3c0a-fe79-40ef-8b35-67ccced77715 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.586998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3c0a-fe79-40ef-8b35-67ccced77715 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.587276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3c0a-fe79-40ef-8b35-67ccced77715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.660200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c57d3c0a-fe79-40ef-8b35-67ccced77715 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:29.661650 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c57d3c0a-fe79-40ef-8b35-67ccced77715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:29.732560 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4168/8346] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:29.784601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:29.786161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:29.844962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:29.875225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7a2e-4b21-4ed7-963d-6f07e35a25cc service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:29.881825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:29.882682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:29.883022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:29.883300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:29.894339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:29.895925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:29.905384 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4179/8347] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:30.256612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1efc-0837-4233-b3ba-50535e60e231 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:30.257138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1efc-0837-4233-b3ba-50535e60e231 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:30.257278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1efc-0837-4233-b3ba-50535e60e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:30.285372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-46ca1efc-0837-4233-b3ba-50535e60e231 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:30.286913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-46ca1efc-0837-4233-b3ba-50535e60e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:30.295102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4169/8348] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:30.306879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:30.320823 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a89af-02f0-40b0-ab4c-32153c1a2c35 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:30.326359 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:30.326957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:30.327236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:30.327506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:30.335762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:30.337376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:30.345711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4180/8349] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:30.797833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3932b-f0ba-40a6-a342-d8603cb7c25c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:30.798195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3932b-f0ba-40a6-a342-d8603cb7c25c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:30.798569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3932b-f0ba-40a6-a342-d8603cb7c25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:30.828151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9b3932b-f0ba-40a6-a342-d8603cb7c25c None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:30.832737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9b3932b-f0ba-40a6-a342-d8603cb7c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:30.844009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4170/8350] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:30.863755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:30.879484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d710479-1073-4004-a1e5-0bc489eb96b0 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:30.885064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636199-4131-494b-97c0-48e96869779e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:30.885747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636199-4131-494b-97c0-48e96869779e service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:30.886447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636199-4131-494b-97c0-48e96869779e service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:30.886765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54636199-4131-494b-97c0-48e96869779e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:30.895719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54636199-4131-494b-97c0-48e96869779e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:30.897322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54636199-4131-494b-97c0-48e96869779e service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:30.908137 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4181/8351] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:31.081707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ec31-e141-40f4-93ae-d63671d69719 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.082444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ec31-e141-40f4-93ae-d63671d69719 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.082697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ec31-e141-40f4-93ae-d63671d69719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.104218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c724ec31-e141-40f4-93ae-d63671d69719 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:31.106103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c724ec31-e141-40f4-93ae-d63671d69719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:31.114214 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4171/8352] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:31.126599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636199-4131-494b-97c0-48e96869779e service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:31.142019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54636199-4131-494b-97c0-48e96869779e service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:31.154879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:31.155760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.156112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.156546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.165573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:31.168015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf67cf-0169-4892-a546-b8bbd327ac9b service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:31.178112 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4182/8353] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:31.628105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.628753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.628753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.651968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.652531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.653005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.661175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:31.662438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:31.670612 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4172/8354] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:31.676343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:31.678516 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:31.685323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:31.694534 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4183/8355] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:31.702790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:31.704292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58eb1-65b4-4820-b65e-84fc5ee46393 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:31.709840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:31.710909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.711186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.711455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.718285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f57c39-8b94-43d2-b017-ae134ec06568 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:31.721191 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:31.722821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7493-c68b-4deb-b450-ffbcc52eeaec service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:31.724261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:31.725099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.725536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.726101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:31.733319 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4173/8356] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:33:31.754759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:31.756606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:31.766065 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4184/8357] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:33:31.992474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:31.992756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:31.993630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:32.027121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:32.028318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:32.036547 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4174/8358] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:32.050973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:32.068057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8244-efc4-439f-836a-ab0b3a0159bf service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:32.074608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:32.075298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:32.075644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:32.075980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:32.087901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:32.090424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfcf15-1d4a-4946-b900-2ba5999fecb8 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:32.100524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4185/8359] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:32.241507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:32.258586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:32.315587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad11a78-47ab-42be-a47d-fe59c6f5303f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:32.321013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:32.321674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:32.321950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:32.322214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] PATH_INFO: `/v3/users/8bad3ba7a0b346cfa209bc59dee98a1e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:32.323948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bad3ba7a0b346cfa209bc59dee98a1e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:32.326372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:32.392269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bad3ba7a0b346cfa209bc59dee98a1e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:32.393068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bad3ba7a0b346cfa209bc59dee98a1e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:32.393809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bad3ba7a0b346cfa209bc59dee98a1e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:32.402522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bad3ba7a0b346cfa209bc59dee98a1e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:32.410910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bad3ba7a0b346cfa209bc59dee98a1e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:32.434776 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4175/8360] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:32 2022] DELETE /identity/v3/users/8bad3ba7a0b346cfa209bc59dee98a1e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:32.439179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:32.439707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:32.440012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:32.477810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:32.478998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:32.550365 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4186/8361] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:32.561064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:32.562746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:32.650673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c709682-7074-4507-9f35-1790fb5e8e47 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:32.654965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:32.655676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:32.656067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:32.656433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:32.666742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:32.668236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5cc0c-d0a6-43f7-892d-c48a784f44ac service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:32.679204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4176/8362] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:33.098942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.100447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.116450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbed29-dbb9-4291-8bad-0c139c65fa28 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.121930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.123177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.123612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.124056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] PATH_INFO: `/v3/projects/c34736ada9894c3dba55244123a0540b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.125731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34736ada9894c3dba55244123a0540b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.128303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.187307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34736ada9894c3dba55244123a0540b', 'request_id': 'req-5006d6f3-907a-4260-8206-164efdb0fb50'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:33.192115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:33.193692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34736ada9894c3dba55244123a0540b', 'request_id': 'req-5006d6f3-907a-4260-8206-164efdb0fb50'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:33.202311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34736ada9894c3dba55244123a0540b', 'request_id': 'req-5006d6f3-907a-4260-8206-164efdb0fb50'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:33.215074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] The token cache is being invalidate because project c34736ada9894c3dba55244123a0540b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:33.215492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:33.216239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5006d6f3-907a-4260-8206-164efdb0fb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:33.217890 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4187/8363] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:33 2022] DELETE /identity/v3/projects/c34736ada9894c3dba55244123a0540b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:33.222925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.223216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.223490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.246913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:33.248145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.278928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:33.310903 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4177/8364] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:33.318884 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.319282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.319629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.345661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:33.346895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.356348 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4188/8365] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:33.361074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.373403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49038-d054-4194-92da-674cc5f01b63 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.379754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.380377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.380656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.380950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.381614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:33.381896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.383525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.396632 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4178/8366] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:33.401270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.411205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39734-8fe8-4d63-87de-37d1bdd0e3e8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.416055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.416659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.416993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.417793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.418419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.420330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.460058 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4189/8367] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:33.464949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.477181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ead4c0-4e8a-4a56-b224-44f66dd1f9c9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.499996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.501734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.554442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.555841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.556323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.556703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.561747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.563601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.588728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-b935-48e0-b387-bc42b251637c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.593495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.594346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.594850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.595285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.595692 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4179/8368] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:33.597576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.600336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.611778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98efb3c-975a-43a0-824d-188fe9f6b78e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.616607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.617336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.617718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.618061 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.618770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.620512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.632425 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4180/8369] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:33.637963 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.654281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035e08a-6f6d-43de-800f-416b006613ca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.659925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.660536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.661035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.661310 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.661950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.664513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.675720 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4181/8370] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:33.681279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.682877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.684326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f75ba-9093-4ec1-a793-3ea501909c20 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.692035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b0e64-2fe9-4f4e-99db-2e47befa6906 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.694776 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4190/8371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:33.697303 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.697964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.698754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.699071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] PATH_INFO: `/v3/projects/dec4314a301e4b02909b327ba7cc1e1f/users/2278e6b98a6b4e6eb2f9e5af15122262/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.714988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec4314a301e4b02909b327ba7cc1e1f, user_id=2278e6b98a6b4e6eb2f9e5af15122262, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.717693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.735848 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4182/8372] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:33 2022] PUT /identity/v3/projects/dec4314a301e4b02909b327ba7cc1e1f/users/2278e6b98a6b4e6eb2f9e5af15122262/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:33.747042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.747427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.747810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.784653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] MFA Rules not processed for user `2278e6b98a6b4e6eb2f9e5af15122262`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:33.785961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:33.853988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:33.860874 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4191/8373] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:33.864024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.929328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860761e-48cb-49d8-99f0-c330ffebedd2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:33.934688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:33.935282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:33.935543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:33.935810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:33.936466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:33.938393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:33.949201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:33.967060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4183/8374] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:33.971556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:33.983373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d6901-9b50-408f-91e8-4b0c4ac4e34e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.042343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.042878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.043268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.043403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.044109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.046181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.075964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4192/8375] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:33 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:34.076927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:34.089919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1d4b-02b5-41bc-a0c3-2bc314c4a98d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.095477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.096380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.096657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.096976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.097628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.099410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.110764 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4184/8376] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:34.114749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:34.125843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9e359-2531-4e57-950d-025fdc3e1e6a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.130965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.131646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.131997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.132273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.132983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.134570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142cbdb-7729-4bb3-b081-b437015eaa62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.146222 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4193/8377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:34.150430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:34.162769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e7c0-6a78-4c14-91e3-d08daefd96ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.167961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.168736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.169286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.170012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] PATH_INFO: `/v3/projects/2c016409c0334eb8aa0de016ea54429f/users/4fbfdfd746e14060aa641984e2a0b409/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.179508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.179794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.180070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.187920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c016409c0334eb8aa0de016ea54429f, user_id=4fbfdfd746e14060aa641984e2a0b409, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.192049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a509165-4607-43a2-9cf1-dc0e54bb9617 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.201201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:34.202498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:34.212985 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4185/8378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:34 2022] PUT /identity/v3/projects/2c016409c0334eb8aa0de016ea54429f/users/4fbfdfd746e14060aa641984e2a0b409/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:34.219992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269946-73a1-4074-a322-5c9941510dfe None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.220437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269946-73a1-4074-a322-5c9941510dfe None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.220811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269946-73a1-4074-a322-5c9941510dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.253360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-44269946-73a1-4074-a322-5c9941510dfe None None] MFA Rules not processed for user `4fbfdfd746e14060aa641984e2a0b409`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:34.254710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-44269946-73a1-4074-a322-5c9941510dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:34.273402 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4194/8379] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:34.327943 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4186/8380] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:34.345753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:34.347344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:34.412383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1fa4-8904-47f9-8d9f-9c8e2a3f4131 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.417795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.418880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.419226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.419602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.464805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:34.485429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.486998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.501291 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4195/8381] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:34.667889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.668307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.668610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.693106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:34.694465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:34.765182 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4187/8382] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:34.778108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:34.779658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:34.865023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642780a-93a9-4666-87ca-5ece6598fefe service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:34.870592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:34.871212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:34.871513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:34.871745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:34.881067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:34.882560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62417d9-31ab-44e6-8cd7-3f387f50da9e service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:34.892723 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4196/8383] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:35.139984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:35.141624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:35.159565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdcc0b-7ae9-4919-a7a8-fcc563b14446 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:35.163269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:35.163943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.164289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.164631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.173319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:35.174825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:35.184858 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4188/8384] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:35.273987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.274506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.274506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.298004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:35.299537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:35.308089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4197/8385] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:35.324768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:35.343202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c772-aaa4-48e6-9b10-817cb406ec84 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:35.349877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:35.350498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.350972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.351241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.360521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:35.362319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714ff9-0081-4ea2-962f-7094ea12d19c service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:35.373179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4189/8386] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:35.505198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:35.581801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b851-50a9-4a5c-ad4e-ca4bf4f28d0a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:35.586768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:35.587547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.587830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.588099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] PATH_INFO: `/v3/users/2278e6b98a6b4e6eb2f9e5af15122262` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.589299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2278e6b98a6b4e6eb2f9e5af15122262)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:35.591431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:35.642017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2278e6b98a6b4e6eb2f9e5af15122262'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:35.642667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2278e6b98a6b4e6eb2f9e5af15122262'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:35.650638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2278e6b98a6b4e6eb2f9e5af15122262'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:35.659001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2278e6b98a6b4e6eb2f9e5af15122262'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:35.659849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2278e6b98a6b4e6eb2f9e5af15122262'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:35.661497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:35.687865 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4198/8387] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:35 2022] DELETE /identity/v3/users/2278e6b98a6b4e6eb2f9e5af15122262 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:35.691804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.692343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.693648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.716294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:35.717588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:35.738221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:35.809222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4190/8388] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:35.818896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:35.820533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:35.882869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23046-bcf6-4301-96fd-cce68d0a4a66 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:35.886654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:35.887388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:35.887768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:35.888153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:35.897633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:35.899187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:35.910187 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4199/8389] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:36.258793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:36.260393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:36.289699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc23a4-09da-4015-81ef-1c8ae02150b4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:36.299955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:36.300941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:36.301518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:36.302005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] PATH_INFO: `/v3/projects/dec4314a301e4b02909b327ba7cc1e1f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:36.303541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec4314a301e4b02909b327ba7cc1e1f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:36.305941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:36.370408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec4314a301e4b02909b327ba7cc1e1f', 'request_id': 'req-bd3b9912-0eb5-41f1-a5dd-47722815b69c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.377384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec4314a301e4b02909b327ba7cc1e1f', 'request_id': 'req-bd3b9912-0eb5-41f1-a5dd-47722815b69c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.386398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec4314a301e4b02909b327ba7cc1e1f', 'request_id': 'req-bd3b9912-0eb5-41f1-a5dd-47722815b69c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.398304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] The token cache is being invalidate because project dec4314a301e4b02909b327ba7cc1e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:36.398596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.399396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.400936 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4191/8390] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:36 2022] DELETE /identity/v3/projects/dec4314a301e4b02909b327ba7cc1e1f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:36.406480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:36.421616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9759-0cc3-4f53-83ce-4672a0129828 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:36.498165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:36.498661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:36.498947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:36.499221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] PATH_INFO: `/v3/users/4fbfdfd746e14060aa641984e2a0b409` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:36.500495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbfdfd746e14060aa641984e2a0b409)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:36.502794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:36.562963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbfdfd746e14060aa641984e2a0b409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.563706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbfdfd746e14060aa641984e2a0b409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.575519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbfdfd746e14060aa641984e2a0b409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.587437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbfdfd746e14060aa641984e2a0b409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.589539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7801f587-9ac6-452e-9518-02247fc8eaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbfdfd746e14060aa641984e2a0b409'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:36.622606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4200/8391] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:36 2022] DELETE /identity/v3/users/4fbfdfd746e14060aa641984e2a0b409 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:37.023699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:37.026266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:37.050299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b9912-0eb5-41f1-a5dd-47722815b69c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:37.207906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:37.209632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.211099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.212222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] PATH_INFO: `/v3/projects/2c016409c0334eb8aa0de016ea54429f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.216657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c016409c0334eb8aa0de016ea54429f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:37.219234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:37.323013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:37.337873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c016409c0334eb8aa0de016ea54429f', 'request_id': 'req-4ae495e6-cddc-4b65-8c75-c419e4ab7960'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:37.353675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c016409c0334eb8aa0de016ea54429f', 'request_id': 'req-4ae495e6-cddc-4b65-8c75-c419e4ab7960'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:37.367981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c016409c0334eb8aa0de016ea54429f', 'request_id': 'req-4ae495e6-cddc-4b65-8c75-c419e4ab7960'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:37.391263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] The token cache is being invalidate because project 2c016409c0334eb8aa0de016ea54429f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:37.391560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:37.393018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4ae495e6-cddc-4b65-8c75-c419e4ab7960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:37.399915 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4192/8392] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:37 2022] DELETE /identity/v3/projects/2c016409c0334eb8aa0de016ea54429f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:37.405933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.406152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.406452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.419391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:37.451878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:37.453302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:37.608266 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4201/8393] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:37.610090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.610400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.612183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.641767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:37.643128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:37.654542 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4193/8394] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:37.659017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:37.675945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa71b-07ff-45d9-83a2-e984045bdaab None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:37.683087 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:37.684029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.684534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.684810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.685751 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:37.686057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:37.688923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:37.711515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:37.720105 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4202/8395] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:37.724789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a533a6-f3d1-426d-afbc-e691ab5358a5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:37.737890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:37.738606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.739385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.739731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.740452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:37.742622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:37.787598 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4194/8396] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:37 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:37.791955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:37.805297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984920-778b-4693-a65d-56ed7dc8958e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:37.890906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:37.891471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.891813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.892101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.892744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:37.895154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:37.926923 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4203/8397] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:37 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:37.930363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:37.955947 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24118e54-751a-45f6-8642-3c1a2491933d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:37.962167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:37.962915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:37.963292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:37.963668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:37.964497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:37.966594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:37.991231 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4195/8398] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:37.992446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.012363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a6f9a-d5f8-4998-9a40-39a3e0933062 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.018263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.018896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.019175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.019449 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.020108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.021831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f47d12-8e3d-485b-8463-2fef0422b900 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.044145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4204/8399] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:38.044893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.064113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60c0a-b3d2-434e-9ae7-8222cd81220f admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.085944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.086637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.086921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.088160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] PATH_INFO: `/v3/projects/c2d37993603b425ebe2a66bb8cf00940/users/c757e7b02c284794a968fb9b028026c9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.113867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d37993603b425ebe2a66bb8cf00940, user_id=c757e7b02c284794a968fb9b028026c9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.116493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.142761 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4196/8400] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:38 2022] PUT /identity/v3/projects/c2d37993603b425ebe2a66bb8cf00940/users/c757e7b02c284794a968fb9b028026c9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:38.156504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.156504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.156998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.226070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] MFA Rules not processed for user `c757e7b02c284794a968fb9b028026c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:38.227803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:38.340501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:38.353309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.359014 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4205/8401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:38.454827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486250-f04e-470e-be8e-1b3d0adaf83c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.460145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.460968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.461402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.461677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.462326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.465618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.508332 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4197/8402] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:38 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:38.509634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.524531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ec18-eec7-4582-bed9-9bca1c4e2087 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.627795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.630743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.631519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.632048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.633160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.636377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.692133 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4206/8403] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:38 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:38.696434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.712333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc247-1283-446d-a4f7-c996b06b7496 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.721457 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.722664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.723204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.723705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.725125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.728414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.747134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4198/8404] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:38.751744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.767667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3d219-3752-4bbf-aa8c-73ccd07f2858 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.773732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.774482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.774831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.775174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.775914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.777711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10196fd4-ece1-4a6a-9115-8f03ac7bc7bb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.806675 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4207/8405] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:38.807249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:38.823941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13facab7-5341-4044-bac0-12cb0f941fb7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:38.834639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:38.835518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.835853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.836188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] PATH_INFO: `/v3/projects/ab632b8c3c2a4b54a09e7c69ab7f4cdc/users/2b891b079ec7471591f3f10c9a08e617/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.857962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab632b8c3c2a4b54a09e7c69ab7f4cdc, user_id=2b891b079ec7471591f3f10c9a08e617, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:38.867489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:38.896220 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4199/8406] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:38 2022] PUT /identity/v3/projects/ab632b8c3c2a4b54a09e7c69ab7f4cdc/users/2b891b079ec7471591f3f10c9a08e617/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:38.903535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:38.903826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:38.904100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:38.942506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] MFA Rules not processed for user `2b891b079ec7471591f3f10c9a08e617`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:38.943851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:39.058194 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4208/8407] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:39.064920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:39.066831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:39.101304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:39.151698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0d26-78f6-423f-8505-ac1a78367a8d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:39.156570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:39.157409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:39.157536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:39.157729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:39.226403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:39.227935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:39.240479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4200/8408] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:39.422529 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:39.437745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1002e79-fe21-4768-931b-65991b7d7cbf None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:39.442097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:39.442724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:39.443005 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:39.443274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:39.453978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:39.455502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73258c1b-a456-4689-aff6-174f34b4bfed service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:39.474618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4209/8409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:40.979297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:41.111705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974c9d-8742-4879-84b9-e27247488231 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:41.121433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:41.123187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:41.123613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:41.123993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] PATH_INFO: `/v3/users/c757e7b02c284794a968fb9b028026c9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:41.125819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c757e7b02c284794a968fb9b028026c9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:41.128244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:41.235452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c757e7b02c284794a968fb9b028026c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:41.236334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c757e7b02c284794a968fb9b028026c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:41.237361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c757e7b02c284794a968fb9b028026c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:41.263225 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c757e7b02c284794a968fb9b028026c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:41.275825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c757e7b02c284794a968fb9b028026c9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:41.284239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:41.316054 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4201/8410] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:40 2022] DELETE /identity/v3/users/c757e7b02c284794a968fb9b028026c9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:41.326612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:41.326612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:41.327381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:41.360688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:41.362142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:41.494234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:41.530791 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4210/8411] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:41.544062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:41.549270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:41.654501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b282-402f-4cb8-8e53-0638153c960d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:41.659508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:41.660341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:41.660341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:41.660715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:41.672716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:41.674174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:41.685987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4202/8412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:42.029306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:42.031222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:42.048199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f17a27-95b8-42f7-8bd9-b20109db3794 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:42.052971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:42.053944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:42.057047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:42.057701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] PATH_INFO: `/v3/projects/c2d37993603b425ebe2a66bb8cf00940` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:42.058878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d37993603b425ebe2a66bb8cf00940)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:42.067607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:42.161378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d37993603b425ebe2a66bb8cf00940', 'request_id': 'req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.170268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d37993603b425ebe2a66bb8cf00940', 'request_id': 'req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.185805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d37993603b425ebe2a66bb8cf00940', 'request_id': 'req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.205098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] The token cache is being invalidate because project c2d37993603b425ebe2a66bb8cf00940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:42.206117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.207161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.210262 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4211/8413] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:42 2022] DELETE /identity/v3/projects/c2d37993603b425ebe2a66bb8cf00940 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:42.216338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:42.228095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97237-8b58-4e7a-b362-0dfd58a95389 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:42.312969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:42.313810 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:42.314090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:42.314361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] PATH_INFO: `/v3/users/2b891b079ec7471591f3f10c9a08e617` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:42.315533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b891b079ec7471591f3f10c9a08e617)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:42.317580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:42.403951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b891b079ec7471591f3f10c9a08e617'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.405433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b891b079ec7471591f3f10c9a08e617'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.406077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b891b079ec7471591f3f10c9a08e617'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.437398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b891b079ec7471591f3f10c9a08e617'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.464873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d43348e5-036c-49d9-95a3-7237a39ea309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b891b079ec7471591f3f10c9a08e617'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:42.498549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:42.506055 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4203/8414] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:42 2022] DELETE /identity/v3/users/2b891b079ec7471591f3f10c9a08e617 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:42.986855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:42.994692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:43.021639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39cb2-ed28-4298-a0cf-a3a5a2e42c67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.146221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.149006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.149006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.149006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] PATH_INFO: `/v3/projects/ab632b8c3c2a4b54a09e7c69ab7f4cdc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.151020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab632b8c3c2a4b54a09e7c69ab7f4cdc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.153114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.235714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab632b8c3c2a4b54a09e7c69ab7f4cdc', 'request_id': 'req-211312fd-c0e0-4ae8-91a3-3d63861de4dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:43.244196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab632b8c3c2a4b54a09e7c69ab7f4cdc', 'request_id': 'req-211312fd-c0e0-4ae8-91a3-3d63861de4dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:43.259744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab632b8c3c2a4b54a09e7c69ab7f4cdc', 'request_id': 'req-211312fd-c0e0-4ae8-91a3-3d63861de4dd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:43.277839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] The token cache is being invalidate because project ab632b8c3c2a4b54a09e7c69ab7f4cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:43.278243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:43.279375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-211312fd-c0e0-4ae8-91a3-3d63861de4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:43.282375 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4212/8415] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:42 2022] DELETE /identity/v3/projects/ab632b8c3c2a4b54a09e7c69ab7f4cdc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:43.289118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.289118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.289118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.317367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:43.318745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:43.422135 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4204/8416] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:43.430914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.431209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.431484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.447923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:43.459204 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:43.461434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:43.477201 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4213/8417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:43.481901 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.492567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b139b1-4f9c-44d2-933b-5138cba02e6e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.498217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.498830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.499106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.499375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.500023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:43.500323 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.501961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.514910 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4205/8418] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:43.519331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.529274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a0d6a-58fe-4680-8e38-96f4a138d70f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.535224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.535977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.536305 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.536539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.537239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.539883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.573206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4214/8419] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:43 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:43.577462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.593387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dcbb9-4b6c-4b16-8c03-56e908a4ef1a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.685875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.686609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.686966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.687235 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.687878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.690326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.732121 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4206/8420] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:43 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:43.741528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.762085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcfc69-a966-44dd-b570-468c52e6a683 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.769038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.769660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.769945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.770213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.770858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.772501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.787103 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4215/8421] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:43.788295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.801213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78bd45-17cd-4f86-84b5-2bc72d830e8c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.813770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.814575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.815068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.817086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.819663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.826002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef9dff-de9b-4709-8b9d-c227d52b8e3d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.841148 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4207/8422] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:43.844730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:43.859903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818aec1-05ee-46ed-8114-b3aa60f9ce30 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:43.871394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:43.872095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.872548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.872920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] PATH_INFO: `/v3/projects/0d94f471797544d28dcd2aeb10528754/users/568d61b2f03a49f4a9fcd95bb4b35e81/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:43.905845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d94f471797544d28dcd2aeb10528754, user_id=568d61b2f03a49f4a9fcd95bb4b35e81, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:43.909115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:43.936948 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4216/8423] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:43 2022] PUT /identity/v3/projects/0d94f471797544d28dcd2aeb10528754/users/568d61b2f03a49f4a9fcd95bb4b35e81/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:43.955681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:43.956429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:43.956726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:44.002518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] MFA Rules not processed for user `568d61b2f03a49f4a9fcd95bb4b35e81`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:44.003982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:44.102985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:44.124760 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4208/8424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:44.150355 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:44.160474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:44.423421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb9d67-7fdc-48e8-a4d6-3b0e34bcf114 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:44.427645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:44.428251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:44.428528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:44.428787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:44.438539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:44.440213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f9ee-390f-4dda-8c2b-8e316c605db9 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:44.455881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4217/8425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:44.611383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:44.698113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892440-5a13-4314-b99d-40fd0608d46e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:44.703574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:44.704234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:44.704514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:44.704789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] PATH_INFO: `/v3/users/568d61b2f03a49f4a9fcd95bb4b35e81` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:44.706376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568d61b2f03a49f4a9fcd95bb4b35e81)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:44.708514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:44.795762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568d61b2f03a49f4a9fcd95bb4b35e81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:44.797986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568d61b2f03a49f4a9fcd95bb4b35e81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:44.797986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568d61b2f03a49f4a9fcd95bb4b35e81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:44.812410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568d61b2f03a49f4a9fcd95bb4b35e81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:44.831942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568d61b2f03a49f4a9fcd95bb4b35e81'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:44.859296 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4209/8426] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:44 2022] DELETE /identity/v3/users/568d61b2f03a49f4a9fcd95bb4b35e81 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:44.865734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:44.866399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:44.867190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:44.896183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:44.897589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:44.982674 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4218/8427] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:44.992746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:44.995749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:45.090517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24a94-c680-4c84-b113-253887bd6d28 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:45.100446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:45.101580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:45.102302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:45.102785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:45.115795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:45.117505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f62a3-1103-4d6a-b410-80824fc9824e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:45.129741 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4210/8428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:45.593862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:45.593862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:45.619989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558862b-2317-4cfe-810b-698165d2cbf6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:45.655158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:45.656227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:45.656617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:45.657510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] PATH_INFO: `/v3/projects/0d94f471797544d28dcd2aeb10528754` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:45.658559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d94f471797544d28dcd2aeb10528754)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:45.660485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:45.720659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:45.731331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d94f471797544d28dcd2aeb10528754', 'request_id': 'req-40fc252f-13e5-4de2-bf40-82ecefe8573f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:45.738566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d94f471797544d28dcd2aeb10528754', 'request_id': 'req-40fc252f-13e5-4de2-bf40-82ecefe8573f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:45.754731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d94f471797544d28dcd2aeb10528754', 'request_id': 'req-40fc252f-13e5-4de2-bf40-82ecefe8573f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:45.769455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] The token cache is being invalidate because project 0d94f471797544d28dcd2aeb10528754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:45.769753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:45.770557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-40fc252f-13e5-4de2-bf40-82ecefe8573f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:45.776721 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4219/8429] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:45 2022] DELETE /identity/v3/projects/0d94f471797544d28dcd2aeb10528754 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:45.779785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:45.780206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:45.780523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:45.815063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:45.817202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:45.846524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:45.937998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4211/8430] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:45.946148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:45.946435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:45.946689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:45.970384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:45.971981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:45.990808 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4220/8431] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:45.996071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.023015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cae5f-5fa6-4b5f-bd6e-663f1d83675e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.030193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.030727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.031064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.031290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.032086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:46.032368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.037089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.061000 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4212/8432] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:46.064253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.078969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c009-66ce-4216-894c-7a234f061a59 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.084706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.084859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.085127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.085401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.086034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.087981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.127764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4221/8433] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:46 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:46.129138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.159514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1c6a-a0e7-4b9a-8fe8-b1934f52cfc2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.278577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.280239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.280517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.280801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.281443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.283376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.328439 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4213/8434] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:46 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:46.329902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.352400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d371-236c-4837-876b-a04a6c391d23 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.358285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.359046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.359559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.359559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.361362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.362705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.379121 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4222/8435] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:46.380972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.395030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b453-76ea-4498-bf27-d66b0735f9d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.403952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.404979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.405638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.405829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.415239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.418686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608813f6-ce95-40d2-9268-284aa73ad054 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.452003 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4214/8436] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:46.456983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.484700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ae31-a8a6-4ca2-bc46-4458b39f1b96 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.501407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.502073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.502350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.502618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] PATH_INFO: `/v3/projects/211d3c430f5043e7829047ad69158dae/users/2df9163964e94332aa390683c6783e1f/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.525369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211d3c430f5043e7829047ad69158dae, user_id=2df9163964e94332aa390683c6783e1f, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.529312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.548628 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4223/8437] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:46 2022] PUT /identity/v3/projects/211d3c430f5043e7829047ad69158dae/users/2df9163964e94332aa390683c6783e1f/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:46.560121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.561103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.561459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.616195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] MFA Rules not processed for user `2df9163964e94332aa390683c6783e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:46.618149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:46.770503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4215/8438] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:46.783623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:46.789194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:46.909263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a88f64-5dfe-482f-8312-f0fc6dd15964 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:46.913633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:46.914960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:46.914960 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:46.915136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:46.935995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:46.937494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703544-9ad5-4430-93d8-9411916e6323 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:46.949897 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4224/8439] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:47.238328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:47.265269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:47.332755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90470c1-65dd-4106-92eb-de54ed09f830 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:47.341345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:47.342127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:47.342279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:47.342577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] PATH_INFO: `/v3/users/2df9163964e94332aa390683c6783e1f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:47.343754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df9163964e94332aa390683c6783e1f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:47.345982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:47.408602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df9163964e94332aa390683c6783e1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:47.409911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df9163964e94332aa390683c6783e1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:47.411059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df9163964e94332aa390683c6783e1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:47.426768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df9163964e94332aa390683c6783e1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:47.437201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df9163964e94332aa390683c6783e1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:47.473377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4216/8440] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:47 2022] DELETE /identity/v3/users/2df9163964e94332aa390683c6783e1f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:47.478205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:47.478491 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:47.478770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:47.501110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:47.502708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:47.599145 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4225/8441] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:47.614728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:47.616762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:47.693998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a3c34-377d-47e5-b98b-55ab75659d25 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:47.698945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:47.699759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:47.700220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:47.701129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:47.713405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:47.715516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eb629-9b8f-4297-81c1-ead53c733bc2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:47.726370 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4217/8442] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:48.071283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.072967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:48.092679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ddd4e-47d0-48df-9adf-05ff2ab5cf0e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.098222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.098957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.099927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.100652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] PATH_INFO: `/v3/projects/211d3c430f5043e7829047ad69158dae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.102245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=211d3c430f5043e7829047ad69158dae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.104104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.107788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:48.173038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211d3c430f5043e7829047ad69158dae', 'request_id': 'req-97387fef-4639-4f79-b1b5-a3571e3055ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:48.179209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211d3c430f5043e7829047ad69158dae', 'request_id': 'req-97387fef-4639-4f79-b1b5-a3571e3055ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:48.189448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211d3c430f5043e7829047ad69158dae', 'request_id': 'req-97387fef-4639-4f79-b1b5-a3571e3055ad'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:48.204534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] The token cache is being invalidate because project 211d3c430f5043e7829047ad69158dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:48.205194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:48.206235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-97387fef-4639-4f79-b1b5-a3571e3055ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:48.212740 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4226/8443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:48 2022] DELETE /identity/v3/projects/211d3c430f5043e7829047ad69158dae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:48.214557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.215075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.215408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.237621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:48.238847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:48.277128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:48.310167 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4218/8444] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:48.319080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.319577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.319917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.344498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:48.345768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:48.358267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4227/8445] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:48.359944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.371273 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872955d2-a769-4003-b954-0ab8ed1dd71b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.376333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.377070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.377359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.377632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.378313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:48.378668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.380390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.395385 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4219/8446] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:48.400090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.410306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63682c-86f7-4061-88ed-f9de7137a83e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.415844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.416528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.416834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.417166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.417951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.420091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.455438 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4228/8447] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:48 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:48.456368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.468606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a23a-5a54-4f60-b6f3-082fe33db9d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.533066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.533686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.533968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.534246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.534882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.536783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.559639 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4220/8448] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:48 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:48.563901 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.575605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4702f-b667-4bc2-a8c5-82c145dd8c60 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.580586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.581242 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.581546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.581814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.582448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.584175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.596948 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4229/8449] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:48.599245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.611554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58678f8-fd66-45e4-92eb-ded2a1a40444 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.617542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.618156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.618434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.618706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.619360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.621569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade387bb-654c-4b71-afa5-3f69e076dcb0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.633119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4221/8450] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:48.636930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.647161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92a9f-0d21-4d24-a6ff-38c9f32a647e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.657290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.657961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.658237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.658573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] PATH_INFO: `/v3/projects/45fdd1b51a2a4abcabaf2ee697b63e35/users/1bd60b58d7b444bb8a9fdb8b13ba1148/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.677944 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fdd1b51a2a4abcabaf2ee697b63e35, user_id=1bd60b58d7b444bb8a9fdb8b13ba1148, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.680659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.695228 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4230/8451] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:48 2022] PUT /identity/v3/projects/45fdd1b51a2a4abcabaf2ee697b63e35/users/1bd60b58d7b444bb8a9fdb8b13ba1148/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:48.705898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.706189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.706465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.740577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] MFA Rules not processed for user `1bd60b58d7b444bb8a9fdb8b13ba1148`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:48.742027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:48.811997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4222/8452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:48.823822 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:48.825859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:48.894684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823c75-16ce-478d-aa19-29f9c724b79e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:48.899994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:48.900604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:48.900881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:48.901727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:48.911828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:48.913246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f99dc-a69e-4fd4-8c54-866cde237a30 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:48.923493 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4231/8453] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:49.549567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:49.585383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:49.619678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecabe9-4f4c-4369-8e76-b1064c1414a0 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:49.624693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:49.625356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:49.625636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:49.625909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] PATH_INFO: `/v3/users/1bd60b58d7b444bb8a9fdb8b13ba1148` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:49.627034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd60b58d7b444bb8a9fdb8b13ba1148)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:49.628972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:49.676231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd60b58d7b444bb8a9fdb8b13ba1148'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:49.677088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd60b58d7b444bb8a9fdb8b13ba1148'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:49.677800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd60b58d7b444bb8a9fdb8b13ba1148'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:49.686205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd60b58d7b444bb8a9fdb8b13ba1148'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:49.693834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd60b58d7b444bb8a9fdb8b13ba1148'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:49.712111 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4223/8454] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:49 2022] DELETE /identity/v3/users/1bd60b58d7b444bb8a9fdb8b13ba1148 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:49.716752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:49.717283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:49.717448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:49.736154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:49.737374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:49.764602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:49.799939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4232/8455] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:49.810153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:49.811548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:49.875711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac327c9f-49c6-43df-b74b-cf9796caed2d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:49.879458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:49.880060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:49.880339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:49.880609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:49.890393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:49.891806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d8d51-5b67-4acf-9f29-9fd3e3e1d47c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:49.901426 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4224/8456] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:50.212227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.214148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:50.241794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadcef-d4dd-461a-a434-e7eee5fec1a2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.250047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.250891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.251170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.251514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] PATH_INFO: `/v3/projects/45fdd1b51a2a4abcabaf2ee697b63e35` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.252576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fdd1b51a2a4abcabaf2ee697b63e35)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.254594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.316287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fdd1b51a2a4abcabaf2ee697b63e35', 'request_id': 'req-12fd14c5-f66d-4c51-b385-e58d2bcf851a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:50.327177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fdd1b51a2a4abcabaf2ee697b63e35', 'request_id': 'req-12fd14c5-f66d-4c51-b385-e58d2bcf851a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:50.339843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fdd1b51a2a4abcabaf2ee697b63e35', 'request_id': 'req-12fd14c5-f66d-4c51-b385-e58d2bcf851a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:50.353863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] The token cache is being invalidate because project 45fdd1b51a2a4abcabaf2ee697b63e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:50.354207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:50.355566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-12fd14c5-f66d-4c51-b385-e58d2bcf851a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:50.357511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4233/8457] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:50 2022] DELETE /identity/v3/projects/45fdd1b51a2a4abcabaf2ee697b63e35 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:50.362144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.362436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.362735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.385578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:50.386928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:50.441301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:50.455159 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4225/8458] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:50.462817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.463095 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.463361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.484999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:50.486193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:50.494341 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4234/8459] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:50.498602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.508667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64732bfa-dafb-400a-9360-915c28b98671 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.513322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.513898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.514184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.514446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.515077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:50.515375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.516975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.533009 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4226/8460] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:50.534331 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.545149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a939-7876-461a-b887-8ad865e95809 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.549881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.550497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.550756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.551020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.551635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.554016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.585691 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4235/8461] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:50 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:50.586783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.597920 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d58a3-79b2-4588-bb9d-159cf5684865 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.655774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.656386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.656666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.656962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.657603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.659509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.686503 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4227/8462] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:50 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:50.687878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.699110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f508fd1-3f13-4aa7-8937-2a3ff6f63ed1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.703766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.704370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.704640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.704933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.705682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.707172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.718403 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4236/8463] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:50.722630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.733082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc28c67-2a40-42f2-9f4d-5a68607fd0b4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.737853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.738488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.738766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.739038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.739676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.741320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7076-e12e-4d52-932c-702453848554 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.752456 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4228/8464] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:50.756653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.767611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cafb-c350-405a-9429-44416ecce301 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:50.772510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:50.773288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.773568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.773837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] PATH_INFO: `/v3/projects/d59c7316942a4e56a9e6193dbdc0df91/users/fafec2effa44451b9e9bf10d93e8e965/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.792710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59c7316942a4e56a9e6193dbdc0df91, user_id=fafec2effa44451b9e9bf10d93e8e965, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:50.795469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:50.809885 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4237/8465] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:50 2022] PUT /identity/v3/projects/d59c7316942a4e56a9e6193dbdc0df91/users/fafec2effa44451b9e9bf10d93e8e965/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:50.822228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:50.822494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:50.822766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:50.855302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] MFA Rules not processed for user `fafec2effa44451b9e9bf10d93e8e965`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:50.856548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:50.928751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4229/8466] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:50.939946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:50.941834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:51.015940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dc1f-5884-4891-b625-ef6b4952c4d0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:51.019696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:51.020382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:51.020728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:51.021160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:51.029365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:51.035110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:51.036775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:51.056041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4238/8467] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:57.684276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:57.686151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:57.692336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:57.779239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:57.806354 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea8c-f0e7-4207-8cd7-f2bf87326fad service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:57.812993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:57.814383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:57.814852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:57.815403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] PATH_INFO: `/v3/users/fafec2effa44451b9e9bf10d93e8e965` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:57.817731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafec2effa44451b9e9bf10d93e8e965)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:57.820427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26017cb6-a5f8-4153-b0b7-ecb69441d953 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:57.821318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:57.828075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:57.828863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:57.829441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:57.829673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:57.832229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:57.848773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:57.850488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:57.865799 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4230/8468] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:57.886386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafec2effa44451b9e9bf10d93e8e965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.887121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafec2effa44451b9e9bf10d93e8e965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.896151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafec2effa44451b9e9bf10d93e8e965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.909148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafec2effa44451b9e9bf10d93e8e965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.909148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-c71456a0-305b-4832-9b5d-c72ce0e7cf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafec2effa44451b9e9bf10d93e8e965'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.910747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:57.912598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:57.927588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5cb5a-b01e-413c-a5b3-5cc64afd1c98 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:57.931519 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4239/8469] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:57 2022] DELETE /identity/v3/users/fafec2effa44451b9e9bf10d93e8e965 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:57.933210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:57.933843 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:57.934127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:57.934717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] PATH_INFO: `/v3/users/eb2442f7f47e4bff8e1ab9d3547550fe` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:57.935644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2442f7f47e4bff8e1ab9d3547550fe)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:57.937597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:57.938307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:57.938591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:57.938865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:57.961180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:57.962420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:57.989946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2442f7f47e4bff8e1ab9d3547550fe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.990743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2442f7f47e4bff8e1ab9d3547550fe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.991398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2442f7f47e4bff8e1ab9d3547550fe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:57.999956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2442f7f47e4bff8e1ab9d3547550fe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.007928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-547b0a6f-9aa8-4b5c-afe3-9202dbca6c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2442f7f47e4bff8e1ab9d3547550fe'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.027158 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4231/8470] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:33:57 2022] DELETE /identity/v3/users/eb2442f7f47e4bff8e1ab9d3547550fe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:58.031424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.031697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.031972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.037347 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4240/8471] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:58.048295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.050044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.052578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:58.053796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.066784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:58.118933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fb609-24b3-46d0-b002-42cb1649d332 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.123228 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4232/8472] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:58.129532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.187604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.189686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.189962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.190171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:58.190294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.209496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.210951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.211109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c7d24-ed9a-48f7-97d6-254e87d6a1e9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.215470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.216078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.216354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.216622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.230533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.232073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.237660 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4241/8473] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:58.246740 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4233/8474] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:33:58.462656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.465440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.470656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.472792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.512344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9508b3-56ee-4821-b050-0ceac03cb21f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.516383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99bc28-293a-40e9-b65a-eea58344599d service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.518759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.519669 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.520043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.520383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] PATH_INFO: `/v3/projects/d59c7316942a4e56a9e6193dbdc0df91` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.522066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59c7316942a4e56a9e6193dbdc0df91)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.522193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.522741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.523086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.523540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] PATH_INFO: `/v3/projects/3b0dea03ca9d4c5b99c4c26b31b6fb27` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.523922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.524782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0dea03ca9d4c5b99c4c26b31b6fb27)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.527669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.578795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59c7316942a4e56a9e6193dbdc0df91', 'request_id': 'req-37f5e960-6063-40cd-959a-dade92364cc0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.592632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'request_id': 'req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.600578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59c7316942a4e56a9e6193dbdc0df91', 'request_id': 'req-37f5e960-6063-40cd-959a-dade92364cc0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.607386 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'request_id': 'req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.609733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59c7316942a4e56a9e6193dbdc0df91', 'request_id': 'req-37f5e960-6063-40cd-959a-dade92364cc0'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.617181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'request_id': 'req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.624234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] The token cache is being invalidate because project d59c7316942a4e56a9e6193dbdc0df91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:58.624621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.625331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-37f5e960-6063-40cd-959a-dade92364cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.626924 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4234/8475] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:58 2022] DELETE /identity/v3/projects/d59c7316942a4e56a9e6193dbdc0df91 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:33:58.632231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528d046-7dae-4af7-9113-c2c0678c9b0a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.632640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528d046-7dae-4af7-9113-c2c0678c9b0a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.632946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528d046-7dae-4af7-9113-c2c0678c9b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.634198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] The token cache is being invalidate because project 3b0dea03ca9d4c5b99c4c26b31b6fb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:33:58.634682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.636276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-da10d1d1-ecdb-4c24-8b35-1179ba3305e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:33:58.638315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4242/8476] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:33:58 2022] DELETE /identity/v3/projects/3b0dea03ca9d4c5b99c4c26b31b6fb27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:58.642612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.643079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.643576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.655739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e528d046-7dae-4af7-9113-c2c0678c9b0a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:58.657012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e528d046-7dae-4af7-9113-c2c0678c9b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.665295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:58.666697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.723119 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4235/8477] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:58.731076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:58.731599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.731599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.731936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.746620 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4243/8478] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:58.760713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:58.762389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.772740 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4236/8479] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:58.778618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.790015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ded0e0-861a-4b9f-8f23-5891f83c2ec2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.795739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.796531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.796942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.797350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.798163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:58.798560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.800492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a2479-df08-4f4c-856c-18aae9f0feb1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.818254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4244/8480] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:33:58.820204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.833412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23c92-e20a-4a76-be07-299e95862f9b None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.838501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.840412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.840942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.841355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.842443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.844809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.853283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.853695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.854068 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.878180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:58.882358 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4237/8481] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:58.882533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:58.883696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.948855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:58.964964 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4245/8482] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:58.968371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:58.973754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749f9e3-9d65-4b70-b68a-c5e6f82a2a7c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.978577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.979221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.979448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2eb26-7d4e-4fb1-a62c-56957c4f6c45 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:58.979580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.979756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.980411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.983586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:58.985609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:58.986571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:58.987141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:58.987724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:58.988537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:33:58.989050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:58.990963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.006388 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4246/8483] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:33:59.014384 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4238/8484] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:58 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:59.014590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.015621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.028065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82166e-00d7-4ae5-aaea-9dba67e49e49 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.028364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dedd9-5b20-4250-a4ca-130d98e8fec9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.033604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.034022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.034462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.034714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.035026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.035144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.035330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.035488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.035975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.036262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.037806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.038854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.052277 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4239/8485] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:33:59.053805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.064783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071077f0-809d-42bb-a72a-8bc7edaff428 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.069709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.074231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.074432 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4247/8486] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:33:59 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:33:59.074542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.074542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.074542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.074542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.075633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.088108 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4240/8487] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:59.093141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.104559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70fa-a985-41ec-bbbe-92ad7b7dc3d3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.150825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ae75-9e31-4c4c-922d-adad6fe46a88 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.156351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.156992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.157273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.157538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.158152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.160079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.181634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.182342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.182600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.182868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] PATH_INFO: `/v3/projects/258874ded1d84b1d9b731d58f1bb5b59/users/fb7349d5e29a45b48d6c6d5833967aac/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.188586 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4248/8488] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:33:59 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:33:59.189483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.200761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211c4d-12a8-4d48-a647-0f1183fa4f98 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.201735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258874ded1d84b1d9b731d58f1bb5b59, user_id=fb7349d5e29a45b48d6c6d5833967aac, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.204892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.205722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.206360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.206669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.207064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.207678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.209410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daa422-f3d9-48d1-a8ab-08e5f1668b5f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.220287 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4241/8489] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:59 2022] PUT /identity/v3/projects/258874ded1d84b1d9b731d58f1bb5b59/users/fb7349d5e29a45b48d6c6d5833967aac/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:59.223562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4249/8490] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:59.226036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.231966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.232257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.232570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.264509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] MFA Rules not processed for user `fb7349d5e29a45b48d6c6d5833967aac`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:59.266020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.283697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:59.299762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281597e-9ae9-4f9d-a08f-7afd98e5aa18 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.305242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.305873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.306227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.306927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.307157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.309129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.324536 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4242/8491] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:33:59.326043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.336823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8847-64c8-422a-96b3-5d609ef934ca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.342201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.342864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.343141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.343598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] PATH_INFO: `/v3/projects/13d4324ba56247f3996afe999b1d48e7/users/b4f8640cedf149239fafa92963fe0d9e/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.355372 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4250/8492] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:33:59.356431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.357934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.367659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4324ba56247f3996afe999b1d48e7, user_id=b4f8640cedf149239fafa92963fe0d9e, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.372244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.390995 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4243/8493] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:33:59 2022] PUT /identity/v3/projects/13d4324ba56247f3996afe999b1d48e7/users/b4f8640cedf149239fafa92963fe0d9e/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:33:59.392018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.395976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.403231 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:59.451534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a84ee-63a0-4674-9520-091b8ab4d385 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.504801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97a49-a683-476c-9238-67bcde102eb2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.511111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.513950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.515356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.516509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.550241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.550862 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.551148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.551415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.553482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.578369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.580064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8775e3d-389e-42e9-98e2-a4c433cb37e4 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.595958 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4251/8494] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:59.597413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.597680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.597950 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.609523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.611270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.622102 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4244/8495] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:59.631321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] MFA Rules not processed for user `b4f8640cedf149239fafa92963fe0d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:33:59.632544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.679821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:59.717210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4252/8496] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:33:59.732013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:33:59.733770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:33:59.810590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb352-abf3-402c-a2de-a08dbe486a42 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:33:59.815199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959655e6-6413-41b0-be40-017124c1349e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:33:59.816187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959655e6-6413-41b0-be40-017124c1349e service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:33:59.816690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959655e6-6413-41b0-be40-017124c1349e service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:33:59.817154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959655e6-6413-41b0-be40-017124c1349e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:33:59.830443 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959655e6-6413-41b0-be40-017124c1349e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:33:59.832528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959655e6-6413-41b0-be40-017124c1349e service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:33:59.844832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4245/8497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:09.711889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=10 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:09.840203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=73 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:12.552807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:12.650054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76944a48-affe-49e1-93fc-c77b824ea230 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:12.656703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:12.657547 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:12.657827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:12.658195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] PATH_INFO: `/v3/users/fb7349d5e29a45b48d6c6d5833967aac` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:12.659424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7349d5e29a45b48d6c6d5833967aac)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:12.661592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:12.718317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7349d5e29a45b48d6c6d5833967aac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:12.718997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7349d5e29a45b48d6c6d5833967aac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:12.727719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7349d5e29a45b48d6c6d5833967aac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:12.738351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7349d5e29a45b48d6c6d5833967aac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:12.739577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7349d5e29a45b48d6c6d5833967aac'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:12.765682 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4253/8498] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:12 2022] DELETE /identity/v3/users/fb7349d5e29a45b48d6c6d5833967aac => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:12.771698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:12.772247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:12.772420 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:12.799802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:12.801258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:12.882644 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4246/8499] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:12.894294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:12.896484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:12.984811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb47-5925-4c33-a098-a322779591f0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:12.989769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:12.990384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:12.990666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:12.990965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.002970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.004704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce4a2-4c64-445e-a291-f76aa5a79cf2 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.016420 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4254/8500] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:13.298315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.300103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:13.326659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc4c09-d447-4a5f-a912-a2c6a062d6a9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.333095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.334922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.335270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.335672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] PATH_INFO: `/v3/projects/258874ded1d84b1d9b731d58f1bb5b59` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.337474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258874ded1d84b1d9b731d58f1bb5b59)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.339294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.425529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258874ded1d84b1d9b731d58f1bb5b59', 'request_id': 'req-63a8a9f9-924c-4c87-bb99-453d0b89a601'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:13.433095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258874ded1d84b1d9b731d58f1bb5b59', 'request_id': 'req-63a8a9f9-924c-4c87-bb99-453d0b89a601'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:13.443389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258874ded1d84b1d9b731d58f1bb5b59', 'request_id': 'req-63a8a9f9-924c-4c87-bb99-453d0b89a601'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:13.456922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] The token cache is being invalidate because project 258874ded1d84b1d9b731d58f1bb5b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:13.457271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:13.457970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-63a8a9f9-924c-4c87-bb99-453d0b89a601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:13.459658 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4247/8501] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:13 2022] DELETE /identity/v3/projects/258874ded1d84b1d9b731d58f1bb5b59 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:13.464949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.465358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.465784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.496982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:13.498293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:13.518784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:13.599282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.599521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.599855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.606163 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4255/8502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:13.625463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:13.626666 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:13.635814 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4248/8503] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:13.640378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.651454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d599b03-29cf-4297-9538-6f57012b8ca3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.656725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.657378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.657657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.657915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.658633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:34:13.658945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.660802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.676041 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4256/8504] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:34:13.680776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.691365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc78b-b578-4eae-adbc-f24084762885 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.697291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.697878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.698163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.698433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.699072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.701209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.733938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4249/8505] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:13.739072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.752379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8540-a92d-4a85-843c-e59bebae838c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.822043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.822727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.823309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.823610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.824401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.826351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.849157 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4257/8506] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:13 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:13.853748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.866662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f376c-b02e-4842-9b22-4a15ce6b4878 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.872272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.872846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.873211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.873759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.874442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.876081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.887786 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4250/8507] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:13.894043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.908747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68bd3-6a89-4609-8cb1-cf3899c61878 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.916116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.917398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.917788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.918256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.919182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.921376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930571-1355-4fff-a6b9-23938f9a8ca7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:13.937194 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4258/8508] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:13.941888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:13.954972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f87a-ead0-4ca9-a935-2ea2966ba481 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:13.960186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:13.961062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:13.961462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:13.961869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] PATH_INFO: `/v3/projects/5b512cdc6da2431bb854d5befa53e4b6/users/73ca9016c2af46cd9770894b1a51be5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:13.985185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b512cdc6da2431bb854d5befa53e4b6, user_id=73ca9016c2af46cd9770894b1a51be5c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:13.987922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:14.007526 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4251/8509] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:13 2022] PUT /identity/v3/projects/5b512cdc6da2431bb854d5befa53e4b6/users/73ca9016c2af46cd9770894b1a51be5c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:34:14.019362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:14.019663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:14.019939 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:14.055538 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] MFA Rules not processed for user `73ca9016c2af46cd9770894b1a51be5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:14.056841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:14.138520 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4259/8510] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:14.150112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:14.152967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:14.180784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:14.234286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49788d4-82a4-4f59-9f15-031591c16007 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:14.238276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:14.238971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:14.239293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:14.239551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:14.249875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:14.250623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb42575-f4e3-4c33-91f7-a034b3bc1211 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:14.262731 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4252/8511] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:14.276666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:14.300590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:14.354663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1196692-3dde-4a9e-a68f-08c5aae3187e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:14.360101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:14.360807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:14.361177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:14.361537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] PATH_INFO: `/v3/users/73ca9016c2af46cd9770894b1a51be5c` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:14.362652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ca9016c2af46cd9770894b1a51be5c)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:14.364579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:14.428154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ca9016c2af46cd9770894b1a51be5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:14.428872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ca9016c2af46cd9770894b1a51be5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:14.439166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ca9016c2af46cd9770894b1a51be5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:14.448718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ca9016c2af46cd9770894b1a51be5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:14.449918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ca9016c2af46cd9770894b1a51be5c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:14.473303 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4260/8512] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:14 2022] DELETE /identity/v3/users/73ca9016c2af46cd9770894b1a51be5c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:14.478564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:14.478849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:14.479148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:14.501794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:14.503320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:14.580281 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4253/8513] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:14.592136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:14.593758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:14.665933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf750e0-9ae1-4feb-88af-2ec99e0a1a7b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:14.670479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:14.671262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:14.671632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:14.672083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:14.685113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:14.686685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce52fd-5ce9-4cfa-a079-86b1518bd6c4 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:14.697560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4261/8514] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:15.092473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.094290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:15.108683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de9927-e7d4-4b8b-8b4a-263610922648 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.114226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.115144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.115660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.116165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] PATH_INFO: `/v3/projects/5b512cdc6da2431bb854d5befa53e4b6` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.117558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b512cdc6da2431bb854d5befa53e4b6)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.125431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.188096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b512cdc6da2431bb854d5befa53e4b6', 'request_id': 'req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:15.195003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b512cdc6da2431bb854d5befa53e4b6', 'request_id': 'req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:15.206452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b512cdc6da2431bb854d5befa53e4b6', 'request_id': 'req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:15.222741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] The token cache is being invalidate because project 5b512cdc6da2431bb854d5befa53e4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:15.223329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:15.224404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-b78a7f2d-b3ce-4793-9de2-3f2dec8ee6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:15.226414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4254/8515] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:15 2022] DELETE /identity/v3/projects/5b512cdc6da2431bb854d5befa53e4b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:15.231834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.232363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.232809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.258423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:15.259627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:15.299982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:15.333010 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4262/8516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:15.341563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.341894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.342285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.364923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:15.366819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:15.377144 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4255/8517] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:15.381441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.391848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f7f3-97d6-43c3-b355-931c92353857 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.396941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.397557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.397836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.398168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.398829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:34:15.399129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.400746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.419104 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4263/8518] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:34:15.419914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.436941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45b96-5d46-4df8-a752-7de5ded0c424 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.445538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.446166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.446754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.447018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.448259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.451651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.486837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4256/8519] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:15.490710 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.518367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a644-0fe6-4254-b347-8215bbdd5f82 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.622518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.623466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.623466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.623715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.624469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.636852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.708572 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4264/8520] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:15 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:15.710701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.725853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a9c3-86ac-4995-9ad0-95fe3531c784 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.732634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.733419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.733699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.733970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.736852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.739439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.755625 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4257/8521] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:15.757525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.772509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d3b9-a6c1-4a26-b8aa-6202dde6c4ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.779339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.779964 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.780243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.780511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.781238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.784248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1490-f607-4f6f-9888-1c14ae449d14 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.798229 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4265/8522] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:15.802422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.814623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0fbff-a897-4967-9c6a-ab331fa9b689 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.821160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.821160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.821688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.821877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] PATH_INFO: `/v3/projects/347d9abc23ba413993eecea9369c5e64/users/4303ff239a71418ab10ee7c1b219c513/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.825320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:15.848451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=347d9abc23ba413993eecea9369c5e64, user_id=4303ff239a71418ab10ee7c1b219c513, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.851178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.865781 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4258/8523] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:15 2022] PUT /identity/v3/projects/347d9abc23ba413993eecea9369c5e64/users/4303ff239a71418ab10ee7c1b219c513/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:15.877360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.877761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.878105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.907528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] MFA Rules not processed for user `4303ff239a71418ab10ee7c1b219c513`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:15.909119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:16.007631 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4266/8524] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:16.016228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:16.018161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:16.102934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10ba8-1b2e-4d9c-ace6-adbab8723d4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:16.112404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:16.113329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:16.113849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:16.114559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:16.125023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:16.126462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3ab05-8bc2-4fd4-bdea-317bc1579b38 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:16.136715 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4259/8525] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:16.464469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:16.508467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:16.537540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8451a-5683-4131-a9b1-dc85ff0c2077 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:16.543582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:16.544325 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:16.544671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:16.545041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] PATH_INFO: `/v3/users/4303ff239a71418ab10ee7c1b219c513` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:16.546338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4303ff239a71418ab10ee7c1b219c513)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:16.550083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:16.639096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4303ff239a71418ab10ee7c1b219c513'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:16.639925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4303ff239a71418ab10ee7c1b219c513'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:16.652971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4303ff239a71418ab10ee7c1b219c513'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:16.663034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4303ff239a71418ab10ee7c1b219c513'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:16.663638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4303ff239a71418ab10ee7c1b219c513'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:16.687724 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4267/8526] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:16 2022] DELETE /identity/v3/users/4303ff239a71418ab10ee7c1b219c513 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:16.692222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:16.692510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:16.692781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:16.715930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:16.717333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:16.798774 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4260/8527] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:16.808684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:16.810600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:16.897150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153315-041a-4c6c-a5e1-97c8ffcf0478 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:16.902022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:16.902601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:16.902886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:16.903157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:16.917189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:16.918694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800fe0f-f106-4a12-a46c-f0ddd75859ef service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:16.931075 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4268/8528] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:17.326069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.328258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:17.352253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc9af-7282-4a27-b71b-ce6a2da3ef90 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.361130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.361919 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.362258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.363396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] PATH_INFO: `/v3/projects/347d9abc23ba413993eecea9369c5e64` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.364867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347d9abc23ba413993eecea9369c5e64)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.367015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.419847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347d9abc23ba413993eecea9369c5e64', 'request_id': 'req-0ca488aa-5473-4173-8867-8725702df135'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:17.426505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347d9abc23ba413993eecea9369c5e64', 'request_id': 'req-0ca488aa-5473-4173-8867-8725702df135'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:17.435693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347d9abc23ba413993eecea9369c5e64', 'request_id': 'req-0ca488aa-5473-4173-8867-8725702df135'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:17.449081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] The token cache is being invalidate because project 347d9abc23ba413993eecea9369c5e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:17.449390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:17.450016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-0ca488aa-5473-4173-8867-8725702df135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:17.455531 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4261/8529] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:17 2022] DELETE /identity/v3/projects/347d9abc23ba413993eecea9369c5e64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:17.457385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.457675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.457943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.478379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:17.479653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:17.535895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:17.556262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.556583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.557558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.558161 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4269/8530] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:17.581936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:17.583097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:17.597268 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4262/8531] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:17.598372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.613839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dd53-f584-4534-bef5-710eb18089da None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.618919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.620560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.620969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.621338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.622246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:34:17.622794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.624546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.644952 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4270/8532] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:34:17.649973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.655357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:17.662037 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7e9c5-e1c1-45c4-bab1-ddfb8361f2dc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.668492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.669138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.669419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.669716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.670349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.672408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.703237 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4263/8533] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:17 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:17.707014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.717684 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a262-2387-4b13-812c-63c56c727547 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.779201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.779854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.780233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.780511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.781198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.783570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.808474 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4271/8534] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:17 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:17.812413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.823641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab833d-1436-4b87-9263-43081eca563d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.828567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.829203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.829487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.829786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.830450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.832112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.842991 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4264/8535] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:17.846923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.858611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac9081-9f54-4b6f-9745-8576c6ea6f62 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.863453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.864208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.864557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.864961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.865658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.868360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166a37-064a-4941-8f83-ea2505ee1261 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.880597 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4272/8536] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:17.884613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:17.895047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52acd6-ecb6-41f8-91ec-15e8867cd8b5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:17.900066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:17.900746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.901099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.901373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] PATH_INFO: `/v3/projects/5515f1d006a94a7ead59adc3f8f1a113/users/d6ba79289cbc43db8c37e40de4554bef/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.919815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5515f1d006a94a7ead59adc3f8f1a113, user_id=d6ba79289cbc43db8c37e40de4554bef, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:17.922590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:17.940482 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4265/8537] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:17 2022] PUT /identity/v3/projects/5515f1d006a94a7ead59adc3f8f1a113/users/d6ba79289cbc43db8c37e40de4554bef/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:17.945761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d8f1-dac0-491a-85e8-d1713e75d85c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:17.946216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d8f1-dac0-491a-85e8-d1713e75d85c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:17.946880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d8f1-dac0-491a-85e8-d1713e75d85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:17.968063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f717d8f1-dac0-491a-85e8-d1713e75d85c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:17.969448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f717d8f1-dac0-491a-85e8-d1713e75d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:18.034370 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4273/8538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:18.044620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:18.046573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:18.112940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e732-4011-4cb4-9aa7-f85e5de67a99 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:18.117296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:18.118329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:18.118527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:18.118800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:18.129921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:18.131358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:18.142426 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4266/8539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:18.896890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:18.897776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:18.898277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:18.934205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] MFA Rules not processed for user `d6ba79289cbc43db8c37e40de4554bef`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:18.935752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:19.017278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:19.036823 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4274/8540] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:19.037893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.050326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079ac3c-a617-449f-8af9-f90fc9586f5c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.055467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.056075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.056351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.056619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.057759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.059967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.106812 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4267/8541] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:19 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:19.108372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.121188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba26f9-db3a-45d3-9434-1fb868193ddb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.181946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.182510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.182789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.183056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.183679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.185637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.207697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4275/8542] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:19 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:19.211677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.223002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a576-626b-4a2c-ba1f-ae8bdfd89d4e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.227833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.228459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.228746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.229106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.229756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.231370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.246430 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4268/8543] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:34:19.247630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.259143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0c766-209c-4a31-81ac-1a46a5f27c6c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.264896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.265871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.266223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.266570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] PATH_INFO: `/v3/projects/3226cb2405bc4975b3e62835921e757d/users/f72aa5e3df794ae684991b1a57215e40/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.284073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3226cb2405bc4975b3e62835921e757d, user_id=f72aa5e3df794ae684991b1a57215e40, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.286932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.302315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4276/8544] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:19 2022] PUT /identity/v3/projects/3226cb2405bc4975b3e62835921e757d/users/f72aa5e3df794ae684991b1a57215e40/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:19.306118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.317091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ef93-e8be-4a69-9a24-f00212c12237 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.386150 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.387033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.387408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.387871 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.388624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.390495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0afbc1-1dca-44ec-8555-d58346e8aa16 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.405814 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4269/8545] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:19.407064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:19.424719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3da03-22a7-4ea1-b670-0ddf76e084db admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:19.432149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:19.433037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:19.433412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:19.433841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] PATH_INFO: `/v3/projects/3226cb2405bc4975b3e62835921e757d/users/f72aa5e3df794ae684991b1a57215e40/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:19.436506 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3226cb2405bc4975b3e62835921e757d, user_id=f72aa5e3df794ae684991b1a57215e40, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:19.440437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:19.454796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4277/8546] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:19 2022] PUT /identity/v3/projects/3226cb2405bc4975b3e62835921e757d/users/f72aa5e3df794ae684991b1a57215e40/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:20.263267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:20.263847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:20.264251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:20.291965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:20.305373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] MFA Rules not processed for user `f72aa5e3df794ae684991b1a57215e40`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:20.308497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:20.410522 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4270/8547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:21.636688 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:21.710482 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48220caa-2d70-4aac-bd27-958e9b1f23b6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:21.715649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:21.716280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:21.716611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:21.716891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] PATH_INFO: `/v3/users/d6ba79289cbc43db8c37e40de4554bef` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:21.718138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ba79289cbc43db8c37e40de4554bef)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:21.720138 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:21.797671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ba79289cbc43db8c37e40de4554bef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:21.798952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ba79289cbc43db8c37e40de4554bef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:21.801347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:21.817908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ba79289cbc43db8c37e40de4554bef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:21.836032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ba79289cbc43db8c37e40de4554bef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:21.837096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ba79289cbc43db8c37e40de4554bef'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:21.857207 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4278/8548] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:21 2022] DELETE /identity/v3/users/d6ba79289cbc43db8c37e40de4554bef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:22.045251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:22.072355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868658d-97da-444c-9aef-6e233a7576f4 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:22.151038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:22.151999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:22.152448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:22.152894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] PATH_INFO: `/v3/projects/5515f1d006a94a7ead59adc3f8f1a113` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:22.154170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5515f1d006a94a7ead59adc3f8f1a113)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:22.156311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:22.218387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5515f1d006a94a7ead59adc3f8f1a113', 'request_id': 'req-cef32a88-1e10-4aaf-be02-40926fe925b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.225110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5515f1d006a94a7ead59adc3f8f1a113', 'request_id': 'req-cef32a88-1e10-4aaf-be02-40926fe925b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.235678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5515f1d006a94a7ead59adc3f8f1a113', 'request_id': 'req-cef32a88-1e10-4aaf-be02-40926fe925b6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.249639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] The token cache is being invalidate because project 5515f1d006a94a7ead59adc3f8f1a113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:22.249932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.250816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.252410 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4271/8549] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:22 2022] DELETE /identity/v3/projects/5515f1d006a94a7ead59adc3f8f1a113 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:22.256720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:22.258322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:22.272726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f76e3-75c1-4101-b6a7-7a4e8f2bbacd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:22.344990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:22.345771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:22.346067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:22.346372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] PATH_INFO: `/v3/users/f72aa5e3df794ae684991b1a57215e40` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:22.347718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72aa5e3df794ae684991b1a57215e40)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:22.350276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:22.398870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72aa5e3df794ae684991b1a57215e40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.399643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72aa5e3df794ae684991b1a57215e40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.407953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72aa5e3df794ae684991b1a57215e40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.415372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72aa5e3df794ae684991b1a57215e40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.416039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2b4e7557-44ba-4c1a-bc1d-3e577225b465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72aa5e3df794ae684991b1a57215e40'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.435167 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4279/8550] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:22 2022] DELETE /identity/v3/users/f72aa5e3df794ae684991b1a57215e40 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:22.645949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:22.647768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:22.677200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32a88-1e10-4aaf-be02-40926fe925b6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:22.710766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:22.754850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:22.755495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:22.755973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:22.756077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] PATH_INFO: `/v3/projects/3226cb2405bc4975b3e62835921e757d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:22.757217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3226cb2405bc4975b3e62835921e757d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:22.759086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:22.817817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3226cb2405bc4975b3e62835921e757d', 'request_id': 'req-c79aa6ad-d2c2-4092-af52-b88736ff04bf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.825367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3226cb2405bc4975b3e62835921e757d', 'request_id': 'req-c79aa6ad-d2c2-4092-af52-b88736ff04bf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.845408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3226cb2405bc4975b3e62835921e757d', 'request_id': 'req-c79aa6ad-d2c2-4092-af52-b88736ff04bf'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.862178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] The token cache is being invalidate because project 3226cb2405bc4975b3e62835921e757d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:22.862473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.863403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-c79aa6ad-d2c2-4092-af52-b88736ff04bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:22.865362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4272/8551] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:22 2022] DELETE /identity/v3/projects/3226cb2405bc4975b3e62835921e757d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:22.870737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:22.871286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:22.871286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:22.892193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:22.893436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:22.939419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:22.962673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4280/8552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:22.970315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:22.970605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:22.970879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:22.992401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:22.993564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:23.005562 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4273/8553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:23.008149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.027522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857b03-10a5-4260-9947-748e7c89cde4 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.032454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.033333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.033608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.033875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.034520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:34:23.034814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.036422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.055570 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4281/8554] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:34:23.056708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.068477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ec0d-ca79-4e1a-907b-eb5af0ae0407 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.073574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.074189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.074470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.074737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.075366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.077313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.110937 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4274/8555] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:23 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:23.112109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.124130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b715-afdb-42a8-862e-8ddca36e8aa6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.185168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.185837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.186117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.186389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.187031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.189043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.211582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4282/8556] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:23 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:23.215938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.227470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd83b42-ac3e-4e4c-8765-dd1579aac6f2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.232975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.233623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.233905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.234178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.234818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.236432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.247999 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4275/8557] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:23.252069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.264174 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed042-dce4-4111-adee-099cf56a369a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.269072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.269677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.269982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.270248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.270882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.272474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43cc-6923-4b77-b387-e79118927bc4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.283978 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4283/8558] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:23.290004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.302371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ff5e5-9fed-4b82-a326-0d9453b364ab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.308233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.309031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.309316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.309593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] PATH_INFO: `/v3/projects/f38a45fc690042bda3af5675dd611033/users/19a5fa8160684d31a485587c9400af00/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.327910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38a45fc690042bda3af5675dd611033, user_id=19a5fa8160684d31a485587c9400af00, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.331589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.349297 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4276/8559] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:23 2022] PUT /identity/v3/projects/f38a45fc690042bda3af5675dd611033/users/19a5fa8160684d31a485587c9400af00/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:23.360379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.360595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.360868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.405378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] MFA Rules not processed for user `19a5fa8160684d31a485587c9400af00`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:23.406866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:23.496385 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4284/8560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:23.497452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.573344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:23.593104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47730fb7-634f-470d-8369-5f92df9b1e50 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.608657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.609320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.609600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.609873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.610515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.612422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.644445 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4277/8561] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:23 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:23.648721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.669451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07c62-470c-4c1d-8dfd-2b7a11fe5fed None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.723915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:23.750398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.751385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.751826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.752379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.753243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.756854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.802126 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4285/8562] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:23 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:34:23.806291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.831769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb37ac-eacf-487f-8a38-ec5298d455d8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.837194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.838853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.839390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.839796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.840454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.842388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.855018 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4278/8563] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:23.859418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.870113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b31e-abe0-4fd8-946b-8603cae348b3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:23.875392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:23.876488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:23.876769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:23.877102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] PATH_INFO: `/v3/projects/7be68df07dc44d5fb5579f754ba899af/users/3268227b50c74e7399deec74ad836b57/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:23.913239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be68df07dc44d5fb5579f754ba899af, user_id=3268227b50c74e7399deec74ad836b57, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:23.916309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:23.937418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4286/8564] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:23 2022] PUT /identity/v3/projects/7be68df07dc44d5fb5579f754ba899af/users/3268227b50c74e7399deec74ad836b57/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:34:23.941605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:23.954173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48d724-2b98-4a53-8595-d12c3758c110 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:24.030322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:24.032976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:24.033271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:24.034220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:24.035040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:24.036673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278098d-b0a0-4547-819b-1dcb7a412b56 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:24.068832 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4279/8565] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:34:24.078350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:24.091546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25f6f-0f25-4900-b82b-2da5efa4d400 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:24.098472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:24.099252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:24.099539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:24.099813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] PATH_INFO: `/v3/projects/7be68df07dc44d5fb5579f754ba899af/users/3268227b50c74e7399deec74ad836b57/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:24.101986 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be68df07dc44d5fb5579f754ba899af, user_id=3268227b50c74e7399deec74ad836b57, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:24.105343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:24.133782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4287/8566] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:24 2022] PUT /identity/v3/projects/7be68df07dc44d5fb5579f754ba899af/users/3268227b50c74e7399deec74ad836b57/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:24.147496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:24.148084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:24.148366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:24.185398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] MFA Rules not processed for user `3268227b50c74e7399deec74ad836b57`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:24.186637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:24.294961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4280/8567] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:24.321142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:24.332559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:24.466965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b3e9-502c-435c-a6a9-4ba0ea424204 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:24.472264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:24.473179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:24.474362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:24.474677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:24.486211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:24.487686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67bca3-d6ee-4418-ba14-f73e2b3a3050 service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:24.500031 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4288/8568] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:25.324324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:25.381455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:25.397632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59e6b7-fe74-4124-aad6-e6d0c7a15e78 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:25.407968 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:25.408697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:25.409003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:25.409477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] PATH_INFO: `/v3/users/19a5fa8160684d31a485587c9400af00` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:25.412179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a5fa8160684d31a485587c9400af00)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:25.414476 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:25.486519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a5fa8160684d31a485587c9400af00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:25.487629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a5fa8160684d31a485587c9400af00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:25.488653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a5fa8160684d31a485587c9400af00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:25.500211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a5fa8160684d31a485587c9400af00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:25.508643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a5fa8160684d31a485587c9400af00'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:25.528318 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4281/8569] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:25 2022] DELETE /identity/v3/users/19a5fa8160684d31a485587c9400af00 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:25.532811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:25.533295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:25.533419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:25.554422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:25.555866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:25.629189 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4289/8570] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:25.641239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:25.642680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:25.711106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe95105-6350-42ee-8862-b4a9940bf648 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:25.715359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:25.715976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:25.716259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:25.716560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:25.726655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:25.728002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:25.739398 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4282/8571] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:34:26.030672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:26.032212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:26.046406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57ed1c-3dac-4228-95d8-a310a041cbc9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:26.051690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:26.052498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.052755 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.053052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] PATH_INFO: `/v3/projects/f38a45fc690042bda3af5675dd611033` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.054170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38a45fc690042bda3af5675dd611033)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:26.056076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:26.081125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:26.106640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38a45fc690042bda3af5675dd611033', 'request_id': 'req-371fcc03-006d-418f-9eb6-a12761a3e05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.112587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38a45fc690042bda3af5675dd611033', 'request_id': 'req-371fcc03-006d-418f-9eb6-a12761a3e05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.119787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38a45fc690042bda3af5675dd611033', 'request_id': 'req-371fcc03-006d-418f-9eb6-a12761a3e05a'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.131078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] The token cache is being invalidate because project f38a45fc690042bda3af5675dd611033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:26.131371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.132018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.133567 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4290/8572] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:26 2022] DELETE /identity/v3/projects/f38a45fc690042bda3af5675dd611033 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:26.138057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:26.147935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511071f-01f5-42c1-9913-9d941130469f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:26.248534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:26.249809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.249809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.250035 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] PATH_INFO: `/v3/users/3268227b50c74e7399deec74ad836b57` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.251203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3268227b50c74e7399deec74ad836b57)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:26.253229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:26.269090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:26.316203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3268227b50c74e7399deec74ad836b57'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.316970 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3268227b50c74e7399deec74ad836b57'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.317659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3268227b50c74e7399deec74ad836b57'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.326736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3268227b50c74e7399deec74ad836b57'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.341038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-98fe671f-3454-46ec-995e-784510941c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3268227b50c74e7399deec74ad836b57'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.366688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4283/8573] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:26 2022] DELETE /identity/v3/users/3268227b50c74e7399deec74ad836b57 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:34:26.659935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:26.661419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:26.677268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fcc03-006d-418f-9eb6-a12761a3e05a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:26.738911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:26.739588 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.739869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.740194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] PATH_INFO: `/v3/projects/7be68df07dc44d5fb5579f754ba899af` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.741329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be68df07dc44d5fb5579f754ba899af)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:26.743223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:26.789262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be68df07dc44d5fb5579f754ba899af', 'request_id': 'req-466383fc-d70a-47a9-8abf-98b3d9f68663'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.795217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be68df07dc44d5fb5579f754ba899af', 'request_id': 'req-466383fc-d70a-47a9-8abf-98b3d9f68663'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.804036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be68df07dc44d5fb5579f754ba899af', 'request_id': 'req-466383fc-d70a-47a9-8abf-98b3d9f68663'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.816017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] The token cache is being invalidate because project 7be68df07dc44d5fb5579f754ba899af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:26.816303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.817080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-466383fc-d70a-47a9-8abf-98b3d9f68663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:26.818793 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4291/8574] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:26 2022] DELETE /identity/v3/projects/7be68df07dc44d5fb5579f754ba899af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:26.824092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.824378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.824644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.844793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:26.845965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:26.907236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4284/8575] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:26.915644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.916002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.916847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.937405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:26.938685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:26.947061 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4292/8576] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:26.951355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:26.962254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7298-991d-40d3-b00f-c7bfbc4abca9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:26.967127 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:26.967763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:26.968041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:26.968315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:26.968984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:34:26.969289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:26.970974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:26.987427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4285/8577] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:34:26.988476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:26.998707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e5912-cb26-41ef-a33f-58fce3046bc5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.003332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.003920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.004195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.004459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.005137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.007062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.035717 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4293/8578] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:26 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:27.040097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.050886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4c57-f3cc-43bf-8bf7-3852ef070f72 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.113384 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.114051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.114318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.114580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.115216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.117244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.140321 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4286/8579] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:27 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:27.144441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.155852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182ea4-403c-493f-a92f-1063e5cb8801 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.160505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.161146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.161427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.161698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.162361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.163961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.169831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:27.175927 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4294/8580] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:34:27.179257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.189985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f5cc-f6bd-4a3c-a51f-1e7d460faff8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.194754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.195382 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.195676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.195929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.196824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.198448 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633abb8-93c4-405a-9e84-1f9a8a9dc7f9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.199757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:27.214176 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4287/8581] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:27.215592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.227026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744fc3-1693-4f72-aafc-9fcdf0d4f154 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.232881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.233518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.233800 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.234072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] PATH_INFO: `/v3/projects/a0e49bd2aee644769e4c27406a147d5d/users/6a374a9ff66042cbbdadd79bf36e5d4d/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.251250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e49bd2aee644769e4c27406a147d5d, user_id=6a374a9ff66042cbbdadd79bf36e5d4d, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.254363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.269898 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4295/8582] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:27 2022] PUT /identity/v3/projects/a0e49bd2aee644769e4c27406a147d5d/users/6a374a9ff66042cbbdadd79bf36e5d4d/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:27.280175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.280463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.280737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.318579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] MFA Rules not processed for user `6a374a9ff66042cbbdadd79bf36e5d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:27.319770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:27.385594 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4288/8583] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:27.390035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.452108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8539a-47fa-4689-9034-60ed81de1879 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.457001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.457746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.458031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.458299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.458933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.461022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.488782 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4296/8584] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:34:27 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:27.493000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.503982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460d2f4-b2c5-4cc6-a837-97210aa2efaa None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.564727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.565473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.565850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.567824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.567824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.569262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.612953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4289/8585] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:34:27 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:34:27.616626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.627394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a15f57-83ea-4bb8-8d3c-2a5b754c55f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.633584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.634244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.634528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.634797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.636059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.637717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.653183 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4297/8586] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:27.654366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.664769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c40d5f-70af-4fb6-9762-7716c7ec046d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.669653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.670540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.670768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.671207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] PATH_INFO: `/v3/projects/fe13384cc3a14d8fa68099e876b6b617/users/34c7dc8157844eed91f7130f55eb9b17/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.691490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe13384cc3a14d8fa68099e876b6b617, user_id=34c7dc8157844eed91f7130f55eb9b17, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.694451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.712618 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4290/8587] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:27 2022] PUT /identity/v3/projects/fe13384cc3a14d8fa68099e876b6b617/users/34c7dc8157844eed91f7130f55eb9b17/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:27.717106 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.729451 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c766e-d145-4acf-886c-71af8cba02c2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.794438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.795134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.795413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.795681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.796310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.797993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82a28d-d25f-420c-ac6a-3f6741bc485a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.808152 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4298/8588] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:34:27.812178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.823512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e750c-f973-4417-9c2f-e14f39de241a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:27.828180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:27.828830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.829148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.829425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] PATH_INFO: `/v3/projects/fe13384cc3a14d8fa68099e876b6b617/users/34c7dc8157844eed91f7130f55eb9b17/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.831339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe13384cc3a14d8fa68099e876b6b617, user_id=34c7dc8157844eed91f7130f55eb9b17, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:27.834034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:27.844948 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4291/8589] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:34:27 2022] PUT /identity/v3/projects/fe13384cc3a14d8fa68099e876b6b617/users/34c7dc8157844eed91f7130f55eb9b17/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:27.855847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:27.856216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:27.856525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:27.884763 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] MFA Rules not processed for user `34c7dc8157844eed91f7130f55eb9b17`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:27.886612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:27.921819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:27.959265 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4299/8590] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:27.970889 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:27.972668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:28.016339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:28.034961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81551-1461-4cba-95bb-0b0e54f53d9e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:28.038710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:28.039756 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:28.040033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:28.040302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:28.098325 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:28.099736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc81a73-23a7-42aa-aa39-e9775d50a66e service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:28.108589 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4292/8591] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:36.138118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:36.139536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:36.216083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836b662-7457-4d3f-a315-c91d374bc87f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:36.221298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:36.222058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:36.222408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:36.222749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] PATH_INFO: `/v3/users/b4f8640cedf149239fafa92963fe0d9e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:36.224154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f8640cedf149239fafa92963fe0d9e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:36.226400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:36.285718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f8640cedf149239fafa92963fe0d9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:36.286479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f8640cedf149239fafa92963fe0d9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:36.297469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f8640cedf149239fafa92963fe0d9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:36.306388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f8640cedf149239fafa92963fe0d9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:36.307219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f8640cedf149239fafa92963fe0d9e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:36.332491 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4300/8592] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:34:36 2022] DELETE /identity/v3/users/b4f8640cedf149239fafa92963fe0d9e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:36.337869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:36.338917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:36.339430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:36.361070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:36.362509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:36.436191 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4293/8593] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:36.446470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:36.448701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:36.514991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c198-d011-4fc8-adea-598b5485fe5d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:36.518952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:36.519558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:36.519836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:36.520135 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:36.527146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:36.532028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:36.534189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b667a-d278-411b-996a-b8eececfb0a1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:36.549585 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4301/8594] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:36.970548 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:36.972322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:36.987996 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e9ff5-43fc-4803-a300-8d48b68062ea None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:37.007682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:37.008598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:37.009027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:37.009875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] PATH_INFO: `/v3/projects/13d4324ba56247f3996afe999b1d48e7` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:37.011828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d4324ba56247f3996afe999b1d48e7)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:37.014685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:37.090883 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d4324ba56247f3996afe999b1d48e7', 'request_id': 'req-528a2e64-83c3-432d-98c9-ff0ab365b32c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:37.097077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d4324ba56247f3996afe999b1d48e7', 'request_id': 'req-528a2e64-83c3-432d-98c9-ff0ab365b32c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:37.109284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d4324ba56247f3996afe999b1d48e7', 'request_id': 'req-528a2e64-83c3-432d-98c9-ff0ab365b32c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:37.125177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] The token cache is being invalidate because project 13d4324ba56247f3996afe999b1d48e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:34:37.125610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:37.126442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:34:37.128532 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4294/8595] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:34:36 2022] DELETE /identity/v3/projects/13d4324ba56247f3996afe999b1d48e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:34:38.938056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08830d0a-c657-408d-8821-21884bffba04 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:38.938500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08830d0a-c657-408d-8821-21884bffba04 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:38.938747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08830d0a-c657-408d-8821-21884bffba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:38.959224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-08830d0a-c657-408d-8821-21884bffba04 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:38.960413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08830d0a-c657-408d-8821-21884bffba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:39.015382 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4302/8596] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:39.063917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:39.065427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:39.088003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:39.151878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a2e64-83c3-432d-98c9-ff0ab365b32c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:39.156881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:39.157531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:39.157811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:39.158083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:39.166249 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:39.167806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:39.176204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4295/8597] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:39.502574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08830d0a-c657-408d-8821-21884bffba04 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:39.504975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-08830d0a-c657-408d-8821-21884bffba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:39.637237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08830d0a-c657-408d-8821-21884bffba04 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:39.642907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:39.643527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:39.643806 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:39.644076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:39.648779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:39.664358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:39.666766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca484-0bc0-4748-99cf-ff772c360e73 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:39.682649 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4303/8598] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:39.869554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:39.882369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e38c01-c705-4d82-97c2-13f2f177b9a1 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:39.887523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:39.888321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:39.888595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:39.888863 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:39.890672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:39.960162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:39.961759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:39.970688 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4296/8599] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:49.675090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=60 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:49.967251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=53 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:57.169456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:57.170086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:57.170086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:57.190295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:57.191502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:57.250142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4304/8600] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:35:07.243302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=25 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:13.324192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:35:13.325658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:35:13.386272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a116e0-742d-4e2c-ac17-f215a0eb5e81 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:35:13.389837 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:35:13.390438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:35:13.390712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:35:13.390978 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:35:13.392653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:35:13.457825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:35:13.459237 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:35:13.469569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4297/8601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:35:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:35:19.689993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:35:19.691459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:35:19.753440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496322d6-6be4-4058-95eb-bf869a0c54be None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:35:19.757129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:35:19.757758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:35:19.758034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:35:19.758301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:35:19.760648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:35:19.828264 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:35:19.829650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:35:19.841617 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4305/8602] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:35:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:35:23.465188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=50 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:29.835094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=50 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:37.964811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:35:37.981487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e2a78-e1e0-4909-9968-f8a53e412a25 service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:35:37.986785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:35:37.987386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:35:37.987657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:35:37.987921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:35:37.997215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:35:37.999093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19eec3-9bb0-486a-8e04-2141419576cf service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:35:38.008818 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4298/8603] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:35:48.004842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:31.537514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:31.538949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:31.617056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0703817-3bc0-49f1-9506-491250dcfc35 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:31.621776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:31.622419 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:31.622695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:31.623012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] PATH_INFO: `/v3/users/6a374a9ff66042cbbdadd79bf36e5d4d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:31.624101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a374a9ff66042cbbdadd79bf36e5d4d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:31.626069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:31.676413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a374a9ff66042cbbdadd79bf36e5d4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:31.677103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a374a9ff66042cbbdadd79bf36e5d4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:31.686214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a374a9ff66042cbbdadd79bf36e5d4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:31.693571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a374a9ff66042cbbdadd79bf36e5d4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:31.694239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a374a9ff66042cbbdadd79bf36e5d4d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:31.712257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4306/8604] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:36:31 2022] DELETE /identity/v3/users/6a374a9ff66042cbbdadd79bf36e5d4d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:31.716745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:31.717306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:31.717407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:31.737509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:31.738742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:31.799987 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4299/8605] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:31.810392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:31.811897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:31.874255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c06d0-1eea-42d8-8bec-200d4ac3505b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:31.878073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:31.878711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:31.878989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:31.879288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:31.888711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:31.890799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:31.900677 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4307/8606] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:32.180640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:32.182139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:32.195760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a62ca-b3ae-445e-8939-2922937cb384 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:32.201052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:32.202296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:32.202486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:32.202789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] PATH_INFO: `/v3/projects/a0e49bd2aee644769e4c27406a147d5d` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:32.203998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e49bd2aee644769e4c27406a147d5d)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:32.206241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:32.258430 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e49bd2aee644769e4c27406a147d5d', 'request_id': 'req-59173dbc-267b-4997-8eb9-c0ea3a8f7844'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.264116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e49bd2aee644769e4c27406a147d5d', 'request_id': 'req-59173dbc-267b-4997-8eb9-c0ea3a8f7844'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.271203 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e49bd2aee644769e4c27406a147d5d', 'request_id': 'req-59173dbc-267b-4997-8eb9-c0ea3a8f7844'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.282259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] The token cache is being invalidate because project a0e49bd2aee644769e4c27406a147d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:36:32.282547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.283177 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.284671 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4300/8607] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:36:32 2022] DELETE /identity/v3/projects/a0e49bd2aee644769e4c27406a147d5d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:32.288753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:32.298953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d49338-34a9-4a97-b1d9-a9840c6c4654 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:32.317336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:32.357526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:32.358721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:32.358999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:32.359271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] PATH_INFO: `/v3/users/34c7dc8157844eed91f7130f55eb9b17` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:32.360391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c7dc8157844eed91f7130f55eb9b17)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:32.362347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:32.410044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c7dc8157844eed91f7130f55eb9b17'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.410716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c7dc8157844eed91f7130f55eb9b17'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.419908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c7dc8157844eed91f7130f55eb9b17'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.428722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c7dc8157844eed91f7130f55eb9b17'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.429485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2a1abb73-464b-4f5b-9684-ce7055507714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c7dc8157844eed91f7130f55eb9b17'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.447181 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4308/8608] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:36:32 2022] DELETE /identity/v3/users/34c7dc8157844eed91f7130f55eb9b17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:32.723653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:32.725208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:32.739131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173dbc-267b-4997-8eb9-c0ea3a8f7844 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:32.796317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:32.796954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:32.797266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:32.797498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] PATH_INFO: `/v3/projects/fe13384cc3a14d8fa68099e876b6b617` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:32.798610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe13384cc3a14d8fa68099e876b6b617)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:32.800493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:32.832603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:32.850195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe13384cc3a14d8fa68099e876b6b617', 'request_id': 'req-73044995-4d0b-4e12-83bf-209722f0438e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.855754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe13384cc3a14d8fa68099e876b6b617', 'request_id': 'req-73044995-4d0b-4e12-83bf-209722f0438e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.863243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe13384cc3a14d8fa68099e876b6b617', 'request_id': 'req-73044995-4d0b-4e12-83bf-209722f0438e'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.874739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] The token cache is being invalidate because project fe13384cc3a14d8fa68099e876b6b617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:36:32.875023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.875672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-73044995-4d0b-4e12-83bf-209722f0438e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:32.877188 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4301/8609] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:36:32 2022] DELETE /identity/v3/projects/fe13384cc3a14d8fa68099e876b6b617 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:32.882006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:32.884164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:32.884164 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:32.913750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:32.915001 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:32.975768 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4309/8610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:32.984031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:32.984314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:32.984589 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.005015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:33.006232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:33.014186 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4302/8611] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:33.018361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.027961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198410cd-f222-43b2-8fb0-94a488f715f9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.032921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.033518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.033798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.034072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.034714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:36:33.035017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.036615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.048783 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4310/8612] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:36:33.052771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.062642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6fd6e-ccfd-4c01-9e39-7dffff2901b6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.067367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.067984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.068264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.068534 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.069265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.071153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.098207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4303/8613] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:36:33 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:36:33.102574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.112887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31d068-6d29-429b-84a5-b1b8c2cc5e66 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.138897 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:33.170689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.171283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.171555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.171816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.172429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.174350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.195338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4311/8614] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:36:33 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:36:33.199704 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.210051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c505f-a104-460f-ab51-56b771cc4d0b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.214773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.215363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.215642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.215912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.216541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.218193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.228359 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4304/8615] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:36:33.232380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.243019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26b84d-f679-4476-83af-99c5b8201dce admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.247820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.249059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.249338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.249614 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.250246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.251821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff5e9-340c-4b2a-a76a-4af9fe259ae3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.263623 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4312/8616] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:36:33.268006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.277930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33d88-c740-48d4-8081-611983a61849 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.282639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.283279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.283559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.283831 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] PATH_INFO: `/v3/projects/628e90da965e40aabf219c6698e53e72/users/77ec81f5292f4d0da1df8f61adc9ef4c/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.298648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628e90da965e40aabf219c6698e53e72, user_id=77ec81f5292f4d0da1df8f61adc9ef4c, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.301340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.314300 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4305/8617] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:36:33 2022] PUT /identity/v3/projects/628e90da965e40aabf219c6698e53e72/users/77ec81f5292f4d0da1df8f61adc9ef4c/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:33.324366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ad21-31c7-4436-b2c2-399b8e676030 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.324788 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ad21-31c7-4436-b2c2-399b8e676030 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.325181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ad21-31c7-4436-b2c2-399b8e676030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.353566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7844ad21-31c7-4436-b2c2-399b8e676030 None None] MFA Rules not processed for user `77ec81f5292f4d0da1df8f61adc9ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:33.354666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7844ad21-31c7-4436-b2c2-399b8e676030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:33.427748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4313/8618] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:33.438649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:33.440351 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:33.499895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04e7b-940e-4871-aaa7-e4ac53c90e78 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:33.503562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:33.504155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:33.504433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:33.504705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:33.512874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:33.514380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:33.523097 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4306/8619] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:34.890859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:34.891391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:34.891391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:34.910922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] MFA Rules not processed for user `77ec81f5292f4d0da1df8f61adc9ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:34.911593 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:34.918578 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4314/8620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:34.962549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:34.963949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:35.023077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:35.047121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671dcd-8b90-476a-9fe3-2af9170d2a1d service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:35.050752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:35.051357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:35.051637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:35.051909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:35.053682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:35.126781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:35.128131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:35.151236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4307/8621] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:35.520206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:35.521653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:35.580850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad710-103a-4424-9100-f9e92f7ca918 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:35.584671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:35.585318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:35.585596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:35.585864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:35.587635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:35.604748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:35.606212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:35.620773 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4315/8622] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:42.834043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:42.835629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:42.851089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35fbd0-a684-4ae3-8fa8-4b6e56a4b483 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:42.854822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:42.855422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:42.855700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:42.855967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:42.857668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:42.869490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:42.870900 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4d887-f57a-4826-aee2-4e2992f9e280 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:42.881229 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4308/8623] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:45.613276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:52.875959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=49 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:54.002361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:54.013379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1b8ce-385a-4322-9b73-6ed85972cc3c service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:54.017618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:54.018237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:54.018508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:54.018772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:54.020457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:54.032808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:54.034237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:54.044489 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4316/8624] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:54.510736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1528f2-21cb-4907-a82b-d2f2891589bc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:54.511268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1528f2-21cb-4907-a82b-d2f2891589bc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:54.511268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1528f2-21cb-4907-a82b-d2f2891589bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:54.531241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bb1528f2-21cb-4907-a82b-d2f2891589bc None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:54.532375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb1528f2-21cb-4907-a82b-d2f2891589bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:54.593123 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4309/8625] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:36:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:54.642455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:54.643890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:54.717149 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383134a-8703-46d8-87e8-568cc5d7f8d5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:54.722198 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:54.722819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:54.723108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:54.723380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:54.731381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:54.732982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:54.741939 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4317/8626] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:36:55.257873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f80-a967-4918-86f6-eb4725a4ced5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.258165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f80-a967-4918-86f6-eb4725a4ced5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.258442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f80-a967-4918-86f6-eb4725a4ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.279131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b9eb4f80-a967-4918-86f6-eb4725a4ced5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:55.280358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9eb4f80-a967-4918-86f6-eb4725a4ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:55.287751 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4310/8627] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:55.300208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:55.314047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0ff01-4142-4327-97c9-5da76312fbe9 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:55.319127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:55.319714 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.319991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.320262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.329240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:55.330813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:55.338728 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4318/8628] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:36:55.557336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead0253-a184-4dbc-a5b2-3cd88a6d084f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.557801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead0253-a184-4dbc-a5b2-3cd88a6d084f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.557923 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead0253-a184-4dbc-a5b2-3cd88a6d084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.577424 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-eead0253-a184-4dbc-a5b2-3cd88a6d084f None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:55.578592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eead0253-a184-4dbc-a5b2-3cd88a6d084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:55.585648 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4311/8629] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:55.597625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:55.611215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb3ef-0516-46ce-b79a-6b64dfffbd87 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:55.616303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:55.616890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.617199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.617468 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.625911 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:55.627495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:55.635748 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4319/8630] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:36:55.953888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.954175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.954450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.973698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:55.974874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:55.982285 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4312/8631] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:55.995240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:56.008928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1907268-9d3b-46fc-9be7-a928cb956aa5 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:56.014017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:56.014571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.014849 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.015113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.023815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:56.025424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89957f-e72e-4115-9c37-54628c39861f service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:56.033502 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4320/8632] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:36:59.221601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:59.284628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95f4e-d123-4fa8-8bc5-0d87e1cc34e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:59.289220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:59.289853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.290165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.290433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] PATH_INFO: `/v3/users/77ec81f5292f4d0da1df8f61adc9ef4c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.291591 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ec81f5292f4d0da1df8f61adc9ef4c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:59.293550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:59.342055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ec81f5292f4d0da1df8f61adc9ef4c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.342875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ec81f5292f4d0da1df8f61adc9ef4c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.343696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ec81f5292f4d0da1df8f61adc9ef4c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.351527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ec81f5292f4d0da1df8f61adc9ef4c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.358717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ec81f5292f4d0da1df8f61adc9ef4c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.377072 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4313/8633] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:36:59 2022] DELETE /identity/v3/users/77ec81f5292f4d0da1df8f61adc9ef4c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:59.381373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.381842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.382021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.401621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:59.402854 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:59.464288 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4321/8634] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:59.474736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:59.476284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:59.483793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:59.541718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605627-0fd5-4bce-aee3-2eda1350b890 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:59.546040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:59.546688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.546993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.547261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.557190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:59.558624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398b14-12c6-42ef-9737-9e6922b849c1 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:59.569854 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4314/8635] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:59.755057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:59.756682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:59.770450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a91183-11e6-4d35-a3b0-ef009c366b4c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:59.788021 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:59.788697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.789274 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.789738 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] PATH_INFO: `/v3/projects/628e90da965e40aabf219c6698e53e72` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.791190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628e90da965e40aabf219c6698e53e72)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:59.793616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:59.830525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:59.843166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628e90da965e40aabf219c6698e53e72', 'request_id': 'req-8372bb0e-14ff-4470-9a57-e0e391ab0241'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.851512 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628e90da965e40aabf219c6698e53e72', 'request_id': 'req-8372bb0e-14ff-4470-9a57-e0e391ab0241'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.860105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628e90da965e40aabf219c6698e53e72', 'request_id': 'req-8372bb0e-14ff-4470-9a57-e0e391ab0241'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.872148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] The token cache is being invalidate because project 628e90da965e40aabf219c6698e53e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:36:59.872432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.873103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-8372bb0e-14ff-4470-9a57-e0e391ab0241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:59.874897 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4322/8636] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:36:59 2022] DELETE /identity/v3/projects/628e90da965e40aabf219c6698e53e72 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:59.880190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.880545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.880929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.901662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:59.902858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:59.962306 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4315/8637] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:59.970205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:59.970610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:59.970921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:59.991725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:59.992985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:00.004606 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4323/8638] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:00.005975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.016472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929686a2-1b17-4748-85c2-a4fc238127dc None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.021146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.021744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.022021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.022293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.022936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:37:00.023242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.024834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.037093 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4316/8639] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:37:00.041454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.051286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb22da-e60a-4a0f-949f-2b56e049f53e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.055955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.056555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.056826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.057125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.057757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.059643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.089270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4324/8640] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:37:00 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:37:00.091387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.101983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdae-a66f-4eb2-a415-7ddbda9f8ac8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.163187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.163805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.164080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.164343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.164989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.166924 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.191619 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4317/8641] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:37:00 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:37:00.195748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.208286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487daf5-065f-4305-bf0b-2858acca040a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.212878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.213504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.213780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.214046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.214674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.216260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.227064 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4325/8642] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:37:00.231090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.241276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979830-4276-4377-97cf-6e9954de07f7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.245908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.246502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.246786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.247059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.247695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.249322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf994498-5f92-4b28-ada6-1aa61e10e799 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.259428 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4318/8643] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:37:00.263360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.273838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567306-0e69-4c51-bc5a-5495065eb5b7 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.278401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.279037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.279316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.279585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] PATH_INFO: `/v3/projects/9afd6b602fe349679ef6c1e89f6ca0b1/users/ddb2a1d621b64ea089afa20c08ae13a6/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.294576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afd6b602fe349679ef6c1e89f6ca0b1, user_id=ddb2a1d621b64ea089afa20c08ae13a6, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.297566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.310269 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4326/8644] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:37:00 2022] PUT /identity/v3/projects/9afd6b602fe349679ef6c1e89f6ca0b1/users/ddb2a1d621b64ea089afa20c08ae13a6/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:37:00.321744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.322031 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.322305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.347751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:00.350983 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] MFA Rules not processed for user `ddb2a1d621b64ea089afa20c08ae13a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:00.353002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:00.415613 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4319/8645] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:00.426519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:00.428171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:00.488890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26723aa6-5241-4865-b2b9-b998cfebea67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:00.492569 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:00.493271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:00.493546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:00.493817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:00.502733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:00.504159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:00.513047 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4327/8646] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:10.412795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=26 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:10.508926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:17.337403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:17.338886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:17.424604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658b75-5f89-44f2-974d-d66fe6028336 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:17.430212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:17.430845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:17.431121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:17.431390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:17.433212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:17.495416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:17.497405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62334a63-4f4f-463a-b6a4-378954fc60f0 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:17.507804 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4320/8647] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:17.764115 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:17.847890 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4914ebc-ebcb-43e5-b59c-7ba75ee20e6d service cinder] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:17.852357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:17.853017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:17.853290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:17.853582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] PATH_INFO: `/v3/users/ddb2a1d621b64ea089afa20c08ae13a6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:17.854758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb2a1d621b64ea089afa20c08ae13a6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:17.856664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:17.903265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb2a1d621b64ea089afa20c08ae13a6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:17.903903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb2a1d621b64ea089afa20c08ae13a6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:17.912396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb2a1d621b64ea089afa20c08ae13a6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:17.920621 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb2a1d621b64ea089afa20c08ae13a6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:17.921308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb2a1d621b64ea089afa20c08ae13a6'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:17.940434 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4328/8648] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:37:17 2022] DELETE /identity/v3/users/ddb2a1d621b64ea089afa20c08ae13a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:37:17.944927 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:17.945236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:17.945503 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:17.964331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:17.965538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:18.024350 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4321/8649] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:18.034316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.035762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:18.098586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c62e9-1730-4cff-92c3-77030563a955 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.102298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.102915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.103192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.103461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.113948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.115409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf587acb-3f4a-4ec8-bf81-38f2859fd111 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.126372 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4329/8650] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:37:18.398560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.400108 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:18.414164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eeee3-0e41-44cc-9077-a6ba8c571b19 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.419190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.419830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.420114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.420386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] PATH_INFO: `/v3/projects/9afd6b602fe349679ef6c1e89f6ca0b1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.421554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afd6b602fe349679ef6c1e89f6ca0b1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.424057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.460475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:18.474172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afd6b602fe349679ef6c1e89f6ca0b1', 'request_id': 'req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:18.480378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afd6b602fe349679ef6c1e89f6ca0b1', 'request_id': 'req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:18.488507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afd6b602fe349679ef6c1e89f6ca0b1', 'request_id': 'req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:18.499999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] The token cache is being invalidate because project 9afd6b602fe349679ef6c1e89f6ca0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:37:18.500288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:18.500967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8446c4dd-d1e4-46a0-88da-5daec32c8ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:37:18.502479 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4322/8651] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:37:18 2022] DELETE /identity/v3/projects/9afd6b602fe349679ef6c1e89f6ca0b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:37:18.508230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.508517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.508787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.528056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:18.529292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:18.546787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:18.598562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4330/8652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:18.606399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.606727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.607038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.627570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:18.628778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:18.636794 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4323/8653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:18.641809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.651760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7b0fa-5708-42da-8c68-0ab53887ff45 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.657171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.657803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.658077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.658339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.658990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:37:18.659285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.660993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.677774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4331/8654] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:37:18.678891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.688775 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3e57e-920c-4a2d-b1bb-e26bf9d2086d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.693688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.694313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.694607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.694860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.695495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.697478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.733694 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4324/8655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:37:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:37:18.734864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.745320 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6520-f2b8-43cf-8e4c-2ea8f1f161d9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.802917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.803625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.803762 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.804027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.804634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.806580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.828579 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4332/8656] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:37:18 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:37:18.832795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.843427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a033b-8f2e-483b-8e73-6e8bcb5b1ba1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.848637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.849280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.849563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.849835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.850472 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.852062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.865133 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4325/8657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:37:18.866537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.877845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e3b3-d0a0-42bf-9a69-04a7b4cbd42e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.882686 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.883301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.883613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.883886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.884533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.886182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f84890-f6c7-4bcb-9325-0b668d6e3474 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.898313 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4333/8658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:37:18.902522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:18.913575 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e93f49-545a-4d3a-9d1e-1af2e68fad8a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:18.918379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:18.919057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.919340 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.919609 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] PATH_INFO: `/v3/projects/a485e438f2354f7a8debf470aa4175b2/users/e2c2a85ee08f4159afe534bc318b2ca4/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.935311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a485e438f2354f7a8debf470aa4175b2, user_id=e2c2a85ee08f4159afe534bc318b2ca4, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:18.938051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:18.952544 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4326/8659] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:37:18 2022] PUT /identity/v3/projects/a485e438f2354f7a8debf470aa4175b2/users/e2c2a85ee08f4159afe534bc318b2ca4/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:37:18.964827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:18.965047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:18.965297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:18.995464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] MFA Rules not processed for user `e2c2a85ee08f4159afe534bc318b2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:18.996678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:19.061703 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4334/8660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:19.066800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.128921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b24b4c-5aeb-43ac-9af0-874028586280 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.133668 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.134263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.134543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.134815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.135445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.137354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.163249 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4327/8661] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:37:19 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:37:19.167290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.178635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b206f7-f87b-4b44-b89d-ad90e4125d4a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.191397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:19.236735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.237368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.237645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.237913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.238525 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.240434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.261255 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4335/8662] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:37:19 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:37:19.265306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.276215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c585-3ccf-4df8-a10d-a5298f706216 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.281347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.282020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.282296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.282567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.283209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.284851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.295750 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4328/8663] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:37:19.299932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.310230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c891-f204-4d18-bded-4674822bbb4d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.315339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.315978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.316253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.316518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] PATH_INFO: `/v3/projects/040cb0f1803d46469b17b1447bd0dd8c/users/bd2b6228ce8e4febaaaf199bfe3ab233/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.331973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040cb0f1803d46469b17b1447bd0dd8c, user_id=bd2b6228ce8e4febaaaf199bfe3ab233, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.334658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.347018 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4336/8664] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:37:19 2022] PUT /identity/v3/projects/040cb0f1803d46469b17b1447bd0dd8c/users/bd2b6228ce8e4febaaaf199bfe3ab233/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:37:19.350868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.361162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8e9f8-77c8-4f46-8021-527165c8380a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.389252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:19.419878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.420527 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.420682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.420984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.421615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.423725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a33d4-d30f-4e8a-bf77-88db61d17d45 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.433609 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4329/8665] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:37:19.438345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.448481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76836c-b2fe-485a-a5e7-c1414b9a4d17 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.453502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.454146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.454423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.454693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] PATH_INFO: `/v3/projects/040cb0f1803d46469b17b1447bd0dd8c/users/bd2b6228ce8e4febaaaf199bfe3ab233/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.456638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040cb0f1803d46469b17b1447bd0dd8c, user_id=bd2b6228ce8e4febaaaf199bfe3ab233, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.459298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.469881 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4337/8666] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:37:19 2022] PUT /identity/v3/projects/040cb0f1803d46469b17b1447bd0dd8c/users/bd2b6228ce8e4febaaaf199bfe3ab233/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:37:19.480111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.480499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.480832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.510804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] MFA Rules not processed for user `bd2b6228ce8e4febaaaf199bfe3ab233`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:19.512016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:19.589819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4330/8667] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:19.609126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:19.611397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:19.673949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357715-e7f7-41f0-b083-ab481f7ffe89 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:19.677528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:19.679635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:19.679635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:19.679635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:19.738543 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:19.740026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:19.749821 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4338/8668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:20.681383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:20.683175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:20.799692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0f78a-3bd0-4dc1-a861-b89b33bcf943 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:20.806628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:20.808165 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:20.808547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:20.809017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:20.811270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:20.831317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:20.833219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477da85-360a-4e44-988b-6cfb175c8401 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:20.850727 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4331/8669] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:22.404400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:22.416695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60204b-f479-499e-9b12-5481ff58337b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:22.420764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:22.421540 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:22.422514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:22.422784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:22.433157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:22.434625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:22.446530 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4339/8670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:37:27.385651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1df8b-93bb-49cd-90bc-e14884315b94 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:27.386146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1df8b-93bb-49cd-90bc-e14884315b94 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:27.386253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1df8b-93bb-49cd-90bc-e14884315b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:27.413268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-74f1df8b-93bb-49cd-90bc-e14884315b94 None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:27.414490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-74f1df8b-93bb-49cd-90bc-e14884315b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:27.452141 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:27.477148 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4332/8671] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:27.823202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:27.839126 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ead4-14e2-46a7-b807-e33177031193 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:27.846812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:27.848039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:27.848413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:27.848752 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:27.850817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:27.864353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:27.866340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:27.869990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:27.882582 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4340/8672] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:28.985569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef79-07e3-4d3c-88c0-aa43e699fa3a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:28.986033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef79-07e3-4d3c-88c0-aa43e699fa3a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:28.986152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef79-07e3-4d3c-88c0-aa43e699fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:29.009412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f6a0ef79-07e3-4d3c-88c0-aa43e699fa3a None None] MFA Rules not processed for user `e2c2a85ee08f4159afe534bc318b2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:29.010652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6a0ef79-07e3-4d3c-88c0-aa43e699fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:29.019926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4333/8673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:37:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:37:37.879564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:39.004110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=11 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:40.682000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:40.683450 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:40.703503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f1045-9498-47e1-bdd1-5ddb42db23ee service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:40.709155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:40.709757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:40.710031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:40.710299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:40.712034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:40.726736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:40.728252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:40.742156 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4341/8674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:50.735015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:20.714236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:20.715032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:20.715456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:20.746691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] MFA Rules not processed for user `e2c2a85ee08f4159afe534bc318b2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:38:20.747911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:20.775260 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4334/8675] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:38:21.108878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:38:21.110370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:21.141418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c592f4-e3be-4a69-a91f-8c5b22a0ea87 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:38:21.145338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:38:21.145952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:21.146228 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:21.146496 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:21.148226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:21.162052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:38:21.163503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:38:21.175555 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4342/8676] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:38:21.531840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:38:21.533379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:21.635007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d8d92-de14-406a-b749-0353f5090559 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:38:21.640877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:38:21.641602 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:21.641931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:21.642244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:21.646066 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:21.664016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:38:21.665865 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:38:21.682802 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4335/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:38:31.170635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:31.673450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=50 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:05.307509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:05.329266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf9e7-7d5d-4eee-802a-b446cc79ee41 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:05.334401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:05.334994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:05.335257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:05.335528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:05.337254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:05.373395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:05.374955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:05.387387 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4343/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:15.223192 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:15.244482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466723ff-c06f-410f-862c-5073dac3bb07 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:15.250714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:15.251322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:15.251605 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:15.251908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:15.253674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:15.274992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:15.276630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:15.301935 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4336/8679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:15.380616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=18 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:16.157906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:16.176293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ef6e-0e17-465c-a629-c3adf43a3735 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:16.182682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:16.183301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:16.183787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:16.184065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:16.186560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:16.202230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:16.203872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71c52-f216-428b-98d5-de7f33e94d85 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:16.219142 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4344/8680] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:23.394507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:23.396361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:23.432458 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf8540-9aed-40bc-a470-bd5431d88d7e service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:23.439157 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:23.440020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:23.440436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:23.440929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:23.443441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:23.483979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:23.490003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f6550-079d-47fc-bf8a-2ded9ce0fff6 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:23.538327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4337/8681] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:26.213851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:29.975440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:29.976014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:29.976014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:30.004024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] MFA Rules not processed for user `8b2ad8fbe36e43358ba644627ebb1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:39:30.005596 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:30.015353 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4345/8682] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:39:31.192156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624a1b-e90a-4a9c-9e70-023ee7f8bd38 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:31.192659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624a1b-e90a-4a9c-9e70-023ee7f8bd38 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:31.192752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624a1b-e90a-4a9c-9e70-023ee7f8bd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:31.277824 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a3624a1b-e90a-4a9c-9e70-023ee7f8bd38 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:39:31.279520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a3624a1b-e90a-4a9c-9e70-023ee7f8bd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:31.291527 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4338/8683] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:39:31.304925 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:31.322812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8e79c-9ff4-441f-a69c-43e302b04cb9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:31.330314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:31.331291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:31.331880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:31.332342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:31.345748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:31.347493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d15779-0cf6-497c-9889-b62d8ea47cd5 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:31.359961 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4346/8684] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:39:31.571886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:31.572456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:31.572899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:31.599830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] MFA Rules not processed for user `e2c2a85ee08f4159afe534bc318b2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:39:31.601076 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:31.611645 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4339/8685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:39:32.429633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:32.430123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:32.430197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:32.458556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:39:32.459962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:32.474649 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4347/8686] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:39:32.487428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:32.504594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136154-311a-4648-b712-831a694cf4e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:32.511486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:32.512496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:32.512966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:32.513578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:32.524421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:32.526425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:32.542458 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4340/8687] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:42.447524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:42.534016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=37 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:45.040698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:45.054351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea87f10-95dc-4efe-b998-42c7add244de None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:45.059442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:45.060042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:45.060390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:45.060713 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:45.062469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:45.076528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:45.078432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a1178-ded2-4706-89da-724971ffd557 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:45.090819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4348/8688] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:55.084181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:57.466914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:57.553350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7f296-5a50-4eab-b359-b380fa38ef10 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:57.558055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:57.558697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:57.558976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:57.559255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] PATH_INFO: `/v3/users/e2c2a85ee08f4159afe534bc318b2ca4` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:57.560393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c2a85ee08f4159afe534bc318b2ca4)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:57.562538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:57.616259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c2a85ee08f4159afe534bc318b2ca4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:57.616944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c2a85ee08f4159afe534bc318b2ca4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:57.617557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c2a85ee08f4159afe534bc318b2ca4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:57.624685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c2a85ee08f4159afe534bc318b2ca4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:57.632216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-4e568b66-84d7-4dac-b8d1-50f8289cd561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c2a85ee08f4159afe534bc318b2ca4'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:57.650304 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4341/8689] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:40:57 2022] DELETE /identity/v3/users/e2c2a85ee08f4159afe534bc318b2ca4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:40:57.655101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:57.655560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:57.655668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:57.695036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:57.696241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:57.754534 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4349/8690] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:40:57.763762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:57.764058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:57.764371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:57.813209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:57.815009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:57.855714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:57.866837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4342/8691] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Oct 28 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:40:57.872711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:57.882634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0036de-5b05-4fef-84f1-311d20fa9081 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:57.886153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:57.886747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:57.887024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:57.887291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:57.896308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:57.897797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:57.908316 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4350/8692] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:40:58.095657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:58.097212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:58.112726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ef1d-ca2a-4d54-ac52-8a5f38ea2e5d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:58.117412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:58.118041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.118515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.118799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] PATH_INFO: `/v3/projects/a485e438f2354f7a8debf470aa4175b2` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.120408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a485e438f2354f7a8debf470aa4175b2)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:58.122344 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:58.168635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a485e438f2354f7a8debf470aa4175b2', 'request_id': 'req-d1cf9626-061d-478e-b11d-7cbd31185314'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.174975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a485e438f2354f7a8debf470aa4175b2', 'request_id': 'req-d1cf9626-061d-478e-b11d-7cbd31185314'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.182185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a485e438f2354f7a8debf470aa4175b2', 'request_id': 'req-d1cf9626-061d-478e-b11d-7cbd31185314'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.193532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] The token cache is being invalidate because project a485e438f2354f7a8debf470aa4175b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:40:58.193827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.194456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.195977 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4343/8693] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:40:58 2022] DELETE /identity/v3/projects/a485e438f2354f7a8debf470aa4175b2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:40:58.199970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:58.209872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb41bf-bace-4a97-a25d-bf3d72ebbb43 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:58.266052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:58.267202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.267481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.267782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] PATH_INFO: `/v3/users/bd2b6228ce8e4febaaaf199bfe3ab233` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.268922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2b6228ce8e4febaaaf199bfe3ab233)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:58.270824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:58.314719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2b6228ce8e4febaaaf199bfe3ab233'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.315418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2b6228ce8e4febaaaf199bfe3ab233'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.322427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2b6228ce8e4febaaaf199bfe3ab233'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.330279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2b6228ce8e4febaaaf199bfe3ab233'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.330955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7e03bf5a-402b-4007-bd2c-5f77eeeea669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2b6228ce8e4febaaaf199bfe3ab233'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.337899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:58.349972 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4351/8694] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:40:58 2022] DELETE /identity/v3/users/bd2b6228ce8e4febaaaf199bfe3ab233 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:40:58.620776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:58.622241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:58.635644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9626-061d-478e-b11d-7cbd31185314 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:58.693658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:58.694675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.694952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.695219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] PATH_INFO: `/v3/projects/040cb0f1803d46469b17b1447bd0dd8c` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.696652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040cb0f1803d46469b17b1447bd0dd8c)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:58.698611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:58.745695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040cb0f1803d46469b17b1447bd0dd8c', 'request_id': 'req-d76af16f-30bd-407d-9e86-f04034070b63'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.751565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040cb0f1803d46469b17b1447bd0dd8c', 'request_id': 'req-d76af16f-30bd-407d-9e86-f04034070b63'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.758545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040cb0f1803d46469b17b1447bd0dd8c', 'request_id': 'req-d76af16f-30bd-407d-9e86-f04034070b63'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.770350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] The token cache is being invalidate because project 040cb0f1803d46469b17b1447bd0dd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:40:58.770942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.771765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-d76af16f-30bd-407d-9e86-f04034070b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:40:58.777256 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4344/8695] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:40:58 2022] DELETE /identity/v3/projects/040cb0f1803d46469b17b1447bd0dd8c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:40:58.779158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.779924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.780200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.822396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:58.823641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:58.883906 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4352/8696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:40:58.892828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.893140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.893414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.916033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:58.917278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:58.924997 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4345/8697] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:40:58.929148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:58.939409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6afb6-7f83-47b3-badd-bca7b481aae9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:58.944253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:58.944799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.945112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.945383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.946059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:40:58.946344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:58.948019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:58.960604 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4353/8698] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:40:58.964984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:58.969404 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:58.975583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f047e-fdff-41c9-a6f4-1dbb316b852d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:58.980822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:58.981445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:58.981722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:58.981992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:58.982610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:58.984520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.016148 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4346/8699] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:40:58 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:40:59.018050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:59.028369 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a1b2-5a74-41f0-897b-e9b31add9faa admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:59.086485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:59.087100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.087381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.087654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.088307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:59.090436 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.117065 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4354/8700] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:40:59 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:40:59.118266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:59.129741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fc9c-9995-4d69-b595-ab981d1a29ac admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:59.134491 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:59.135097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.135406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.135701 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.136339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:59.137966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.148724 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4347/8701] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:40:59.152927 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:59.163209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6495-092d-435e-8594-4cb397b0cb8d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:59.169466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:59.170105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.170382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.170665 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.171299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:59.173499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dafcf-886d-4f3d-9979-8860e5eb93ce admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.185261 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4355/8702] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:40:59.190163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:59.200359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6604-6444-4c8d-b6d8-42e90f70dec8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:59.205375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:59.206028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.206307 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.206608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] PATH_INFO: `/v3/projects/73e4f00a908f4b579ae99c2d4e160945/users/95be59199e0147b78f99b1a7142b3543/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.221250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e4f00a908f4b579ae99c2d4e160945, user_id=95be59199e0147b78f99b1a7142b3543, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:59.223906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.237734 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4348/8703] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:40:59 2022] PUT /identity/v3/projects/73e4f00a908f4b579ae99c2d4e160945/users/95be59199e0147b78f99b1a7142b3543/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:40:59.242908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2128d-0105-4daf-81c2-50d7b129dde2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.243236 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2128d-0105-4daf-81c2-50d7b129dde2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.243508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2128d-0105-4daf-81c2-50d7b129dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.262988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-47c2128d-0105-4daf-81c2-50d7b129dde2 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:59.264182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-47c2128d-0105-4daf-81c2-50d7b129dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:59.298917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:59.327492 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4356/8704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:40:59.344423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:59.346243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:59.406608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c95e4-b6c5-4ca7-9e34-bbf6b7ddc2e0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:59.410559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:59.411508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:59.411792 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:59.412062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:59.422138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:59.424783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:59.434961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4349/8705] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:03.684121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:03.684606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:03.684692 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:03.717566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] MFA Rules not processed for user `95be59199e0147b78f99b1a7142b3543`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:03.718933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:03.800818 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4357/8706] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:03.805349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:03.817399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005d47-da11-4d81-958a-c7241cf5be38 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:03.822210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:03.822818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:03.823095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:03.823368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:03.824078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:03.826080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:03.859809 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4350/8707] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:41:03 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:03.862105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:03.874586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970f0a-786c-4a10-b3bd-b22c73c2ac6f None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:03.944124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:03.944747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:03.945070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:03.945344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:03.945981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:03.947909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:03.976859 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4358/8708] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:41:03 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:03.978074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:03.990234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1109-ae97-440e-96fd-8bd7706497bd admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:03.996047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:03.996818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:03.997132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:03.997405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:03.998048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:03.999645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:04.012759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4351/8709] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:41:04.016810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:04.029011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a6620-62f7-49ad-bc5d-f725042abf78 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:04.035682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:04.036448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:04.036802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:04.037181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] PATH_INFO: `/v3/projects/acebe9d0b4c74401a041401efdf08073/users/b5247768a5ec4196a43c639a479cb97d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:04.058478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acebe9d0b4c74401a041401efdf08073, user_id=b5247768a5ec4196a43c639a479cb97d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:04.061790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:04.077262 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4359/8710] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:41:04 2022] PUT /identity/v3/projects/acebe9d0b4c74401a041401efdf08073/users/b5247768a5ec4196a43c639a479cb97d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:04.082180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:04.093797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf946-d0dc-4afc-a46b-e9d43846f7ab admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:04.164425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:04.165277 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:04.165477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:04.165949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:04.166663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:04.168741 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa424f6a-9166-4312-b484-80d237d1bf96 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:04.180896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4352/8711] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:41:04.184991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:04.197327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd68fb-65d7-47a3-b0b4-5f81507135f4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:04.202498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:04.203489 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:04.203749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:04.204029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] PATH_INFO: `/v3/projects/acebe9d0b4c74401a041401efdf08073/users/b5247768a5ec4196a43c639a479cb97d/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:04.206107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acebe9d0b4c74401a041401efdf08073, user_id=b5247768a5ec4196a43c639a479cb97d, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:04.208784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:04.221096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4360/8712] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:41:04 2022] PUT /identity/v3/projects/acebe9d0b4c74401a041401efdf08073/users/b5247768a5ec4196a43c639a479cb97d/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:41:09.114389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823321-f211-4885-a129-4cd56c0c0fd3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:09.114882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823321-f211-4885-a129-4cd56c0c0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:09.114990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823321-f211-4885-a129-4cd56c0c0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:09.138216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.149465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bc823321-f211-4885-a129-4cd56c0c0fd3 None None] MFA Rules not processed for user `b5247768a5ec4196a43c639a479cb97d`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:09.151376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bc823321-f211-4885-a129-4cd56c0c0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:09.227297 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4353/8713] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:09.241261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:09.243206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:09.274385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.347559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5a750-4799-4a3c-98c2-3651efaedfc6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:09.353175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:09.353789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:09.354090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:09.354363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:09.366953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:09.368594 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51bb08-51e7-4c04-89b1-58f3d7d09839 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:09.379418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4361/8714] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:09.430474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:09.430759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:09.431028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:09.450735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] MFA Rules not processed for user `95be59199e0147b78f99b1a7142b3543`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:09.451914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:09.505737 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4354/8715] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:19.374248 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=32 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:19.498751 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=54 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:19.774298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558a4e-8b26-4ebb-9f96-d292551a2d5e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:19.774585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558a4e-8b26-4ebb-9f96-d292551a2d5e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:19.774863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558a4e-8b26-4ebb-9f96-d292551a2d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:19.793980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d8558a4e-8b26-4ebb-9f96-d292551a2d5e None None] MFA Rules not processed for user `95be59199e0147b78f99b1a7142b3543`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:19.795177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d8558a4e-8b26-4ebb-9f96-d292551a2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:19.802035 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4362/8716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:29.788943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:34.864600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:34.922248 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81208364-3f37-4a3a-90d2-064da2e2694e None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:34.926091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:34.926695 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:34.926975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:34.927247 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:34.929034 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:34.946130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:34.947912 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:34.963569 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4355/8717] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:35.980044 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:35.980616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:35.980616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:36.006409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:36.008137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:36.016239 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4363/8718] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Oct 28 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:36.022566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:36.032190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf616f2-3ce5-40b4-afc8-6ba6fdddae61 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:36.036072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:36.036758 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:36.037085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:36.037386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:36.039363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:36.056691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:36.058171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:36.073173 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4356/8719] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:45.997977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:46.065347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=32 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:48.167018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:48.238214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f47bc-c74e-49ec-be94-b276d3036b9d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:48.242695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:48.243326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:48.243601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:48.243870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] PATH_INFO: `/v3/users/95be59199e0147b78f99b1a7142b3543` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:48.245019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95be59199e0147b78f99b1a7142b3543)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:48.246968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:48.295312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95be59199e0147b78f99b1a7142b3543'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.296504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95be59199e0147b78f99b1a7142b3543'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.304258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95be59199e0147b78f99b1a7142b3543'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.312083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95be59199e0147b78f99b1a7142b3543'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.312754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95be59199e0147b78f99b1a7142b3543'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.330759 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4364/8720] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:41:48 2022] DELETE /identity/v3/users/95be59199e0147b78f99b1a7142b3543 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:48.513519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:48.541182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146421-23b2-4200-93dc-8f4f7155c0f2 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:48.611564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:48.612312 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:48.612667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:48.613063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] PATH_INFO: `/v3/projects/73e4f00a908f4b579ae99c2d4e160945` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:48.614372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e4f00a908f4b579ae99c2d4e160945)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:48.616403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:48.670161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e4f00a908f4b579ae99c2d4e160945', 'request_id': 'req-a9758428-54d7-4c42-825b-4e84c96c9164'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.679243 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e4f00a908f4b579ae99c2d4e160945', 'request_id': 'req-a9758428-54d7-4c42-825b-4e84c96c9164'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.688643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e4f00a908f4b579ae99c2d4e160945', 'request_id': 'req-a9758428-54d7-4c42-825b-4e84c96c9164'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.701532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] The token cache is being invalidate because project 73e4f00a908f4b579ae99c2d4e160945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:41:48.701851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.702498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.704175 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4357/8721] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:41:48 2022] DELETE /identity/v3/projects/73e4f00a908f4b579ae99c2d4e160945 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:48.708233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:48.713892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:48.744070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611609-6b90-410b-8868-28fe67395334 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:48.825322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:48.827006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:48.828338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:48.829363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:48.829715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:48.830009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] PATH_INFO: `/v3/users/b5247768a5ec4196a43c639a479cb97d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:48.831217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5247768a5ec4196a43c639a479cb97d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:48.833280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:48.856039 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:48.885396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5247768a5ec4196a43c639a479cb97d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.886054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5247768a5ec4196a43c639a479cb97d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.893869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5247768a5ec4196a43c639a479cb97d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.896847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9758428-54d7-4c42-825b-4e84c96c9164 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:48.901046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:48.901956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:48.902094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5247768a5ec4196a43c639a479cb97d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.902615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:48.902742 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5247768a5ec4196a43c639a479cb97d'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:48.903142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:48.905616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:48.918793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:48.920218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92f6b-895f-41a6-acf2-607aa11ef3a9 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:48.923716 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4365/8722] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:41:48 2022] DELETE /identity/v3/users/b5247768a5ec4196a43c639a479cb97d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:41:48.932185 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4358/8723] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:41:49.119828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.121394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:49.212575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ba1d-7882-41ab-b4a4-3bc63ecddd40 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.218484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.219261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.219541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.219811 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] PATH_INFO: `/v3/projects/acebe9d0b4c74401a041401efdf08073` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.220993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acebe9d0b4c74401a041401efdf08073)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.222914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.278530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acebe9d0b4c74401a041401efdf08073', 'request_id': 'req-2c8341c6-b733-4609-bea7-774ba85e4364'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:49.287067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acebe9d0b4c74401a041401efdf08073', 'request_id': 'req-2c8341c6-b733-4609-bea7-774ba85e4364'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:49.295958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acebe9d0b4c74401a041401efdf08073', 'request_id': 'req-2c8341c6-b733-4609-bea7-774ba85e4364'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:49.309726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] The token cache is being invalidate because project acebe9d0b4c74401a041401efdf08073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:41:49.310178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:49.311764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2c8341c6-b733-4609-bea7-774ba85e4364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:49.313474 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4366/8724] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:41:49 2022] DELETE /identity/v3/projects/acebe9d0b4c74401a041401efdf08073 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:49.318499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.318782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.319049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.338973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:49.340161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:49.371155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:49.411854 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4359/8725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:49.413582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.413941 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.414909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.437036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:49.438478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:49.450659 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4367/8726] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:49.452490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.464223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd720-1f79-4707-9a41-bf5ebcde599d None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.469188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.469840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.470121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.470391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.471065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:41:49.471326 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.473133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.486912 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4360/8727] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:41:49.491099 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.504030 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e801d-1a2b-45dc-9fec-6e276e618ff8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.509483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.510234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.510586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.510858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.511498 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.513495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.536402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:49.544401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4368/8728] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:41:49 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:49.549642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.560505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a48c-3021-4c76-a9e3-22af540dcaea admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.626566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.627183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.627462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.627727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.628348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.630434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.655959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4361/8729] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:41:49 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:49.657142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.668183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ef6c-daf3-44b4-9224-a0363ee570ee admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.673803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.674426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.674701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.674966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.675605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.677245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.688124 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4369/8730] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:41:49.691759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.702998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39b6a-5ee2-489f-87e9-7ef9c0341f83 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.707620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.708212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.708492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.708759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.709429 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.711017 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9e01-d297-4a68-a194-0b05579d9025 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.722492 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4362/8731] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:41:49.726562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.736564 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d50907-9165-4363-92df-60571a658ad2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.741215 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.741900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.742182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.742461 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] PATH_INFO: `/v3/projects/8bc10bfafe084721b5530999187aead0/users/5922bd77a54c448ca47ce3b326079efd/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.757465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc10bfafe084721b5530999187aead0, user_id=5922bd77a54c448ca47ce3b326079efd, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.760091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.775289 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4370/8732] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:41:49 2022] PUT /identity/v3/projects/8bc10bfafe084721b5530999187aead0/users/5922bd77a54c448ca47ce3b326079efd/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:49.781083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb894-2cf7-4b8b-a452-52fd81a88f5c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.781370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb894-2cf7-4b8b-a452-52fd81a88f5c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.781640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb894-2cf7-4b8b-a452-52fd81a88f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.804578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-980fb894-2cf7-4b8b-a452-52fd81a88f5c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:49.806655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-980fb894-2cf7-4b8b-a452-52fd81a88f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:49.878234 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4363/8733] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:41:49.886201 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:49.888670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:49.955211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a448-6db7-4977-b116-6dfef7c54491 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:49.959439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:49.960166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:49.961192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:49.961536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:49.972728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:49.974393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:49.985768 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4371/8734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:54.896743 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:54.897251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:54.897328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:54.935943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] MFA Rules not processed for user `5922bd77a54c448ca47ce3b326079efd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:54.937557 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:54.996297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:55.063030 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4364/8735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:41:55.067371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.079270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32827d6e-ee32-48e1-85b9-e1d797fdeacc service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.086272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.088211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.088708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.089311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.090657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.093745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.156254 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4372/8736] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:41:55 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:55.157657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.169931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83373c7f-88bd-4624-9c80-ea7da4f9e333 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.264486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.265195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.265459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.265723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.266528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.268800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.300094 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4365/8737] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:41:55 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:41:55.304153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.316329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a4a4b-14ab-418d-abfd-ad777a9e8243 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.321151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.321772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.322049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.322323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.322947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.324659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.337902 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4373/8738] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:41:55.342855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.354757 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93242ef-aa17-430a-bbef-02e84b971d52 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.359882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.360552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.360827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.361129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] PATH_INFO: `/v3/projects/e7502ef1adc842758bd6412f22abf9ad/users/cc6e45c788c541cf89d0748b7dca9162/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.382309 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7502ef1adc842758bd6412f22abf9ad, user_id=cc6e45c788c541cf89d0748b7dca9162, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.385018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.400961 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4366/8739] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:41:55 2022] PUT /identity/v3/projects/e7502ef1adc842758bd6412f22abf9ad/users/cc6e45c788c541cf89d0748b7dca9162/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:41:55.405199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.418568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d1e5e-bc20-4523-883c-dbae4b5218c4 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.489787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.490550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.490931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.491528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.492517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.494015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.506740 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4374/8740] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:41:55.510699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:55.524685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162b28-088b-4cdb-9829-38bc45bb86ad admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:55.531120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:55.531804 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:55.532087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:55.532363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] PATH_INFO: `/v3/projects/e7502ef1adc842758bd6412f22abf9ad/users/cc6e45c788c541cf89d0748b7dca9162/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:55.534936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7502ef1adc842758bd6412f22abf9ad, user_id=cc6e45c788c541cf89d0748b7dca9162, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:55.537672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:55.552860 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4367/8741] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:41:55 2022] PUT /identity/v3/projects/e7502ef1adc842758bd6412f22abf9ad/users/cc6e45c788c541cf89d0748b7dca9162/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:56.534092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:56.537330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:56.570013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c9dc-6dfb-41b0-a615-773a47839aeb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:56.626548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:56.678741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:56.679422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:56.679757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:56.680025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] PATH_INFO: `/v3/users/8b2ad8fbe36e43358ba644627ebb1d8b` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:56.696531 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2ad8fbe36e43358ba644627ebb1d8b)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:56.698926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:56.766831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2ad8fbe36e43358ba644627ebb1d8b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:56.767657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2ad8fbe36e43358ba644627ebb1d8b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:56.780663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2ad8fbe36e43358ba644627ebb1d8b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:56.793702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2ad8fbe36e43358ba644627ebb1d8b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:56.794574 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2ad8fbe36e43358ba644627ebb1d8b'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:56.823919 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4375/8742] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:41:56 2022] DELETE /identity/v3/users/8b2ad8fbe36e43358ba644627ebb1d8b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:57.085350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:57.087707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:57.107664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653576c-bfc1-44fd-bc9c-c6be20a1246b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:57.177263 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:57.178010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:57.178148 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:57.178335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] PATH_INFO: `/v3/projects/7b98d113d6914d01a909378c1c96e3fa` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:57.191835 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b98d113d6914d01a909378c1c96e3fa)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:57.194632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:57.213926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:57.255361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b98d113d6914d01a909378c1c96e3fa', 'request_id': 'req-317f3555-dc0b-4736-add9-49e7ed580157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.262610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b98d113d6914d01a909378c1c96e3fa', 'request_id': 'req-317f3555-dc0b-4736-add9-49e7ed580157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.270986 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b98d113d6914d01a909378c1c96e3fa', 'request_id': 'req-317f3555-dc0b-4736-add9-49e7ed580157'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.284660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] The token cache is being invalidate because project 7b98d113d6914d01a909378c1c96e3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:41:57.284992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.285671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.287212 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4368/8743] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:41:57 2022] DELETE /identity/v3/projects/7b98d113d6914d01a909378c1c96e3fa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:57.291364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:57.302745 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d43b-b7c8-4979-a0c8-09cdde26a2dc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:57.370729 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:57.371250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:57.371504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:57.372571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] PATH_INFO: `/v3/users/79447fae5bdd4c368087107d3bf0fef1` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:57.391736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79447fae5bdd4c368087107d3bf0fef1)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:57.394273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:57.436290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:57.455372 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79447fae5bdd4c368087107d3bf0fef1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.456508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79447fae5bdd4c368087107d3bf0fef1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.468124 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79447fae5bdd4c368087107d3bf0fef1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.477389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79447fae5bdd4c368087107d3bf0fef1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.478402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-38caf63a-dbad-4094-b7fc-659334926cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79447fae5bdd4c368087107d3bf0fef1'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.503151 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4376/8744] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:41:57 2022] DELETE /identity/v3/users/79447fae5bdd4c368087107d3bf0fef1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:41:57.711544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:57.713189 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:57.730477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3555-dc0b-4736-add9-49e7ed580157 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:57.811574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:57.812549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:57.813124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:57.813657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] PATH_INFO: `/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:57.828360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90bea95b7524d9e928d690f7a8f7dbb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:57.830305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:57.902379 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90bea95b7524d9e928d690f7a8f7dbb', 'request_id': 'req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.908223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90bea95b7524d9e928d690f7a8f7dbb', 'request_id': 'req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.916802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90bea95b7524d9e928d690f7a8f7dbb', 'request_id': 'req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.929937 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] The token cache is being invalidate because project c90bea95b7524d9e928d690f7a8f7dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:41:57.930434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.930949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2a2ea091-4728-473a-bd9a-4ec1ead7aeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:41:57.932674 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4369/8745] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:41:57 2022] DELETE /identity/v3/projects/c90bea95b7524d9e928d690f7a8f7dbb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:42:00.965310 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:00.965935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:00.966400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:01.014324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] MFA Rules not processed for user `cc6e45c788c541cf89d0748b7dca9162`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:42:01.016350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:01.094504 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4377/8746] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:42:01.106105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860443b-b0c2-4d6a-8ca8-46c192b587e4 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:01.106614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860443b-b0c2-4d6a-8ca8-46c192b587e4 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:01.106614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860443b-b0c2-4d6a-8ca8-46c192b587e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:01.148026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9860443b-b0c2-4d6a-8ca8-46c192b587e4 None None] MFA Rules not processed for user `b6f23fb45ed14020a6d15f834881d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:42:01.149393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9860443b-b0c2-4d6a-8ca8-46c192b587e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:01.155842 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:01.207481 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4370/8747] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Oct 28 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:42:01.213997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:01.224420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7863-f7b0-42ba-bea0-3eb0f4df2f15 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:01.228351 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:01.228995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:01.229269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:01.229542 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:01.231319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:01.293929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:01.295915 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:01.305683 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4378/8748] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:42:11.200454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=18 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:11.301173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=80,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:23.212627 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1466-8fb5-44ae-b025-915842f4087b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:23.213063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1466-8fb5-44ae-b025-915842f4087b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:23.213212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1466-8fb5-44ae-b025-915842f4087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:23.262423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-4f0c1466-8fb5-44ae-b025-915842f4087b None None] MFA Rules not processed for user `35c19dc65ad64a8eaa5d0f64e7e14079`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:42:23.263546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4f0c1466-8fb5-44ae-b025-915842f4087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:23.337602 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4371/8749] 10.222.0.16 () {58 vars in 1040 bytes} [Fri Oct 28 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:42:23.343816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:23.355326 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3593a4-df4c-480f-971b-6eaff468ebca service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:23.360367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:23.361007 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:23.361321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:23.361597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:23.369437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:23.371041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:23.379813 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4379/8750] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 10:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:42:33.334145 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=44 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:33.376427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:50.893943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:50.894408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:50.894499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:50.914170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] MFA Rules not processed for user `5922bd77a54c448ca47ce3b326079efd`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:43:50.915366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:50.922883 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4372/8751] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:43:51.257907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:51.259410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:51.326631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ab8fd-2734-43df-84c8-f5e7d6cfa60d service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:51.330317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:51.330920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:51.331206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:51.331479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:51.333254 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:51.345160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:51.346575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:51.357511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4380/8752] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:43:53.591174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:53.592614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:53.604814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ff1a8-a3f4-41f1-9f8f-cb8626f28707 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:53.609149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:53.609906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:53.610295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:53.610647 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:53.612462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:53.626539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:53.628097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:53.641403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4373/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:43:54.386590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:54.388693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:54.503694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e229-bca9-4e0b-80d9-2360ccafdedf service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:54.510420 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:54.511119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:54.511472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:54.512376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:54.514230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:43:54.531367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:54.532635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:54.547240 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4381/8754] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:03.633530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:04.539187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=64 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:07.263891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:07.265345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:07.350279 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d23d-6775-4604-be07-7ffa0254289c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:07.356213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:07.356829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:07.357140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:07.357413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:07.359152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:07.374508 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:07.376093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:07.389624 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4374/8755] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:09.352062 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:09.353530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:09.371244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8157269-3eb8-4c63-92e3-4ea75aa85f21 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:09.376826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:09.377457 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:09.377732 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:09.378000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:09.379739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:09.394954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:09.396553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:09.410635 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4382/8756] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:12.140120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:12.149576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb728-4ec9-4c3c-a471-5ee6c4cc9850 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:12.153281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:12.153875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:12.154149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:12.154435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:12.163513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:12.164956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:12.174930 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4375/8757] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:17.069668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:17.084065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828bea-a31d-4f57-9c79-1c36eaecf922 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:17.090130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:17.090726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:17.091004 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:17.091279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:17.093043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:17.108105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:17.109753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:17.122673 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4383/8758] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:22.170696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=42 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:27.115812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:51.068460 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:51.069957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:51.087196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb797b3b-1030-4307-9064-c1a324f1ee90 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:51.092428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:51.093090 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:51.093444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:51.093716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:51.095437 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:51.110469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:51.112032 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:51.125448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4376/8759] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:00.437329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:00.454979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb6f6d-526c-44be-b531-4a0af6f06e5d service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:00.465867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:00.466642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:00.467194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:00.467510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:00.469477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:00.491155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:00.493819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:00.512426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4384/8760] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:01.118397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:03.624533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:03.638896 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c7e59-1ef9-453d-99db-1fadc4dc899a service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:03.644614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:03.645245 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:03.645526 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:03.645790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:03.647510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:03.663625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:03.665737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:03.683884 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4377/8761] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:03.684038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:03.686154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:03.771488 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f714-302d-414c-bed8-2deb99357c56 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:03.777016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:03.777676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:03.777959 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:03.778233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] PATH_INFO: `/v3/users/5922bd77a54c448ca47ce3b326079efd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:03.779514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5922bd77a54c448ca47ce3b326079efd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:03.781514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:03.828965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5922bd77a54c448ca47ce3b326079efd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:03.829623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5922bd77a54c448ca47ce3b326079efd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:03.837275 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5922bd77a54c448ca47ce3b326079efd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:03.844345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5922bd77a54c448ca47ce3b326079efd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:03.844969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5922bd77a54c448ca47ce3b326079efd'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:03.862089 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4385/8762] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:03 2022] DELETE /identity/v3/users/5922bd77a54c448ca47ce3b326079efd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:45:04.047373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:04.058541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e7df2-139a-4f45-b929-0de44b903280 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:04.120661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:04.121332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:04.121608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:04.121875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] PATH_INFO: `/v3/projects/8bc10bfafe084721b5530999187aead0` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:04.122973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc10bfafe084721b5530999187aead0)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:04.124882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:04.169712 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc10bfafe084721b5530999187aead0', 'request_id': 'req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.175866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc10bfafe084721b5530999187aead0', 'request_id': 'req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.183515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc10bfafe084721b5530999187aead0', 'request_id': 'req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.195456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] The token cache is being invalidate because project 8bc10bfafe084721b5530999187aead0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:04.195748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.196388 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.198165 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4378/8763] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:04 2022] DELETE /identity/v3/projects/8bc10bfafe084721b5530999187aead0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:04.202181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:04.203578 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:04.216329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec859-2ef9-4276-98ad-75fe0c7c12c6 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:04.266456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:04.273617 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:04.274287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:04.274810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:04.275196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] PATH_INFO: `/v3/users/cc6e45c788c541cf89d0748b7dca9162` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:04.276810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6e45c788c541cf89d0748b7dca9162)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:04.279234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:04.324025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6e45c788c541cf89d0748b7dca9162'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.324668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6e45c788c541cf89d0748b7dca9162'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.331034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6e45c788c541cf89d0748b7dca9162'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.338216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6e45c788c541cf89d0748b7dca9162'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.338858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-9bd34b17-0b96-4b33-b13e-b8733f4c0dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6e45c788c541cf89d0748b7dca9162'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.355684 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4386/8764] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:04 2022] DELETE /identity/v3/users/cc6e45c788c541cf89d0748b7dca9162 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:04.533585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:04.535665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:04.550710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f62e-454b-491d-893a-6e2ee4bd70d6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:04.611634 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:04.612292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:04.613198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:04.613470 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] PATH_INFO: `/v3/projects/e7502ef1adc842758bd6412f22abf9ad` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:04.614598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7502ef1adc842758bd6412f22abf9ad)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:04.616483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:04.637921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:04.663748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7502ef1adc842758bd6412f22abf9ad', 'request_id': 'req-9a530ce2-8c80-41ca-9928-85c969715d08'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.669240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7502ef1adc842758bd6412f22abf9ad', 'request_id': 'req-9a530ce2-8c80-41ca-9928-85c969715d08'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.676671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7502ef1adc842758bd6412f22abf9ad', 'request_id': 'req-9a530ce2-8c80-41ca-9928-85c969715d08'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.687728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] The token cache is being invalidate because project e7502ef1adc842758bd6412f22abf9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:04.687949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.688653 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-9a530ce2-8c80-41ca-9928-85c969715d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:04.690274 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4379/8765] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:04 2022] DELETE /identity/v3/projects/e7502ef1adc842758bd6412f22abf9ad => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:14.164797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0564-887a-450b-af55-2c4f97071806 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.165445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0564-887a-450b-af55-2c4f97071806 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.165445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0564-887a-450b-af55-2c4f97071806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.184880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-415d0564-887a-450b-af55-2c4f97071806 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:14.186097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-415d0564-887a-450b-af55-2c4f97071806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:14.244118 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4387/8766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:14.255238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.255723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.255825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.275718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:14.277265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:14.285045 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4380/8767] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:14.289479 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0564-887a-450b-af55-2c4f97071806 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.298843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0564-887a-450b-af55-2c4f97071806 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.303306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561051-8931-4064-a133-d97214e5554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.303891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561051-8931-4064-a133-d97214e5554e admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.304160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561051-8931-4064-a133-d97214e5554e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.304424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561051-8931-4064-a133-d97214e5554e admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.305085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561051-8931-4064-a133-d97214e5554e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:45:14.305381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561051-8931-4064-a133-d97214e5554e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.306952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561051-8931-4064-a133-d97214e5554e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.318710 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4388/8768] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:45:14.331762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.341402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7b458-cb8c-42f5-a9d2-5a746583db99 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.345967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.346554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.346833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.347104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.347714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.349659 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.385758 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4381/8769] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:14.390059 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561051-8931-4064-a133-d97214e5554e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.400579 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561051-8931-4064-a133-d97214e5554e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.455156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.455677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.455948 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.456213 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.456827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.459330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.468956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:14.482774 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4389/8770] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:14.486875 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.497581 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e8c-764c-4bff-a124-79fe3fa057a9 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.502143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.502735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.503010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.503278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.503907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.506122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.515819 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4382/8771] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:14.519706 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.530485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca137-d7a8-4338-bd8a-16d9b6710e81 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.535366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.536033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.536377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.536712 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.537453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.539339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb355517-2509-4397-904e-f4f7c77651ca admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.550045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4390/8772] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:14.555635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.565766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15ee9-f8d4-4ce8-80aa-ed83f0cbcd93 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.570955 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.571598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.571881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.572403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] PATH_INFO: `/v3/projects/77a86ef86a1c4ac7b35642d8559975e6/users/baf5f2e04c4c45f9b1e4863fc9a26c16/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.587636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a86ef86a1c4ac7b35642d8559975e6, user_id=baf5f2e04c4c45f9b1e4863fc9a26c16, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.590333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.603207 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4383/8773] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:14 2022] PUT /identity/v3/projects/77a86ef86a1c4ac7b35642d8559975e6/users/baf5f2e04c4c45f9b1e4863fc9a26c16/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:14.615084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.615366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.615636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.644933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] MFA Rules not processed for user `baf5f2e04c4c45f9b1e4863fc9a26c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:14.646154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:14.710001 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4391/8774] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:14.714511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.775363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65917eb-ee17-4db8-b7bf-75ebe165cc4b admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.780081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.780677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.781041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.781272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.781903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.783787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.809630 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4384/8775] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:14.813859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.825505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2964-5050-48eb-9669-e1759d5e79b2 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.881139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.881770 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.882061 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.882313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.882965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.884934 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.905743 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4392/8776] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:45:14 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:45:14.909964 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.921276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384b78f-0b2e-4dda-a175-7240a182d549 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.926033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.926631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.927410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.927684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.928315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.929926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.940923 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4385/8777] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:14.944891 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:14.955121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c64-37b6-4b60-b1af-9d5a792eb0ff admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:14.959813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:14.960514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:14.960734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:14.961041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] PATH_INFO: `/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67/users/7b426aaea04142e7a9f748f82c4ba3a8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:14.976804 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3a5d752a3d4edb8e01c673027f7b67, user_id=7b426aaea04142e7a9f748f82c4ba3a8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:14.979781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:14.993045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4393/8778] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:14 2022] PUT /identity/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67/users/7b426aaea04142e7a9f748f82c4ba3a8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:45:14.997093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:15.007149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afd23-a648-49b9-b314-4308e2a82882 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:15.011888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.066088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:15.066685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.066962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.067230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.067851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:15.069456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1423-ce64-4441-85f7-0566dcbf891e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:15.079437 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4386/8779] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:15.083577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:15.093767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5a20-2bc8-40e8-93d6-90c300874aff admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:15.098919 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:15.099559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.099836 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.100105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] PATH_INFO: `/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67/users/7b426aaea04142e7a9f748f82c4ba3a8/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.102034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3a5d752a3d4edb8e01c673027f7b67, user_id=7b426aaea04142e7a9f748f82c4ba3a8, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:15.104661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc94457-0ef8-49fd-b3e2-478bb6e32e10 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:15.115361 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4394/8780] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:15 2022] PUT /identity/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67/users/7b426aaea04142e7a9f748f82c4ba3a8/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:15.125272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.125554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.125825 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.153217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] MFA Rules not processed for user `7b426aaea04142e7a9f748f82c4ba3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:15.154415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:15.221615 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4387/8781] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:45:15.235189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.235697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.235810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.254813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] MFA Rules not processed for user `baf5f2e04c4c45f9b1e4863fc9a26c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:15.255994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:15.274187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.313984 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4395/8782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:15.327886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:15.329482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:15.406612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85b58-bc16-4339-a966-8766bc649fe8 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:15.413149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:15.413752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.414027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.414292 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.422154 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:15.423718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:15.432345 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4388/8783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:15.898511 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:15.899883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:15.975038 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6ef1-dd84-44df-b2e6-bc745d1d3ab0 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:15.980117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:15.980668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:15.980975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:15.981245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:15.982955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:15.994885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:15.996464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af2e8e-d199-4e53-80ee-502f2528bf5b service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:16.006757 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4396/8784] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:25.428408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=93 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:26.002178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=46 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:28.026439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:28.041040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea0fe-3dcd-4129-842d-676fcc6d52c5 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:28.046636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:28.047232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.047513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.047784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.056122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:28.057739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:28.067426 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4389/8785] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:28.083322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef3317-14aa-4d85-b2b8-bb65d7fb0cd8 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.083747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef3317-14aa-4d85-b2b8-bb65d7fb0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.083840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef3317-14aa-4d85-b2b8-bb65d7fb0cd8 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.085264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4397/8786] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:45:28.089925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:45:28.105706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:28.113933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934544-f047-4ad3-944a-bbafd68a44fe service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:28.119851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b426aaea04142e7a9f748f82c4ba3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3a5d752a3d4edb8e01c673027f7b67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:28.120702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.121147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.121418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] PATH_INFO: `/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.122539 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f3a5d752a3d4edb8e01c673027f7b67)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:28.124306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:28.125959 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4390/8787] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:45:28 2022] GET /identity/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:45:28.442142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.442425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.442693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] PATH_INFO: `/` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.444112 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4398/8788] 10.222.0.16 () {54 vars in 912 bytes} [Fri Oct 28 10:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:45:28.449487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Authenticating service token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:45:28.451242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:28.469684 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:28.478898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61633c5a-a034-4b51-9bb5-7e7de099dbe6 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:28.483490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b426aaea04142e7a9f748f82c4ba3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3a5d752a3d4edb8e01c673027f7b67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:28.484112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.484397 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.484674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] PATH_INFO: `/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.485848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f3a5d752a3d4edb8e01c673027f7b67)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:28.487623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:28.489362 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4391/8789] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Oct 28 10:45:28 2022] GET /identity/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67 => generated 393 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:45:28.645536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:28.647191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:28.705622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919eb73-8c9b-4dc9-9ed2-cd07254ae420 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:28.709694 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:28.710298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:28.710577 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:28.710845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:28.712546 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:28.725424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:28.726863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b2208-9d56-4be8-80a8-151df691a025 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:28.737471 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4399/8790] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:32.521453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:32.583427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d688c-6c27-4d83-979a-9d1884222384 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:32.588172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:32.588714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:32.589022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:32.589296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] PATH_INFO: `/v3/users/baf5f2e04c4c45f9b1e4863fc9a26c16` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:32.590428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf5f2e04c4c45f9b1e4863fc9a26c16)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:32.592314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:32.639269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf5f2e04c4c45f9b1e4863fc9a26c16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:32.639974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf5f2e04c4c45f9b1e4863fc9a26c16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:32.640595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf5f2e04c4c45f9b1e4863fc9a26c16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:32.648587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf5f2e04c4c45f9b1e4863fc9a26c16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:32.655435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf5f2e04c4c45f9b1e4863fc9a26c16'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:32.673328 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4392/8791] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:32 2022] DELETE /identity/v3/users/baf5f2e04c4c45f9b1e4863fc9a26c16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:32.677975 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:32.678472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:32.678583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:32.697573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:32.698704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:32.756839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4400/8792] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:32.766204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:32.767592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:32.820431 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:32.824886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315604-716e-48b8-94e9-f2dc77ebc118 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:32.829423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:32.830393 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:32.830746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:32.831151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:32.841199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:32.842624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:32.852687 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4393/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:33.018408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.020514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:33.032776 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9914a-dc5c-4c7b-ab6d-e142f470897c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:33.037757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:33.038389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.038666 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.039031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] PATH_INFO: `/v3/projects/77a86ef86a1c4ac7b35642d8559975e6` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.040654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a86ef86a1c4ac7b35642d8559975e6)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:33.042591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:33.089689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a86ef86a1c4ac7b35642d8559975e6', 'request_id': 'req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.095160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a86ef86a1c4ac7b35642d8559975e6', 'request_id': 'req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.102530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a86ef86a1c4ac7b35642d8559975e6', 'request_id': 'req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.113365 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] The token cache is being invalidate because project 77a86ef86a1c4ac7b35642d8559975e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:33.113651 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.114284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.115755 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4401/8794] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:33 2022] DELETE /identity/v3/projects/77a86ef86a1c4ac7b35642d8559975e6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:33.119742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.129989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40bb0-b3d2-459c-9288-8d3619027fc7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:33.184713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:33.185361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.185642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.185914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] PATH_INFO: `/v3/users/7b426aaea04142e7a9f748f82c4ba3a8` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.187022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b426aaea04142e7a9f748f82c4ba3a8)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:33.189001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:33.236015 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b426aaea04142e7a9f748f82c4ba3a8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.236578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b426aaea04142e7a9f748f82c4ba3a8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.237196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b426aaea04142e7a9f748f82c4ba3a8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.245053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b426aaea04142e7a9f748f82c4ba3a8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.251876 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-3babac50-1779-4503-82d3-2ee65d33c16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b426aaea04142e7a9f748f82c4ba3a8'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.270103 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4394/8795] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:33 2022] DELETE /identity/v3/users/7b426aaea04142e7a9f748f82c4ba3a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:33.556787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.558481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:33.571655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba07b7-b390-4124-9ad7-ef18a8a170fe admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:33.603459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:33.640484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:33.641158 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.641815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.642094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] PATH_INFO: `/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.643225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3a5d752a3d4edb8e01c673027f7b67)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:33.645737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:33.692456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3a5d752a3d4edb8e01c673027f7b67', 'request_id': 'req-a59b56ef-50f7-4d8c-871f-a54564cf940e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.698535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3a5d752a3d4edb8e01c673027f7b67', 'request_id': 'req-a59b56ef-50f7-4d8c-871f-a54564cf940e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.705649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3a5d752a3d4edb8e01c673027f7b67', 'request_id': 'req-a59b56ef-50f7-4d8c-871f-a54564cf940e'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.717270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] The token cache is being invalidate because project 3f3a5d752a3d4edb8e01c673027f7b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:33.717555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.718182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-a59b56ef-50f7-4d8c-871f-a54564cf940e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:33.719663 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4402/8796] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:33 2022] DELETE /identity/v3/projects/3f3a5d752a3d4edb8e01c673027f7b67 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:33.725728 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.726186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.726290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.745744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:33.747001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:33.806945 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4395/8797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:33.815277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.815567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.815842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.836565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:33.837917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:33.845844 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4403/8798] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:33.850440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.860103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14c68-af37-4dc4-8f06-c496fe410209 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:33.864670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:33.865299 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.865574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.865846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.866471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:45:33.866769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:33.868343 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:33.874882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:33.882866 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4396/8799] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:45:33.885672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.895805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde4897-7ba5-44e7-869c-4796864c2943 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:33.903601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:33.904226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:33.904504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:33.904772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:33.905448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:33.907367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:33.934371 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4404/8800] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:45:33 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:33.938685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:33.949672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41690fc-f82e-4afd-b147-9c2b2644713e admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:34.009559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:34.010167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.010464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.010723 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.011342 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:34.013267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:34.033965 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4397/8801] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:45:33 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:45:34.038055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:34.048229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820356d5-9862-4e9d-8ca0-60cf8c5544cc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:34.053286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:34.053875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.054157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.054425 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.055050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:34.056635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:34.067174 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4405/8802] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:34.070925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:34.081217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0bd17-1d2d-4e99-8c3b-36312481fdc5 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:34.085814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:34.086402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.086675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.086943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.087568 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:34.089159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9fd0-2fd9-4cea-bc93-a760a72442f0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:34.098877 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4398/8803] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:34.102885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:34.112637 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62426-4ad2-4fa6-be1d-77afe34073bd admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:34.117951 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:34.118590 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.118868 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.119142 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] PATH_INFO: `/v3/projects/dedc9e2dcf3346fe8ca2e46cc4a504de/users/34ff19be87414c8583e3bacb352400c3/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.133983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedc9e2dcf3346fe8ca2e46cc4a504de, user_id=34ff19be87414c8583e3bacb352400c3, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:34.136622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:34.149119 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4406/8804] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:34 2022] PUT /identity/v3/projects/dedc9e2dcf3346fe8ca2e46cc4a504de/users/34ff19be87414c8583e3bacb352400c3/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:45:34.154179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7522-bd6f-4867-9838-9d0e0b5d6b89 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.154469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7522-bd6f-4867-9838-9d0e0b5d6b89 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.154744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7522-bd6f-4867-9838-9d0e0b5d6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.173438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-528d7522-bd6f-4867-9838-9d0e0b5d6b89 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:34.174628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-528d7522-bd6f-4867-9838-9d0e0b5d6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:34.232767 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4399/8805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:34.243050 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:34.244743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:34.302098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f62d3-fbfa-4cb5-b08f-de4c00d682d1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:34.305705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:34.306294 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:34.306575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:34.306840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:34.313533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:34.316259 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:34.318003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22368e3-e9d1-4f4c-baf9-d716043ae14c service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:34.328985 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4407/8806] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:38.342574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:38.343013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:38.343013 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:38.372826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] MFA Rules not processed for user `34ff19be87414c8583e3bacb352400c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:38.374071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:38.449261 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4400/8807] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:38.461002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:38.461522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:38.461522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:38.483092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] MFA Rules not processed for user `34ff19be87414c8583e3bacb352400c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:38.484324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:38.491996 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4408/8808] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:38.507234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:38.508934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:38.519320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:38.593980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152d38-da05-4f03-be39-2c26b44327f9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:38.604077 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:38.604715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:38.605261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:38.605422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:38.614579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:38.616152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:38.625442 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4401/8809] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:39.196393 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:39.198083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:39.285772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28fcd-0215-418d-96c0-0a0874ee3d92 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:39.290779 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:39.291385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:39.291663 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:39.291935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:39.293690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:39.305040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:39.306658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9b202-ba4c-4d27-bc51-bd6a18443bc4 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:39.316785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4409/8810] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:48.621171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=31 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:49.312397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=37 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:50.397961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:50.399502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:50.412290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245981-bcad-4e21-842d-d44c2429572b service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:50.416160 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:50.416766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:50.417074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:50.417350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:50.419505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:50.433198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:50.434554 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:50.445197 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4402/8811] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:50.558303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:50.558726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:50.558929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:50.589604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:50.590802 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:50.600426 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4410/8812] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:50.611805 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:50.626604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b60d5-648c-4e8e-a5d2-e8f2d2c8d10c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:50.631693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:50.632268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:50.632545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:50.632814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:50.641055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:50.642618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9b42d-9529-4dd2-be45-92baa7192f01 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:50.652608 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4403/8813] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:50.829544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:50.838780 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc5d74-7eeb-4722-82d4-ef96208b86c3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:50.842361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:50.842949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:50.843221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:50.843483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:50.845190 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:50.861064 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:50.862469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:50.876081 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4411/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:00.648643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:00.868989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=13 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:10.288524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:10.289082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:10.289082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:10.308547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:10.309755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:10.318203 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4404/8815] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 28 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:10.330464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:10.344216 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57e90-0082-4492-890e-50eaac4a4a9b service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:10.349245 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:10.350346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:10.350623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:10.350892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:10.359322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:10.360898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274afd1a-9629-4581-9a9e-0aed9defef0c service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:10.371401 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4412/8816] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:19.667125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:19.676411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a923bf-e6d3-4255-9784-2b66e71d0778 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:19.680115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:19.680711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:19.681059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:19.681332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:19.683011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:19.694972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:19.696674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ae6e2-edea-4168-adee-068a6a03d1d4 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:19.706928 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4405/8817] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:20.367224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:21.109231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:21.109675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:21.110015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:21.129906 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:21.131202 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:21.141429 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4413/8818] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Oct 28 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:21.154197 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:21.154682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:21.154800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:21.174584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:21.175783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:21.184355 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4406/8819] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Oct 28 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:21.190330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:21.200777 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1f3a-41f4-48d8-8587-d11a7ec3f79c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:21.205769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:21.206361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:21.206636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:21.206903 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:21.215517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:21.217120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:21.227560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4414/8820] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:31.127195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.132715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=13 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:31.139639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cc2b-c966-47cd-a749-f50a17f00add None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.144862 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.145001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.145311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.145583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] PATH_INFO: `/v3/users/34ff19be87414c8583e3bacb352400c3` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.146707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ff19be87414c8583e3bacb352400c3)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.149364 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.195195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ff19be87414c8583e3bacb352400c3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.195846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ff19be87414c8583e3bacb352400c3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.196711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ff19be87414c8583e3bacb352400c3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.205599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ff19be87414c8583e3bacb352400c3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.213030 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8f4ae201-6866-448d-be9d-c7241a68b0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ff19be87414c8583e3bacb352400c3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.222518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=9 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:31.230330 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4407/8821] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:46:31 2022] DELETE /identity/v3/users/34ff19be87414c8583e3bacb352400c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:46:31.402155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.413230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336575cf-cc3a-45a1-920f-2618c636ab5e service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.470537 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.471162 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.471439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.471709 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] PATH_INFO: `/v3/projects/dedc9e2dcf3346fe8ca2e46cc4a504de` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.472817 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedc9e2dcf3346fe8ca2e46cc4a504de)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.474787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.519206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'request_id': 'req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.525313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'request_id': 'req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.532446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'request_id': 'req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.543090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] The token cache is being invalidate because project dedc9e2dcf3346fe8ca2e46cc4a504de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:46:31.543374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.543997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-f26b5b19-0d70-4260-bd4a-9bf8fd5d5ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:46:31.545490 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4415/8822] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:46:31 2022] DELETE /identity/v3/projects/dedc9e2dcf3346fe8ca2e46cc4a504de => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:46:31.550497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.550786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.551062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.571672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:31.572855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:31.632101 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4408/8823] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:31.640677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.640994 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.641266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.660931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:31.662140 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:31.670397 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4416/8824] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:31.674509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.684580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd2938-9a16-4742-84bd-94951774d1a9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.689216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.689811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.690089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.690358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.690989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:46:31.691289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.692866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.705369 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4409/8825] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:46:31.709662 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.718969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04999124-8212-4c31-bfa5-da697bfe3777 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.723708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.724332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.724609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.724880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.725552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.727444 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.755237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4417/8826] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:46:31.760114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.770281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899f64-1806-4e6f-a0bb-3ca0d64a69ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.825782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.826440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.826721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.826992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.827622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.829618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.838391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:31.852834 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4410/8827] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:46:31 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:46:31.857177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.867917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6aaa-491c-425f-8d49-8f74a817d7f9 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.872557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.873173 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.873453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.873726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.874368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.875961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.886581 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4418/8828] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:46:31.890327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.900258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800db-e5d7-49a1-8dff-ef5972d17d55 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.904873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.905493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.905773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.906047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.906682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.908255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18635bff-b761-47c8-854b-c178758caf8f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.919720 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4411/8829] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:46:31.923653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:31.936764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7d88-6d73-4b38-80fd-ed652a2e0e6d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:31.942773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:31.943514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.944402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.944743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] PATH_INFO: `/v3/projects/08bbd521938347f79f6d57235c246c5e/users/fcc4e920a6784b02bbddf74e01158db5/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:31.970366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bbd521938347f79f6d57235c246c5e, user_id=fcc4e920a6784b02bbddf74e01158db5, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:31.973803 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:31.991448 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4419/8830] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:46:31 2022] PUT /identity/v3/projects/08bbd521938347f79f6d57235c246c5e/users/fcc4e920a6784b02bbddf74e01158db5/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:46:31.996592 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0503d1-22d3-4da8-a846-3eaf03d57942 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:31.996881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0503d1-22d3-4da8-a846-3eaf03d57942 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:31.997182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0503d1-22d3-4da8-a846-3eaf03d57942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:32.035855 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-5c0503d1-22d3-4da8-a846-3eaf03d57942 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:32.037211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5c0503d1-22d3-4da8-a846-3eaf03d57942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:32.106605 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4412/8831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:46:32.116387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:32.118199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:32.152886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:32.184553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5f12c-9996-449f-a03e-053b738039bc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:32.188495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:32.189129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:32.189399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:32.189673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:32.199758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:32.201234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4261f1e-da2a-4b58-a0ec-e2bd4261e4a7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:32.211676 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4420/8832] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:36.356600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:36.357104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:36.357190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:36.389561 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] MFA Rules not processed for user `fcc4e920a6784b02bbddf74e01158db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:36.390940 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:36.473282 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4413/8833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:36.484344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:36.484885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:36.484885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:36.506952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] MFA Rules not processed for user `fcc4e920a6784b02bbddf74e01158db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:36.508192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:36.515315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4421/8834] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:36.527511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:36.529073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:36.610660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:36.619956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b694e6-c397-41e4-a0a1-3d42b1055935 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:36.625619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:36.626229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:36.626511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:36.626790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:36.634760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:36.636341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:36.645366 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4414/8835] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:36.679074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:36.680522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:36.761022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdde6-ba9d-44da-8ed9-4fe1d8133ffc None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:36.764652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:36.765293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:36.765572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:36.765844 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:36.767559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:36.783287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:36.784705 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822aa360-e62c-4605-84d6-1fcbf836f712 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:36.798605 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4422/8836] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:37.344294 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:37.345737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:37.360187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb51a1-b76d-4fab-aa0e-461338adf608 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:37.366350 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:37.368502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:37.368976 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:37.369462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:37.371710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:37.396638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:37.398719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb32911-79f2-4f1f-843d-fa290b1c2764 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:37.419979 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4415/8837] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:46.791252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=52 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:47.406662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:29.736110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96831-9370-4703-9333-e1d34d1694a1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:47:29.736676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96831-9370-4703-9333-e1d34d1694a1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:47:29.736676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96831-9370-4703-9333-e1d34d1694a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:47:29.757401 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-28b96831-9370-4703-9333-e1d34d1694a1 None None] MFA Rules not processed for user `fcc4e920a6784b02bbddf74e01158db5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:47:29.758605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28b96831-9370-4703-9333-e1d34d1694a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:47:29.765507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4423/8838] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:47:39.752380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:08.656525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810e08-a2d3-4701-8890-33237c50f82d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:08.657136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810e08-a2d3-4701-8890-33237c50f82d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:08.657136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810e08-a2d3-4701-8890-33237c50f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:08.695053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d9810e08-a2d3-4701-8890-33237c50f82d None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:08.696523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9810e08-a2d3-4701-8890-33237c50f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:08.705796 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4416/8839] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:11.058589 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:11.059726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:11.059833 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:11.081042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:11.082261 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:11.092033 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4424/8840] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Oct 28 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:12.359966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29f8f-bc34-41e2-a128-c7ac8afd228a None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:12.360482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29f8f-bc34-41e2-a128-c7ac8afd228a None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:12.360482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29f8f-bc34-41e2-a128-c7ac8afd228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:12.381850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3de29f8f-bc34-41e2-a128-c7ac8afd228a None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:12.383295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3de29f8f-bc34-41e2-a128-c7ac8afd228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:12.393546 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4417/8841] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:12.405136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:12.415272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd9ce9-7915-4400-b8d2-6f61c34705a9 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:12.419100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:12.419909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:12.420187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:12.420455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:12.431472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:12.432962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:12.445780 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4425/8842] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:15.338124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:15.338680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:15.338680 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:15.358916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:15.360084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:15.369504 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4418/8843] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:15.380154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:15.388750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23a4c4-5c7e-42f9-b186-35ad7767618f service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:15.392388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:15.393014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:15.393288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:15.393554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:15.404536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:15.405993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:15.416666 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4426/8844] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:22.423356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:22.463779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47332058-0a73-45c3-8fb9-a36c218d6111 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:22.468864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:22.469569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:22.469848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:22.470117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] PATH_INFO: `/v3/users/fcc4e920a6784b02bbddf74e01158db5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:22.471262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc4e920a6784b02bbddf74e01158db5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:22.473270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:22.525929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc4e920a6784b02bbddf74e01158db5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.526586 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc4e920a6784b02bbddf74e01158db5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.527212 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc4e920a6784b02bbddf74e01158db5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.537316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc4e920a6784b02bbddf74e01158db5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.545129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8e17712f-46fc-43fb-9418-4b5d48b9713e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc4e920a6784b02bbddf74e01158db5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.563008 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4419/8845] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:48:22 2022] DELETE /identity/v3/users/fcc4e920a6784b02bbddf74e01158db5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:48:22.739683 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:22.778946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3ab59-882d-4e20-a579-a59fc6ce1e2a service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:22.835458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:22.836084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:22.836361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:22.836630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] PATH_INFO: `/v3/projects/08bbd521938347f79f6d57235c246c5e` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:22.837790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bbd521938347f79f6d57235c246c5e)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:22.839717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:22.884392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bbd521938347f79f6d57235c246c5e', 'request_id': 'req-e0c8a235-8cc8-4edd-9175-3de68a405027'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.890696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bbd521938347f79f6d57235c246c5e', 'request_id': 'req-e0c8a235-8cc8-4edd-9175-3de68a405027'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.897972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bbd521938347f79f6d57235c246c5e', 'request_id': 'req-e0c8a235-8cc8-4edd-9175-3de68a405027'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.909918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] The token cache is being invalidate because project 08bbd521938347f79f6d57235c246c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:48:22.910229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.910889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-e0c8a235-8cc8-4edd-9175-3de68a405027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:48:22.912389 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4427/8846] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:48:22 2022] DELETE /identity/v3/projects/08bbd521938347f79f6d57235c246c5e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:48:22.917599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:22.917913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:22.918180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:22.947187 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:22.948367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:23.008588 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4420/8847] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:48:23.016988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.017273 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.017545 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.036798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:23.038023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:23.045861 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4428/8848] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:23.049967 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.060202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a098b-d5cb-41a3-b5d8-a120c60a5d91 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.064778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.065411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.065691 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.065961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.066596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:48:23.066898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.068528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.069993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:23.082628 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4421/8849] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:48:23.086417 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.095611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f7e19-a0aa-4c5e-b1a1-001e60e07e6d None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.100253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6541-e423-4485-9520-d823945da6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.100835 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6541-e423-4485-9520-d823945da6da admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.101279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6541-e423-4485-9520-d823945da6da admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.101550 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6541-e423-4485-9520-d823945da6da admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.102171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6541-e423-4485-9520-d823945da6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.104052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6541-e423-4485-9520-d823945da6da admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.130819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4429/8850] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:48:23 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:48:23.134740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.145313 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85eac-44cd-4c50-bd68-e89d6f6c262d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.201516 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.202111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.202387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.202655 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.203265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.205215 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.225626 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4422/8851] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:48:23 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:48:23.229740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6541-e423-4485-9520-d823945da6da admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.236810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:23.241015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6541-e423-4485-9520-d823945da6da admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.247734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.248562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.249037 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.249313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.249954 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.251646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.261867 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4430/8852] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:48:23.265769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.275663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f0ff-df7c-4ac0-b724-213d43c2c607 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.280497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.281152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.281432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.281705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.282341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.283930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f7550-be82-4bae-8a2f-2636ddb53aad admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.296703 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4423/8853] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:48:23.301034 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.312014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4740-87b8-4ecd-b30f-2e523dc5e25d admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.316972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.317648 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.317932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.318205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] PATH_INFO: `/v3/projects/09f3883c8434405bb79bf4b18afab549/users/a84e8b5b3cc84489aa387be5a69b8670/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.335353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f3883c8434405bb79bf4b18afab549, user_id=a84e8b5b3cc84489aa387be5a69b8670, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.338187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.351821 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4431/8854] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:48:23 2022] PUT /identity/v3/projects/09f3883c8434405bb79bf4b18afab549/users/a84e8b5b3cc84489aa387be5a69b8670/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:48:23.357374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467270-65fd-4572-afea-3b50922d0d72 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.357730 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467270-65fd-4572-afea-3b50922d0d72 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.358092 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9467270-65fd-4572-afea-3b50922d0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.378878 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f9467270-65fd-4572-afea-3b50922d0d72 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:23.380053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f9467270-65fd-4572-afea-3b50922d0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:23.444754 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4424/8855] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:23.456495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:23.458377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:23.515988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b41ec-c6f2-497c-a0e4-dba7e5838d14 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:23.519661 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:23.520257 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:23.520528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:23.520794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:23.529881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:23.531300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:23.541206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4432/8856] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:27.378193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129743d5-7e2e-4d21-a76e-8a8f27158f0d None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:27.378661 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129743d5-7e2e-4d21-a76e-8a8f27158f0d None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:27.378774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129743d5-7e2e-4d21-a76e-8a8f27158f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:27.409858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-129743d5-7e2e-4d21-a76e-8a8f27158f0d None None] MFA Rules not processed for user `a84e8b5b3cc84489aa387be5a69b8670`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:27.411019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-129743d5-7e2e-4d21-a76e-8a8f27158f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:27.477854 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4425/8857] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:27.491815 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:27.493295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:27.567873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce12d2f-8bd5-428f-a17f-cbbe6ea84135 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:27.574636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:27.575336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:27.575624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:27.575895 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:27.585332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:27.586946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82347b7-9fed-449b-ad5c-9162a34fe46c service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:27.596275 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4433/8858] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:29.273050 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:29.273553 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:29.273672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:29.280718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:29.295028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] MFA Rules not processed for user `a84e8b5b3cc84489aa387be5a69b8670`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:29.296224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:29.303060 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4426/8859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:48:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:31.880000 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593856a-dcb3-4cc6-9eea-8e0f40479140 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:31.880544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593856a-dcb3-4cc6-9eea-8e0f40479140 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:31.880544 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593856a-dcb3-4cc6-9eea-8e0f40479140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:31.901984 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0593856a-dcb3-4cc6-9eea-8e0f40479140 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:31.903197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0593856a-dcb3-4cc6-9eea-8e0f40479140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:31.910096 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4434/8860] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 28 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:31.921772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:31.923286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:31.936166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47379f7-6917-4bc3-bf26-d84f65a3e54c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:31.940028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:31.940635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:31.940925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:31.941220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:31.949750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:31.951201 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:31.960125 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4427/8861] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:32.670758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937297e-373b-45d4-9e0d-c5fd76fb620f None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:32.671166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937297e-373b-45d4-9e0d-c5fd76fb620f None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:32.671515 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937297e-373b-45d4-9e0d-c5fd76fb620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:32.712556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c937297e-373b-45d4-9e0d-c5fd76fb620f None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:32.713719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c937297e-373b-45d4-9e0d-c5fd76fb620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:32.727073 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4435/8862] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:48:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:32.753315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:32.755169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:32.772332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f0b6f-c939-4e9d-b02e-2dde7778fc57 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:32.780479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:32.781483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:32.781829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:32.782186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:32.793520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:32.795226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:32.806086 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4428/8863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:41.625771 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2357-36f3-4e1e-b2d9-2c03c71d86c0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:41.626301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2357-36f3-4e1e-b2d9-2c03c71d86c0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:41.626301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2357-36f3-4e1e-b2d9-2c03c71d86c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:41.647467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-286a2357-36f3-4e1e-b2d9-2c03c71d86c0 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:41.648679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-286a2357-36f3-4e1e-b2d9-2c03c71d86c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:41.658842 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4436/8864] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:48:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:41.671610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:41.682860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8309c7-b7f5-4937-b3aa-899127eff811 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:41.689058 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:41.689662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:41.689946 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:41.690220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:41.700571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:41.702195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:41.712983 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4429/8865] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:51.640965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:51.708487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=20 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:46.764388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa0-cdd1-4ea0-bdb9-a2f88ef0c691 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:49:46.764998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa0-cdd1-4ea0-bdb9-a2f88ef0c691 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:49:46.764998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa0-cdd1-4ea0-bdb9-a2f88ef0c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:49:46.796091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8160efa0-cdd1-4ea0-bdb9-a2f88ef0c691 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:49:46.797321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8160efa0-cdd1-4ea0-bdb9-a2f88ef0c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:49:46.821769 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4437/8866] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:49:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:49:46.834064 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:49:46.851954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148458-ae47-4bea-b1a0-27e3d80787b6 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:49:46.856121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:49:46.856726 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:49:46.857039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:49:46.857304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:49:46.865392 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:49:46.866409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:49:46.874550 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4430/8867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:49:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:49:56.815521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=14 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:56.870854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:00.810458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:00.811029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:00.811029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:00.831840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:00.833186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:00.839839 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4438/8868] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Oct 28 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:50:00.857893 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:00.862051 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:00.867573 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1eaa-be59-4b13-a50c-1708ab28fecd service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:00.871279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b18ad-7940-4e0b-b056-5831e09893cb None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:00.874049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:00.874049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:00.874049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:00.874049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:00.875337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:00.876553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:00.876834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:00.877130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:00.881818 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:00.883256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49c54a-985b-4af9-a6be-2be0efe8d75a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:00.884719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:00.886168 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:00.892221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4431/8869] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:50:00.894947 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4439/8870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:50:08.221008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48177-bd7a-4806-8a6b-943c6d20187b None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:08.221628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48177-bd7a-4806-8a6b-943c6d20187b None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:08.221628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48177-bd7a-4806-8a6b-943c6d20187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:08.242426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2bb48177-bd7a-4806-8a6b-943c6d20187b None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:08.243635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bb48177-bd7a-4806-8a6b-943c6d20187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:08.253629 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4432/8871] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:50:08.269298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:08.283141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0809-dd23-4909-aff6-a0b494c8ae80 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:08.289130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:08.289829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:08.290112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:08.290392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:08.299652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:08.301350 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c7a8-0b69-49e7-9f11-0d9efe144a77 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:08.311742 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4440/8872] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:50:12.737423 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:12.737907 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:12.738029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:12.757628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] MFA Rules not processed for user `a84e8b5b3cc84489aa387be5a69b8670`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:12.758796 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:12.765759 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4433/8873] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:50:13.069112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796414-1811-4737-8aa9-be63b59fde60 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:13.069629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796414-1811-4737-8aa9-be63b59fde60 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:13.069748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796414-1811-4737-8aa9-be63b59fde60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:13.088829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-0d796414-1811-4737-8aa9-be63b59fde60 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:13.090049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-0d796414-1811-4737-8aa9-be63b59fde60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:13.096400 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4441/8874] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:50:13.107742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:13.117754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227321-b493-4120-ac01-ed1d3b9f18e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:13.121285 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:13.121874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:13.122147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:13.122412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:13.130042 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:13.131451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:13.139205 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4434/8875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:50:23.083886 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=18 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:23.135798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=18 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:13.284079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:13.284517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:13.284634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:13.334240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:51:13.335446 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:13.397324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4442/8876] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Oct 28 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:51:13.403304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:13.415585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f327d5-ae4b-41f1-88c2-741bd6e72bd5 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:13.420466 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:13.421091 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:13.421373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:13.421641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:13.423341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:13.434447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:13.435997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:13.445837 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4435/8877] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:23.388470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=40 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:23.442059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:49.359586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:49.361043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:49.374501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa445-0c91-4139-9290-d14db4ff27df None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:49.380269 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:49.380873 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:49.381184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:49.381454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:49.383166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:49.394718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:49.396302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:49.413598 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4443/8878] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:49.664063 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:49.673396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b9af7-2e85-4549-925c-545fbbfe72d1 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:49.677549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:49.678137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:49.678449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:49.678721 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:49.680426 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:49.714962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:49.716372 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:49.730268 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4436/8879] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:49.791019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:49.802112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143d45-e7f7-47a8-aa0b-b86d6df5c2c5 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:49.807195 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:49.807785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:49.808069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:49.808344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:49.810074 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:49.821505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:49.823070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dde4f-1715-42e4-9d89-ef6d514272cb service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:49.833404 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4444/8880] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:50.191389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:50.203335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13da62-f821-4317-aea7-3690f6d51360 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:50.208500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:50.209133 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:50.209413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:50.209686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:50.211390 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:50.222454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:50.224525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:50.234377 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4437/8881] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:59.828793 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:00.230152 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=20 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:05.809137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:52:05.809602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:52:05.809698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:52:05.829212 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] MFA Rules not processed for user `a84e8b5b3cc84489aa387be5a69b8670`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:52:05.830392 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:52:05.837243 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4445/8882] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:52:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:52:06.448018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:52:06.458678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6aaae-9caa-4999-a021-9f1c51707c99 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:52:06.464463 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:52:06.465162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:52:06.465473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:52:06.465713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:52:06.467447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:52:06.480110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:52:06.481724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:52:06.497067 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4438/8883] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:52:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:52:15.824249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:16.487593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:33.565517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:33.578889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feaad6-61ae-446c-a0c1-b73a7618d8c1 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:33.584402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:33.585143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:33.585422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:33.585691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:33.594217 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:33.595826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:33.604832 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4446/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:33.840022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:33.850480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17098b-275e-4ae7-b781-1d359d882d8b service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:33.854617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:33.855369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:33.855870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:33.856184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:33.857935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:33.872418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:33.873873 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:33.887006 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4439/8885] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:35.034609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:35.045019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349433ba-0b58-40dc-90b6-ffbfda12d651 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:35.048644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:35.049281 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:35.049768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:35.050199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:35.057970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:35.059284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:35.067267 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4447/8886] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:35.106809 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:35.115779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab266caf-0f43-4845-8e42-28ed3bcfc79f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:35.119598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:35.120196 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:35.120477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:35.120813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:35.122678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:35.136722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:35.138183 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e6c6-e4bb-47fa-a497-45b23dfe2239 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:35.149896 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4440/8887] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:53:45.063789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:45.144267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:48.257703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:48.271609 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d3c3-a834-4751-adf6-f62b7de658ac service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:48.277765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:48.278368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:48.278640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:48.278907 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:48.287932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:48.289528 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:48.299838 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4448/8888] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:58.295582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:05.178610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef801d6-1144-4834-9a6a-249439f71b29 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:54:05.179078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef801d6-1144-4834-9a6a-249439f71b29 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:54:05.179182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef801d6-1144-4834-9a6a-249439f71b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:54:05.199752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-0ef801d6-1144-4834-9a6a-249439f71b29 None None] MFA Rules not processed for user `a84e8b5b3cc84489aa387be5a69b8670`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:54:05.201011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-0ef801d6-1144-4834-9a6a-249439f71b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:54:05.208279 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4441/8889] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:54:15.194188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:17.447935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:54:17.459101 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e777f52-56f0-4dd0-bd11-0eb95405804a service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:54:17.464912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:54:17.465563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:54:17.465842 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:54:17.466114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:54:17.475006 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:54:17.476583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:54:17.487023 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4449/8890] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:54:27.482724 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:41.122639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:55:41.123223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:55:41.123223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:55:41.172113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:55:41.173328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:55:41.188794 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4442/8891] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:55:41.200467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:55:41.209783 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0af6f-da4d-445a-bcd5-ccb772219c9b service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:55:41.213816 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:55:41.214405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:55:41.214685 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:55:41.214952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:55:41.221825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:55:41.223246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:55:41.231560 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4450/8892] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:55:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:55:41.369540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:55:41.381252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19ba3-85f4-498d-af81-3b70d9933f87 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:55:41.385480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:55:41.386335 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:55:41.386621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:55:41.386892 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:55:41.394832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:55:41.396407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:55:41.404953 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4443/8893] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:55:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:55:51.227560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:51.401436 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=24 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:07.467627 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:07.476282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5f1a0-9edb-41d5-9645-2b0980204854 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:07.480376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:07.481094 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:07.481387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:07.481644 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:07.488607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:07.490060 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:07.498358 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4451/8894] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:17.494286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:22.302026 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:22.324080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479afe50-0efd-460a-8694-d6cee0bdd8e8 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:22.329118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:22.329732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:22.329994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:22.330264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:22.338502 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:22.340705 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:22.350348 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4444/8895] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:26.017565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:26.034799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54751-61a6-4630-a57e-6a18c93498f8 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:26.040673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:26.041381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:26.041734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:26.042079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:26.052719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:26.054695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0766b66-28f9-4912-ae2d-0d9a19888d7a service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:26.067150 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4452/8896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:32.346454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:36.061368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:56.154216 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:56.163681 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87067dba-5cb9-45a5-b54e-b8b6b79877c2 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:56.167853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:56.168446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:56.168724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:56.169027 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:56.177881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:56.179287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:56.206998 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4445/8897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:59.378826 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:59.379400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:59.379657 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:59.416083 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:59.419298 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:59.429216 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4453/8898] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:59.443485 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:59.455332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:59.458318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a244-e498-4691-80fd-a94b250afc4d service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:59.470905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:59.471287 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c33cf-e060-485f-a101-876f0fb8405e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:59.471535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:59.471814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:59.472085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:59.475979 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:59.476611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:59.476892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:59.477194 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] PATH_INFO: `/v3/users/a84e8b5b3cc84489aa387be5a69b8670` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:59.478396 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84e8b5b3cc84489aa387be5a69b8670)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:59.480863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:59.482511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:59.484071 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:59.494893 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4446/8899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:59.531853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84e8b5b3cc84489aa387be5a69b8670'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.532608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84e8b5b3cc84489aa387be5a69b8670'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.539344 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84e8b5b3cc84489aa387be5a69b8670'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.546831 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84e8b5b3cc84489aa387be5a69b8670'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.547478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ae02aa20-8548-4ef2-8656-b3b1b1791d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84e8b5b3cc84489aa387be5a69b8670'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.564775 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4454/8900] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:56:59 2022] DELETE /identity/v3/users/a84e8b5b3cc84489aa387be5a69b8670 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:56:59.746478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:59.758958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c172-bc59-4536-83eb-809e807fe6b5 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:59.815520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:59.816139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:59.816416 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:59.816683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] PATH_INFO: `/v3/projects/09f3883c8434405bb79bf4b18afab549` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:59.817798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f3883c8434405bb79bf4b18afab549)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:59.819688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:59.865944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f3883c8434405bb79bf4b18afab549', 'request_id': 'req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.871793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f3883c8434405bb79bf4b18afab549', 'request_id': 'req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.878902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f3883c8434405bb79bf4b18afab549', 'request_id': 'req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.902621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] The token cache is being invalidate because project 09f3883c8434405bb79bf4b18afab549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:56:59.902910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.903543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ec36a1ef-c33f-4830-ad10-11fb2320fd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:59.905089 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4447/8901] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:56:59 2022] DELETE /identity/v3/projects/09f3883c8434405bb79bf4b18afab549 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:59.909987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:59.910302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:59.910576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:59.958638 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:59.959875 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:00.018727 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4455/8902] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:00.027546 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.027938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.028305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.047636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:00.048828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:00.056681 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4448/8903] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:00.060808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.070557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7594-6bbf-4172-aff4-a3f2c8dd9e99 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.075829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.076424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.076696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.076993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.077624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:57:00.077918 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.079494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.091413 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4456/8904] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:57:00.095622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.104950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aa322-006c-4521-a1e3-3ca9de3a9d22 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.109600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.110193 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.110471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.110769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.111415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.113349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.144473 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:00.153237 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4449/8905] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:57:00 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:00.156548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.166464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e8658-4d37-4968-a515-1a54a1121396 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.186303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:00.224841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.225439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.225717 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.225980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.226583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.228510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.248885 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4457/8906] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:57:00 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:00.253173 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.263999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed074-5d9a-45b9-b5e5-268b23b276ce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.268685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.269314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.269597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.269869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.270507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.272101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.282454 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4450/8907] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:00.286566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.296983 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd9b4-c5f8-415a-b9cf-a5cd70ca1c32 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.301633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.302234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.302514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.302785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.303416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.305075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606ad2e-af38-4ad5-8ebc-60affaf8d785 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.316644 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4458/8908] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:00.320788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.331753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6985b-08bf-4e97-959f-14ee1edded35 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.336662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.337332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.337603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.337870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] PATH_INFO: `/v3/projects/d2e93db79a4c47e2af4be2f269c21c7e/users/521e21daa5d34a06ac28c7e09ddbeaf8/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.353223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e93db79a4c47e2af4be2f269c21c7e, user_id=521e21daa5d34a06ac28c7e09ddbeaf8, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.355933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.372118 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4451/8909] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:57:00 2022] PUT /identity/v3/projects/d2e93db79a4c47e2af4be2f269c21c7e/users/521e21daa5d34a06ac28c7e09ddbeaf8/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:57:00.377172 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.377458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.377730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.397415 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:00.398611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:00.459256 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4459/8910] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:57:00.469033 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:00.470795 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:00.527629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56a810-1444-44ca-b606-df3903339b67 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:00.531356 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:00.531989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:00.532269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:00.532540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:00.541483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:00.543407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b2bb-0fa8-4cc2-ae7e-d7342ac64e58 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:00.552745 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4452/8911] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:03.035863 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:03.037377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:03.144634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76009-c421-4b6d-bbed-7d1960a56e0a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:03.150725 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:03.151510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:03.151843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:03.152118 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:03.153972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:03.167570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:03.169408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc95de-9773-4cc8-9da8-79d70b42f498 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:03.187069 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4460/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:04.305228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:04.305789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:04.305789 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:04.344662 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] MFA Rules not processed for user `521e21daa5d34a06ac28c7e09ddbeaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:04.346238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:04.433295 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4453/8913] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:04.445775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:04.446551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:04.446551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:04.470009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] MFA Rules not processed for user `521e21daa5d34a06ac28c7e09ddbeaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:04.471249 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:04.479794 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4461/8914] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:04.490562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:04.492102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:04.560949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:04.597827 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dce69-a5d2-4e3f-b6d5-03c05ab1e0f3 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:04.604227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:04.604851 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:04.605163 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:04.605435 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:04.614702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:04.615987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:04.626500 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4454/8915] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:04.913139 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:04.914639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:04.926607 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48171fa-a31d-43bb-85e7-407e7390d122 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:04.930155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:04.930761 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:04.931036 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:04.931306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:04.933606 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:04.945595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:04.947286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b452fe1-d15f-41f0-b519-30d1f476d328 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:04.956464 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4462/8916] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:06.301371 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:06.330341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6794-d8d1-4f83-91a3-f643bc56fb65 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:06.336769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:06.337520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:06.337933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:06.338298 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:06.340594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:06.362142 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:06.364383 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:06.376856 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4455/8917] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:14.952610 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:16.072348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c419-770b-4344-8574-2d7579cceca7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:16.072991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c419-770b-4344-8574-2d7579cceca7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:16.072991 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c419-770b-4344-8574-2d7579cceca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:16.092416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-c476c419-770b-4344-8574-2d7579cceca7 None None] MFA Rules not processed for user `521e21daa5d34a06ac28c7e09ddbeaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:16.093649 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c476c419-770b-4344-8574-2d7579cceca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:16.100507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4463/8918] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:16.372180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=18 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:16.664439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:16.675498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74b382-229a-430c-91cf-8f8c53a126cd service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:16.680603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:16.681244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:16.681515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:16.681782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:16.683550 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:16.695012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:16.696836 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:16.707284 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4456/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:26.086735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:26.703415 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:38.975439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:38.975989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:38.975989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.004268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:39.005603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:39.016336 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4464/8920] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 10:57:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:39.033230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.034800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:39.049267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7d6a-3a14-4367-b599-7ffe891fc16a service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.055188 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.055866 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.056151 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.056496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.057953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.068079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.069992 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd49eec-8b5d-463d-a42c-b39624bbb7e5 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.070779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.075519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.076615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.077380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.077807 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] PATH_INFO: `/v3/users/521e21daa5d34a06ac28c7e09ddbeaf8` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.079240 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521e21daa5d34a06ac28c7e09ddbeaf8)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.081270 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.083734 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4457/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:39.140431 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521e21daa5d34a06ac28c7e09ddbeaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.141210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521e21daa5d34a06ac28c7e09ddbeaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.148271 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521e21daa5d34a06ac28c7e09ddbeaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.155935 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521e21daa5d34a06ac28c7e09ddbeaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.156586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-7abd1930-575c-4414-80ea-c4e2ab308449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521e21daa5d34a06ac28c7e09ddbeaf8'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.174449 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4465/8922] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:57:39 2022] DELETE /identity/v3/users/521e21daa5d34a06ac28c7e09ddbeaf8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:39.345425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.356957 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d092e-4193-4f0b-9e23-697e0b1abca9 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.413731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.414360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.414637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.414905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] PATH_INFO: `/v3/projects/d2e93db79a4c47e2af4be2f269c21c7e` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.416679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e93db79a4c47e2af4be2f269c21c7e)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.418608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.464547 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e93db79a4c47e2af4be2f269c21c7e', 'request_id': 'req-fc79380f-b480-4b2a-8fdd-307418da8bc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.470001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e93db79a4c47e2af4be2f269c21c7e', 'request_id': 'req-fc79380f-b480-4b2a-8fdd-307418da8bc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.476953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e93db79a4c47e2af4be2f269c21c7e', 'request_id': 'req-fc79380f-b480-4b2a-8fdd-307418da8bc3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.488046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] The token cache is being invalidate because project d2e93db79a4c47e2af4be2f269c21c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:57:39.488332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.488975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-fc79380f-b480-4b2a-8fdd-307418da8bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:39.490434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4458/8923] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:57:39 2022] DELETE /identity/v3/projects/d2e93db79a4c47e2af4be2f269c21c7e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:39.495447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.495734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.496009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.515861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:39.517097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:39.575421 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4466/8924] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:57:39.584532 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.584820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.585128 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.605720 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:39.606879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:39.614963 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4459/8925] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:57:39.619223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.628966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753ba8-00ff-486d-933c-c97b210f0784 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.633432 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.634024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.634302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.634572 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.635746 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:57:39.636048 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.637671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.649045 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4467/8926] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:57:39.653823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.663530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67af9b2-85dd-4482-b743-de43067f2057 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.668366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.668979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.669260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.669529 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.670159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.672099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.699200 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4460/8927] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:57:39 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:57:39.703267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.713900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b264a-e835-4f78-b5cb-7ef19f8eba67 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.761322 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:39.771300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.771902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.772181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.772448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.773096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.775008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.798535 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4468/8928] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:57:39 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:39.799731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.810600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a9c62-25d7-4e6c-a1f1-b5f442ba39cb admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.815291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.815881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.816162 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.816432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.817106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.819156 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.829877 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4461/8929] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:39.833674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.844089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a529a-6d65-45fd-9e25-fe84df28d8d5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.848711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.849346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.849646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.849902 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.850532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.852155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fbd4a-f0f1-41fe-8c2f-8b04f9aae105 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.862764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4469/8930] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:39.866657 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:39.877242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5a5c-d787-4c1d-8d27-bc3644427611 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:39.881858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:39.882509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.882786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.883059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] PATH_INFO: `/v3/projects/49d7d930e18643d886164197959e8630/users/b0d84b5d83d044b896b39954592acedc/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.898008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d7d930e18643d886164197959e8630, user_id=b0d84b5d83d044b896b39954592acedc, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:39.900739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:39.913073 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4462/8931] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:57:39 2022] PUT /identity/v3/projects/49d7d930e18643d886164197959e8630/users/b0d84b5d83d044b896b39954592acedc/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:39.923047 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:39.923336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:39.923611 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:39.953591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] MFA Rules not processed for user `b0d84b5d83d044b896b39954592acedc`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:39.954797 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:40.019507 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4470/8932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:40.029934 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:40.031671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:40.045870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:40.089552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79300f5-521d-44f7-87ac-b861e91f1533 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:40.093293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:40.093891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:40.094169 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:40.094442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:40.102763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:40.104208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b5754-b820-4079-a6fd-30a5a10c8d22 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:40.113052 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4463/8933] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:50.016561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:50.109082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=20 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:50.606103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:50.674362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044173d9-045d-475e-a37c-c85b26c5f16b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:50.678908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:50.679532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:50.679808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:50.680105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] PATH_INFO: `/v3/users/b0d84b5d83d044b896b39954592acedc` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:50.681238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d84b5d83d044b896b39954592acedc)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:50.683182 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:50.729908 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d84b5d83d044b896b39954592acedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:50.730492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d84b5d83d044b896b39954592acedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:50.738411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d84b5d83d044b896b39954592acedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:50.745343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d84b5d83d044b896b39954592acedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:50.745972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d84b5d83d044b896b39954592acedc'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:50.763562 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4471/8934] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:57:50 2022] DELETE /identity/v3/users/b0d84b5d83d044b896b39954592acedc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:50.768088 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:50.768399 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:50.768672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:50.787933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:50.789149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:50.847204 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4464/8935] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:50.856982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:50.858408 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:50.915598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3bc-ec0e-4114-8a05-43955ff92d60 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:50.919341 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:50.919968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:50.920246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:50.920517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:50.929524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:50.930945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6d574-23f4-4baf-a14f-efc223769fb6 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:50.940442 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4472/8936] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:51.105854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.107287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:51.119973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbeded-9c85-43dd-8ca5-ffe22d8323f5 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.124711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.125375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.125660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.125931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] PATH_INFO: `/v3/projects/49d7d930e18643d886164197959e8630` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.127056 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d7d930e18643d886164197959e8630)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.129003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.175497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d7d930e18643d886164197959e8630', 'request_id': 'req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:51.180995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d7d930e18643d886164197959e8630', 'request_id': 'req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:51.188711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d7d930e18643d886164197959e8630', 'request_id': 'req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:51.200562 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] The token cache is being invalidate because project 49d7d930e18643d886164197959e8630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:57:51.200850 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:51.201513 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-8a964e1a-0cd2-4139-a5ce-ff50afdfffb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:51.203011 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4465/8937] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:57:51 2022] DELETE /identity/v3/projects/49d7d930e18643d886164197959e8630 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:51.208403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.208921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.209023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.228171 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:51.229395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:51.246674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:51.289511 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4473/8938] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:51.297179 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.297465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.297738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.317733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:51.318928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:51.327683 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4466/8939] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:51.331731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.341376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c62917-2e35-4b53-a89c-601983fede22 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.345877 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.346470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.346747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.347014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.347647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:57:51.347942 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.349565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.361185 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4474/8940] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:57:51.365365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.374951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572553-ec6b-4783-bea7-07487e720258 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.379565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.380153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.380433 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.380706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.381378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.383297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.410145 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4467/8941] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:57:51 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:57:51.414361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.424237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde371bd-de0d-4151-9da0-38bb149da0c5 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.480499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.481131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.481410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.481682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.482307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.484234 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.505390 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4475/8942] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:57:51 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:51.509524 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.519722 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3625-4343-4c53-a205-fc2faf8b4fae admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.524331 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.524950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.525262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.525535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.526178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.527762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.537713 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4468/8943] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:51.541931 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.551885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947f21-e90f-45a0-88e1-1b089e679621 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.557148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.557737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.558019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.558290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.558922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.560518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8bf93-3df7-43e0-b5a3-5b4cd396f453 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.571206 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4476/8944] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:51.575559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.585651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c1672-809d-4222-8dcb-81bf4c9b2e4c admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.590347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.590995 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.591276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.591595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] PATH_INFO: `/v3/projects/394699ae8a514c48ac08d4209727036b/users/883a2745f340457182f0607a1a91ca15/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.607748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394699ae8a514c48ac08d4209727036b, user_id=883a2745f340457182f0607a1a91ca15, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.610418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.623083 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4469/8945] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:57:51 2022] PUT /identity/v3/projects/394699ae8a514c48ac08d4209727036b/users/883a2745f340457182f0607a1a91ca15/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:51.633089 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.633376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.633680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.663375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] MFA Rules not processed for user `883a2745f340457182f0607a1a91ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:51.664615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:51.729587 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4477/8946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:51.739488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:51.741259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:51.763207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:51.798295 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269812-0e5f-4ca4-9b91-e6be4012be71 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:51.801928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:51.802525 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:51.802801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:51.803070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:51.811806 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:51.813253 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a8a49-a691-4491-9b9b-ef64b9fc175b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:51.822111 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4470/8947] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:56.205672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:56.224459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:56.269518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a772a3-66ae-44eb-8f4d-2f8308c28a63 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:56.273930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:56.274552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.274827 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.275120 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] PATH_INFO: `/v3/users/883a2745f340457182f0607a1a91ca15` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.276223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] RBAC: Authorizing `identity:delete_user(user_id=883a2745f340457182f0607a1a91ca15)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:56.278166 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:56.328495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883a2745f340457182f0607a1a91ca15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.329196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883a2745f340457182f0607a1a91ca15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.338387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883a2745f340457182f0607a1a91ca15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.345767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883a2745f340457182f0607a1a91ca15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.346587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883a2745f340457182f0607a1a91ca15'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.366452 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4478/8948] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 10:57:56 2022] DELETE /identity/v3/users/883a2745f340457182f0607a1a91ca15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:57:56.371172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.371621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.371849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.391256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:56.392551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:56.454327 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4471/8949] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:56.464740 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:56.466152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:56.521812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824220e-2b29-437a-a77e-1684a81f857b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:56.525904 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:56.526497 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.526772 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.527040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.537079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:56.538503 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b70dab-b2a2-4999-b914-f301732271dd service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:56.548396 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4479/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:56.720673 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:56.722322 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:56.735760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b88fe3-31a9-4606-894d-291e17dbf02c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:56.740425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:56.741078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.741355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.741625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] PATH_INFO: `/v3/projects/394699ae8a514c48ac08d4209727036b` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.742750 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=394699ae8a514c48ac08d4209727036b)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:56.744689 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:56.793094 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394699ae8a514c48ac08d4209727036b', 'request_id': 'req-16368b54-3db5-48b7-b130-0691e04e1e0f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.798434 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394699ae8a514c48ac08d4209727036b', 'request_id': 'req-16368b54-3db5-48b7-b130-0691e04e1e0f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.805817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394699ae8a514c48ac08d4209727036b', 'request_id': 'req-16368b54-3db5-48b7-b130-0691e04e1e0f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.816794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] The token cache is being invalidate because project 394699ae8a514c48ac08d4209727036b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:57:56.817109 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.817754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-16368b54-3db5-48b7-b130-0691e04e1e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:57:56.819240 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4472/8951] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:57:56 2022] DELETE /identity/v3/projects/394699ae8a514c48ac08d4209727036b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:57:56.825013 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.825297 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.825566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.845434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:56.846628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:56.879494 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:56.907591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4480/8952] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:56.916613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.916956 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.917232 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.936724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:56.937985 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:56.945858 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4473/8953] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:56.950848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:56.960409 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d0f8-8767-4f14-b6b5-8fbda631a95e None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:56.965563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:56.966150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.966423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:56.966690 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:56.967437 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:57:56.967737 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:56.969384 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:56.980772 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4481/8954] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:57:56.985081 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:56.994272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e72b5-0f74-4735-bb86-f456e3f99d88 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:56.998899 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:56.999488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:56.999767 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.000036 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.000675 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.002629 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.030157 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4474/8955] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:57:56 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:57.034410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:57.044346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e73c9-133a-4138-9a29-b6e7cc9b330c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:57.099403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:57.099993 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.100265 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.100548 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.101292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.103221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.124396 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4482/8956] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:57:57 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:57:57.128483 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:57.139565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c84e23-ee88-4fef-a4f6-f83f9f0f9884 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:57.144137 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:57.144725 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.145045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.145315 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.145938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.147544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.157286 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4475/8957] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:57.161157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:57.170968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f90c46-fede-426d-800c-7b6752d56feb admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:57.175539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:57.176117 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.176398 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.176664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.177319 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.178888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221ccb5-9ad3-478f-bae2-09aafeff8040 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.189801 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4483/8958] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:57:57.193471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:57.204052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9f24-004e-42f5-8b26-6635f359dcd1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:57.208560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:57.209226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.209522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.209772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] PATH_INFO: `/v3/projects/7d38e856f240411a9e040be046e4bbae/users/c7c3887f21264885b5e50be86d97e5cb/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.212250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:57.227097 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d38e856f240411a9e040be046e4bbae, user_id=c7c3887f21264885b5e50be86d97e5cb, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.229783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.242524 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4476/8959] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:57:57 2022] PUT /identity/v3/projects/7d38e856f240411a9e040be046e4bbae/users/c7c3887f21264885b5e50be86d97e5cb/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:57:57.247893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274f85-5e80-4fd3-bc40-84adb3ef341e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.248387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274f85-5e80-4fd3-bc40-84adb3ef341e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.248522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274f85-5e80-4fd3-bc40-84adb3ef341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.267791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-26274f85-5e80-4fd3-bc40-84adb3ef341e None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:57:57.269477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-26274f85-5e80-4fd3-bc40-84adb3ef341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:57.328198 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4484/8960] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:57:57.337922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:57.339584 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:57:57.395932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f050d6f-25e0-46bd-9020-504ae02d37c0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:57.399572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:57.400190 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:57.400467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:57.400736 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:57.409625 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:57.411060 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:57.420685 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4477/8961] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:01.314366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.314929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.314929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.344268 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] MFA Rules not processed for user `c7c3887f21264885b5e50be86d97e5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:01.345462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:01.379956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:01.414500 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4485/8962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:01.419085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.429250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c435d3-b037-4a73-8580-eef298bfeced service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.434375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.435018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.435301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.435574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.436288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.438221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.466926 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4478/8963] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 10:58:01 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:58:01.470947 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.483731 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c444-6ab3-4f89-8566-a6c63a84d63c None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.543353 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.543972 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.544252 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.544524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.545214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.547170 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.569641 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4486/8964] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 10:58:01 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:58:01.574784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.585808 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef517-90b1-4fb9-aea2-c72b12855178 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.590551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.591164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.591445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.591717 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.592387 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.594005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.607563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4479/8965] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:58:01.610563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.621597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce0438-cff9-40db-baed-0b8c30440e70 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.627184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.627978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.628318 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.628583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] PATH_INFO: `/v3/projects/712dd249e67a4bcf8c64e60ee0524408/users/646dc1cd8f61429bb2e228852b02826a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.670748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712dd249e67a4bcf8c64e60ee0524408, user_id=646dc1cd8f61429bb2e228852b02826a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.673801 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.691618 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4487/8966] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:58:01 2022] PUT /identity/v3/projects/712dd249e67a4bcf8c64e60ee0524408/users/646dc1cd8f61429bb2e228852b02826a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:58:01.695422 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.706766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb909-2e98-4372-bcd6-e837733dd8ac admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.773087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.773794 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.774143 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.774506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.775261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.776982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681087-5258-45db-996f-d69d1a87fffd admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.790574 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4480/8967] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:58:01.791766 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:01.802832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac763-dfaa-4fc7-81bd-f7253b030598 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:01.808289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:01.809009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:01.809295 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:01.809567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] PATH_INFO: `/v3/projects/712dd249e67a4bcf8c64e60ee0524408/users/646dc1cd8f61429bb2e228852b02826a/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:01.811722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=712dd249e67a4bcf8c64e60ee0524408, user_id=646dc1cd8f61429bb2e228852b02826a, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:01.814470 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:01.826513 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4488/8968] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 10:58:01 2022] PUT /identity/v3/projects/712dd249e67a4bcf8c64e60ee0524408/users/646dc1cd8f61429bb2e228852b02826a/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:58:06.233746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25ede-f9bd-4663-b11a-904f86528153 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:06.234306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25ede-f9bd-4663-b11a-904f86528153 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:06.234306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25ede-f9bd-4663-b11a-904f86528153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:06.265178 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3dd25ede-f9bd-4663-b11a-904f86528153 None None] MFA Rules not processed for user `646dc1cd8f61429bb2e228852b02826a`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:06.266377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3dd25ede-f9bd-4663-b11a-904f86528153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:06.307760 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:06.351372 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4481/8969] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:06.369130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:06.371855 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:06.457924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec987d-db90-4480-9b42-762a0f610dcc admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:06.463775 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:06.464387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:06.464664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:06.464967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:06.491306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:06.524032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:06.525660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c7a9-b2c5-47ee-9ecf-0c667bcdb046 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:06.534926 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4489/8970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:06.614278 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:06.614755 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:06.615102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:06.635003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] MFA Rules not processed for user `c7c3887f21264885b5e50be86d97e5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:06.636272 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:06.643179 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4482/8971] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:16.530625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=16 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:16.629988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=15 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:19.363015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce597f-02a6-49bb-b5f7-bfa5056bc6f7 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:19.363418 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce597f-02a6-49bb-b5f7-bfa5056bc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:19.363562 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce597f-02a6-49bb-b5f7-bfa5056bc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:19.412185 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-75ce597f-02a6-49bb-b5f7-bfa5056bc6f7 None None] MFA Rules not processed for user `95ff200fd16445debdaa322bf2123ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:19.413336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-75ce597f-02a6-49bb-b5f7-bfa5056bc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:19.473106 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4490/8972] 10.222.0.16 () {58 vars in 1054 bytes} [Fri Oct 28 10:58:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:19.480083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:19.489616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64e07-4e75-4c6d-b995-52b76a6b5e63 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:19.493737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:19.494336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:19.494607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:19.494868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:19.503908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:19.505363 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:19.514697 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4483/8973] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:29.470176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=38 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:29.510445 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:37.544131 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:37.544612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:37.544722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:37.572958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] MFA Rules not processed for user `95ff200fd16445debdaa322bf2123ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:37.574246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:37.583947 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4491/8974] 10.222.0.16 () {58 vars in 1054 bytes} [Fri Oct 28 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:37.590441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:37.602019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5458-8c4e-4d1e-b5ff-99f02ef226fb service cinder] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:37.606324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95ff200fd16445debdaa322bf2123ab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:37.606918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:37.607213 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:37.607462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:37.609226 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:37.642643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:37.644084 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885778c6-1f64-4f64-a3d2-04e5be44ef12 service cinder] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:37.655236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4484/8975] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:58:42.415378 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:42.417523 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:42.472858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9f11-7e22-4cbf-9b6d-b35396838d02 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:42.476560 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:42.477181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:42.477462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:42.477730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:42.479924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:42.492792 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:42.494247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:42.505554 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4492/8976] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:44.897803 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:44.898328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:44.898328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:44.917814 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] MFA Rules not processed for user `c7c3887f21264885b5e50be86d97e5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:58:44.919001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:44.925825 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4485/8977] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:58:47.203696 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:47.212759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9cb56-7dd2-41a4-94bf-c66ab741bf67 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:47.218492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:47.219448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:47.219735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:47.220233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:47.221977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:47.233830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:47.235278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b50c-1b3e-40d6-ad0b-603ad87fe649 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:47.244531 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4493/8978] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:48.192826 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:58:48.194480 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:48.213261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546ea6-4655-4436-bd7f-143431d01757 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:58:48.219107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:58:48.219719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:58:48.220001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:58:48.220276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:58:48.222102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:58:48.234918 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:58:48.236512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:58:48.248414 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4486/8979] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:58:57.240413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=41 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:58.243075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=26 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:22.709109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:22.709699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:22.709699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:22.728602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] MFA Rules not processed for user `c7c3887f21264885b5e50be86d97e5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:59:22.729834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:22.736677 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4494/8980] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:59:32.723073 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:05.616784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:05.678003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc8a9-18d7-4307-9a71-049b2d44c6bb service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:05.682506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:05.683122 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:05.683398 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:05.683667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] PATH_INFO: `/v3/users/c7c3887f21264885b5e50be86d97e5cb` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:05.685403 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c3887f21264885b5e50be86d97e5cb)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:05.687291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:05.732380 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c3887f21264885b5e50be86d97e5cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:05.733053 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c3887f21264885b5e50be86d97e5cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:05.733665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c3887f21264885b5e50be86d97e5cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:05.741613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c3887f21264885b5e50be86d97e5cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:05.749311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c3887f21264885b5e50be86d97e5cb'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:05.766236 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4487/8981] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:00:05 2022] DELETE /identity/v3/users/c7c3887f21264885b5e50be86d97e5cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:05.936410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:05.950381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aaccd-3890-44fb-b6d7-312ae32eef36 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.007199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.007828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.008108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.008382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] PATH_INFO: `/v3/projects/7d38e856f240411a9e040be046e4bbae` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.009507 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d38e856f240411a9e040be046e4bbae)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.011433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.057552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d38e856f240411a9e040be046e4bbae', 'request_id': 'req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.063002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d38e856f240411a9e040be046e4bbae', 'request_id': 'req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.070002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d38e856f240411a9e040be046e4bbae', 'request_id': 'req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.080928 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] The token cache is being invalidate because project 7d38e856f240411a9e040be046e4bbae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:00:06.081218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.081839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.083315 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4495/8982] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:00:05 2022] DELETE /identity/v3/projects/7d38e856f240411a9e040be046e4bbae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:06.087406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.088811 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:06.102396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756529-5bf8-419a-b6ba-a7a5d41989f6 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.159270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.159903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.160181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.160453 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] PATH_INFO: `/v3/users/646dc1cd8f61429bb2e228852b02826a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.161571 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646dc1cd8f61429bb2e228852b02826a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.163493 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.185301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:06.209016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646dc1cd8f61429bb2e228852b02826a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.209663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646dc1cd8f61429bb2e228852b02826a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.210261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646dc1cd8f61429bb2e228852b02826a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.217974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646dc1cd8f61429bb2e228852b02826a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.225406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-6f5975a0-9744-4679-8587-d2c4b024ddc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646dc1cd8f61429bb2e228852b02826a'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.244674 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4488/8983] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:00:06 2022] DELETE /identity/v3/users/646dc1cd8f61429bb2e228852b02826a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:06.430819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.433629 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:06.452936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57dbd0-2d8f-4068-bc5c-bbf326e8a301 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.511336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.512535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.512813 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.513121 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] PATH_INFO: `/v3/projects/712dd249e67a4bcf8c64e60ee0524408` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.514224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712dd249e67a4bcf8c64e60ee0524408)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.516159 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.551218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:06.564798 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712dd249e67a4bcf8c64e60ee0524408', 'request_id': 'req-b4fe602a-4793-423b-a7f5-038726f23e35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.570288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712dd249e67a4bcf8c64e60ee0524408', 'request_id': 'req-b4fe602a-4793-423b-a7f5-038726f23e35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.577981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712dd249e67a4bcf8c64e60ee0524408', 'request_id': 'req-b4fe602a-4793-423b-a7f5-038726f23e35'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.589055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] The token cache is being invalidate because project 712dd249e67a4bcf8c64e60ee0524408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:00:06.589340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.590088 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b4fe602a-4793-423b-a7f5-038726f23e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:00:06.592085 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4496/8984] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:00:06 2022] DELETE /identity/v3/projects/712dd249e67a4bcf8c64e60ee0524408 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:06.597120 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.597410 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.597683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.626538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:06.627718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:06.687453 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4489/8985] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:06.695342 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db242-fc61-46b0-a043-956567042420 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.695653 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db242-fc61-46b0-a043-956567042420 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.695920 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db242-fc61-46b0-a043-956567042420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.717385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bf3db242-fc61-46b0-a043-956567042420 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:06.718622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bf3db242-fc61-46b0-a043-956567042420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:06.726620 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4497/8986] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:06.731465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.741221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf282547-4455-4488-b9d4-fd440286f1e6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.745744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.746370 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.746613 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.746888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.747519 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 11:00:06.747820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.749440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.760685 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4490/8987] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 11:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 11:00:06.764953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db242-fc61-46b0-a043-956567042420 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.774186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db242-fc61-46b0-a043-956567042420 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.779376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.779968 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.780247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.780519 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.781177 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.783072 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.810694 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4498/8988] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:00:06 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:00:06.814816 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.825055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830e6a-f259-404d-af2a-92d4c51ad4e2 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.880428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.881018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.881306 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.881578 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.882206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.884101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.905127 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4491/8989] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:00:06 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 11:00:06.909067 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.919940 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd40e8e-3ac6-4943-b69f-7531bccc282a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.924558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.925179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.925459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.925730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.926364 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.927965 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.937706 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4499/8990] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:00:06.941449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.952408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a965-410d-42a0-b56f-bc408b30fbaf admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.957522 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.958126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.958531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.958813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:06.959455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:06.961089 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7b2a3-e5c9-47b7-b163-06f41234d554 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:06.962490 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:06.974222 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4492/8991] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:00:06.978917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:06.989716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c169b-754c-4aee-bf0d-c740ff648a57 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:06.994541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:06.995374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:06.995576 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:06.995850 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] PATH_INFO: `/v3/projects/3717bdde41e0401e925316053c8b4b3a/users/44d187857c82461dba93a33f32981127/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:07.010453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3717bdde41e0401e925316053c8b4b3a, user_id=44d187857c82461dba93a33f32981127, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:07.013113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:07.026785 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4500/8992] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:00:06 2022] PUT /identity/v3/projects/3717bdde41e0401e925316053c8b4b3a/users/44d187857c82461dba93a33f32981127/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:07.032632 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89529c8-3d39-4fc5-bf2b-c7b260ba00fc None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:07.032938 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89529c8-3d39-4fc5-bf2b-c7b260ba00fc None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:07.033228 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89529c8-3d39-4fc5-bf2b-c7b260ba00fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:07.055001 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e89529c8-3d39-4fc5-bf2b-c7b260ba00fc None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:07.056202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e89529c8-3d39-4fc5-bf2b-c7b260ba00fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:07.116359 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4493/8993] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:00:07.126495 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:07.128175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:07.202020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7986a-a739-4ce4-91ad-6d35a7b0ce9c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:07.205721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:07.206333 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:07.206600 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:07.206864 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:07.216307 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:07.217765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:07.227059 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4501/8994] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:00:11.176537 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.177054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.177180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.211255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] MFA Rules not processed for user `44d187857c82461dba93a33f32981127`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:11.212489 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:11.292015 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4494/8995] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:11.297348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.307585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81563-dc42-4477-b2e9-f82778fe08b5 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.312348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.313055 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.313423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.313821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.314514 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.316602 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.349871 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4502/8996] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:00:11.351009 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.362958 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a786-2a4f-4875-ae13-1eb1a1751e41 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.443073 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.443697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.443974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.444242 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.444882 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.446929 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.471699 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4495/8997] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:00:11 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 11:00:11.473565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.484859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d56e4-3dc4-4e06-8483-63e22acce0d0 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.489786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.490397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.490672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.490938 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.491568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.493197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.504068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4503/8998] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:00:11.508389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.522218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a89e7-5de0-4b59-a7fe-8f737b058c03 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.527255 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.528574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.528953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.529321 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] PATH_INFO: `/v3/projects/92c07b4616ce40358ae9001e65e472fd/users/fc8e9b80bef1479a9ffcdb1a330f10a5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.542820 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:11.547006 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c07b4616ce40358ae9001e65e472fd, user_id=fc8e9b80bef1479a9ffcdb1a330f10a5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.549823 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.564427 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4496/8999] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:00:11 2022] PUT /identity/v3/projects/92c07b4616ce40358ae9001e65e472fd/users/fc8e9b80bef1479a9ffcdb1a330f10a5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:11.568370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.579655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858ce1-0aef-42e5-a2a8-114febc5bb8c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.591280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:11.645343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.645966 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.646262 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.646521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.647163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.648786 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f149f2-f212-4541-9b73-25b419db6180 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.660144 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4504/9000] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 11:00:11.664314 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:11.675252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3655561-3fdc-4945-bb52-2aab01227f72 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:11.680782 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:11.681481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:11.681759 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:11.682021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] PATH_INFO: `/v3/projects/92c07b4616ce40358ae9001e65e472fd/users/fc8e9b80bef1479a9ffcdb1a330f10a5/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:11.684043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c07b4616ce40358ae9001e65e472fd, user_id=fc8e9b80bef1479a9ffcdb1a330f10a5, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:11.686788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:11.698174 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4497/9001] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:00:11 2022] PUT /identity/v3/projects/92c07b4616ce40358ae9001e65e472fd/users/fc8e9b80bef1479a9ffcdb1a330f10a5/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:00:16.102879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764af9-7d86-44b7-b78c-7b12fce9b94e None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:16.103421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764af9-7d86-44b7-b78c-7b12fce9b94e None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:16.103421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764af9-7d86-44b7-b78c-7b12fce9b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:16.130825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-63764af9-7d86-44b7-b78c-7b12fce9b94e None None] MFA Rules not processed for user `fc8e9b80bef1479a9ffcdb1a330f10a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:16.132031 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63764af9-7d86-44b7-b78c-7b12fce9b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:16.204270 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4505/9002] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:16.228683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:16.230496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:16.310916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfedba-5cf0-4618-8e1c-3ba6824f1f25 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:16.314596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64001504-1276-4408-b693-0f056f5880fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:16.315202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001504-1276-4408-b693-0f056f5880fb service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:16.315477 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001504-1276-4408-b693-0f056f5880fb service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:16.315744 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001504-1276-4408-b693-0f056f5880fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:16.378257 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64001504-1276-4408-b693-0f056f5880fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:16.379734 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64001504-1276-4408-b693-0f056f5880fb service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:16.393155 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4498/9003] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:00:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:00:16.567848 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1389ad5-b198-4bbe-b340-11f6fb71ca79 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:16.568387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1389ad5-b198-4bbe-b340-11f6fb71ca79 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:16.568837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1389ad5-b198-4bbe-b340-11f6fb71ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:16.637912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e1389ad5-b198-4bbe-b340-11f6fb71ca79 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:16.639211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e1389ad5-b198-4bbe-b340-11f6fb71ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:16.730591 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4506/9004] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:00:16.793867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64001504-1276-4408-b693-0f056f5880fb service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:16.795361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-64001504-1276-4408-b693-0f056f5880fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:16.885510 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:16.901949 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64001504-1276-4408-b693-0f056f5880fb service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:16.907260 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:16.907888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:16.908172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:16.908469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:16.917700 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:16.919840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2108-526b-4dae-a856-f73e8c5cd24a service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:16.929023 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4499/9005] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:00:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:00:25.866736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:25.867235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:25.867336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:25.875554 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=100 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:25.889160 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] MFA Rules not processed for user `44d187857c82461dba93a33f32981127`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:25.890374 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:25.897218 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4507/9006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:00:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:26.925417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:27.752049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:27.752533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:27.752880 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:27.773601 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:00:27.774822 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:00:27.782280 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4500/9007] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:00:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:00:27.794113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:00:27.806016 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855d9e-7fa4-480a-bd1a-732dc6dec41b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:00:27.811522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:00:27.812125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:00:27.812406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:00:27.812674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:00:27.821019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:00:27.822889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:00:27.831719 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4508/9008] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:00:37.768224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:37.828197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:02.376619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:02.378118 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:02.434800 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d42cde-84c7-4af4-b817-c10e9a42b854 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:02.438389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:02.438994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:02.439274 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:02.439545 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:02.448549 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:02.450018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:02.459386 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4501/9009] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:12.455176 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=26 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:30.265402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:30.266791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:30.346936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe640-6e8d-463b-a882-7f8fc83417c9 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:30.352017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:30.352615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:30.352896 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:30.353199 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:30.355485 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:30.366645 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:30.368210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:30.378697 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4509/9010] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:40.374439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=37 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:02:08.032729 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:02:08.034208 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:02:08.048559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5638ae-3bfa-47bb-88c9-75bef7a44d43 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:02:08.054630 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:02:08.055330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:02:08.055703 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:02:08.056029 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:02:08.058144 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:02:08.069881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:02:08.071452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:02:08.082077 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4502/9011] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:02:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:02:18.078016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:15.977599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:04:15.987316 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee783-b032-4d9e-94c7-aa3c4a3809f8 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:04:15.990814 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:04:15.991443 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:04:15.991719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:04:15.991987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:04:15.993703 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:04:16.003406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:04:16.004821 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:04:16.012526 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4510/9012] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:04:26.009163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:50.445797 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:04:50.455916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6fb08-169d-4b0b-ac0f-3c033da22999 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:04:50.459492 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:04:50.460083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:04:50.460360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:04:50.460628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:04:50.462378 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:04:50.550125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:04:50.551558 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:04:50.562924 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4503/9013] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:04:50.985445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:04:50.987017 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:04:51.010865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de6dbc-d6d5-430a-af86-cdf5872609ae service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:04:51.019880 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:04:51.020971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:04:51.021499 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:04:51.021998 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:04:51.024144 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:04:51.044879 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:04:51.046769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:04:51.065264 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4511/9014] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:00.557622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=42 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:01.055134 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:02.542566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:02.551182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c6ec1-e8ee-4dc9-9716-8d9b9acf83eb service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:02.554798 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:02.555394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:02.555674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:02.555945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:02.557682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:02.570686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:02.572104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff6cd8-a163-4771-8ada-d06e031bbe6b service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:02.583599 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4504/9015] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:03.864985 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:03.876241 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651f4-8f2e-486c-aa40-2b4489805334 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:03.881874 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:03.882474 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:03.882753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:03.883329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:03.885103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:03.897502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:03.899079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:03.910284 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4512/9016] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:04.919494 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abde8b-f786-4aed-935f-a54828d8e1a5 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:04.919966 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abde8b-f786-4aed-935f-a54828d8e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:04.920069 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abde8b-f786-4aed-935f-a54828d8e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:04.939718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-f6abde8b-f786-4aed-935f-a54828d8e1a5 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:05:04.940928 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6abde8b-f786-4aed-935f-a54828d8e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:04.948083 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4505/9017] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:05:04.988486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:05.000464 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df895d9-cee4-4eeb-bae7-c884d602fd24 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:05.005481 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:05.006079 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:05.006357 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:05.006626 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:05.014567 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:05.016148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:05.024095 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4513/9018] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:05:05.497577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305c71-7c00-49db-9d2b-7ee600cab7ad None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:05.497860 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305c71-7c00-49db-9d2b-7ee600cab7ad None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:05.498129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305c71-7c00-49db-9d2b-7ee600cab7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:05.517612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-aa305c71-7c00-49db-9d2b-7ee600cab7ad None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:05:05.518783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-aa305c71-7c00-49db-9d2b-7ee600cab7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:05.525779 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4506/9019] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:05:05.538624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:05.549024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431e2b-3e98-4364-894a-0cb2ec259898 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:05.555008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:05.555603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:05.555883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:05.556153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:05.564053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:05.565667 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:05.573873 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4514/9020] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:05:14.053776 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:14.054301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:14.054301 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:14.073149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] MFA Rules not processed for user `44d187857c82461dba93a33f32981127`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:05:14.074352 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:14.081487 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4507/9021] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:05:14.341371 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:14.350524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34740f-8fac-41d9-b84c-6bc626c12e26 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:14.354085 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:14.354673 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:14.354952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:14.355219 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:14.357583 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:14.366700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:14.368184 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:14.376154 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4515/9022] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:14.713761 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:14.727202 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b7e8-1544-409f-a448-ed4a1a6b3999 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:14.732359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:14.733121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:14.733498 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:14.733867 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:14.735672 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:14.747588 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:14.749113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060e58-b083-4aef-872f-e4247d528d1c service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:14.759298 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4508/9023] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:16.792635 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:16.801676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55e588-472c-493b-9885-983fd974acd7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:16.805387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:16.806033 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:16.806303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:16.806570 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:16.815189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:16.816678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:16.827055 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4516/9024] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:05:17.052464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:17.053038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:17.053038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:17.073377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:05:17.074739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:17.082319 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4509/9025] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:05:17.095760 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:17.107840 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66438-1a28-43d2-91e6-ef7ecb463da1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:17.112921 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:17.113530 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:17.113808 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:17.114080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:17.123426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:17.125058 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:17.133888 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4517/9026] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:05:24.778270 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:24.787631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42fa82-d48f-4286-b52d-97e802455662 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:24.791224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:24.791821 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:24.792096 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:24.792367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:24.794115 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:24.803288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:24.804699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:24.812978 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4510/9027] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:27.130002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=36 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:30.241612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:05:30.254433 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675408-b22b-4839-b027-6f2030df7300 service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:05:30.261063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:05:30.261063 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:05:30.261363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:05:30.261486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:05:30.263229 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:05:30.276203 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:05:30.277870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb0c43-fe38-4ff5-8bfb-d051ef52e87d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:05:30.290860 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4518/9028] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:05:34.809521 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=30 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:40.285881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:37.238788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:06:37.260358 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91529-4b08-4f4b-80e7-faf4f5a15f56 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:06:37.266047 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:06:37.266641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:06:37.266971 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:06:37.267199 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:06:37.275543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:06:37.277138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:06:37.286780 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4511/9029] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:06:47.282731 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:03.374390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:03.374866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:03.374974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:03.403156 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:03.404343 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:03.411530 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4519/9030] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:03.452541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:03.463793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ad2d9-0ef5-4150-96d0-478a1a02b706 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:03.469354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:03.469974 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:03.470261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:03.470533 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:03.478693 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:03.480244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:03.488782 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4512/9031] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:07:03.843065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:03.861622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d0de3-522c-4321-a01b-17e04a405ce6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:03.865233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:03.865824 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:03.866103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:03.866373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:03.934484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:03.935926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:03.955262 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4520/9032] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:07.072438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:07.084083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0ba5a-ee8c-4d6a-879d-ff11b622af2b service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:07.089708 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:07.090579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:07.091075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:07.091345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:07.093211 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:07.105072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:07.108932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:07.124575 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4513/9033] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:10.239289 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:10.251200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87046-0bca-415f-bfa6-64a30190bf24 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:10.256390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:10.257032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:10.257311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:10.257599 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:10.259330 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:10.271313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:10.272882 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:10.283963 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4521/9034] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:10.306481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:10.318112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e9f68-2029-4e2b-8e23-2fecc00961e3 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:10.323656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:10.324286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:10.324749 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:10.325218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] PATH_INFO: `/v3/users/44d187857c82461dba93a33f32981127` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:10.326207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d187857c82461dba93a33f32981127)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:10.328745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:10.372745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d187857c82461dba93a33f32981127'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.373953 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d187857c82461dba93a33f32981127'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.374560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d187857c82461dba93a33f32981127'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.381495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d187857c82461dba93a33f32981127'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.388462 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d187857c82461dba93a33f32981127'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.406388 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4514/9035] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:07:10 2022] DELETE /identity/v3/users/44d187857c82461dba93a33f32981127 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:10.587410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:10.605930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf842e-1184-424e-a924-9a4beb203e26 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:10.666155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:10.666785 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:10.667057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:10.667321 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] PATH_INFO: `/v3/projects/3717bdde41e0401e925316053c8b4b3a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:10.668434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3717bdde41e0401e925316053c8b4b3a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:10.670923 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:10.713689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:10.721586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3717bdde41e0401e925316053c8b4b3a', 'request_id': 'req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.727323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3717bdde41e0401e925316053c8b4b3a', 'request_id': 'req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.735323 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3717bdde41e0401e925316053c8b4b3a', 'request_id': 'req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.759155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] The token cache is being invalidate because project 3717bdde41e0401e925316053c8b4b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:07:10.759440 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.760056 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.761581 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4522/9036] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:07:10 2022] DELETE /identity/v3/projects/3717bdde41e0401e925316053c8b4b3a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:10.765570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:10.766979 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:10.780048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b911b-d42c-44c1-85de-6fe08f1cc31a admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:10.835874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:10.836501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:10.836778 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:10.837082 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] PATH_INFO: `/v3/users/fc8e9b80bef1479a9ffcdb1a330f10a5` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:10.838207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8e9b80bef1479a9ffcdb1a330f10a5)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:10.840124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:10.884624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8e9b80bef1479a9ffcdb1a330f10a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.885284 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8e9b80bef1479a9ffcdb1a330f10a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.885885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8e9b80bef1479a9ffcdb1a330f10a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.887572 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:10.894083 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8e9b80bef1479a9ffcdb1a330f10a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.902682 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-cfa4fd8f-5d55-4b8c-a8ef-1beca7edfba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8e9b80bef1479a9ffcdb1a330f10a5'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:10.920654 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4515/9037] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:07:10 2022] DELETE /identity/v3/users/fc8e9b80bef1479a9ffcdb1a330f10a5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:11.090702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.092767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:11.109311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a37d-77e0-48b2-8b87-ea73ba8eb198 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.167784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.168422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.168701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.169011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] PATH_INFO: `/v3/projects/92c07b4616ce40358ae9001e65e472fd` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.170739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c07b4616ce40358ae9001e65e472fd)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.172660 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.220368 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c07b4616ce40358ae9001e65e472fd', 'request_id': 'req-55bf7e7c-95e3-45b2-b108-693e2e9a135c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:11.225878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c07b4616ce40358ae9001e65e472fd', 'request_id': 'req-55bf7e7c-95e3-45b2-b108-693e2e9a135c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:11.233563 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c07b4616ce40358ae9001e65e472fd', 'request_id': 'req-55bf7e7c-95e3-45b2-b108-693e2e9a135c'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:11.244700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] The token cache is being invalidate because project 92c07b4616ce40358ae9001e65e472fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:07:11.245352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:11.245636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-55bf7e7c-95e3-45b2-b108-693e2e9a135c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:07:11.247132 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4523/9038] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:07:11 2022] DELETE /identity/v3/projects/92c07b4616ce40358ae9001e65e472fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:11.252308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.252598 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.252870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.300670 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:11.301909 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:11.361164 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4516/9039] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:11.369119 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.369405 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.369678 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.389650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:11.390843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:11.398711 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4524/9040] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:11.402777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.413139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702ab7-070e-46fe-8374-a181d4a2bd99 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.417765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.418357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.418633 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.418902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.419535 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 11:07:11.419834 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.421465 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.433171 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4517/9041] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 11:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 11:07:11.437469 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.446559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50580fd-989c-4e0f-9831-d2fbec0c427b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.451953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.452700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.453023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.453314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.453945 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.455866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.492162 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4525/9042] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:07:11.496106 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.506065 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32997-edff-4fcf-a759-c3cb98c48bce admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.561506 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.562107 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.562386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.562658 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.563302 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.565227 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.589403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4518/9043] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 11:07:11.590434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.601410 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b51a-03c7-4ff8-8e2e-c47e5503e63a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.606020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.606612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.606892 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.607163 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.607830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.609463 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.614640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:11.620071 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4526/9044] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:07:11.623915 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.633922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e40d34-d742-49b2-9ddc-0f757ae351c1 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.638587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.639711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.639988 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.640258 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.640887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.642488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d203c5a-f169-4987-a65b-dd35b2767b12 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.652859 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4519/9045] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:07:11.657517 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.667693 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38422ea-8da9-48c7-95bb-dedce3a303ea admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.672337 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.673015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.673299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.673571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] PATH_INFO: `/v3/projects/19a924fff2a74cd489ec2f9b0f43db97/users/65c0789aabf74875985235644d9191a7/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.690143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a924fff2a74cd489ec2f9b0f43db97, user_id=65c0789aabf74875985235644d9191a7, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.692885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.706214 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4527/9046] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:07:11 2022] PUT /identity/v3/projects/19a924fff2a74cd489ec2f9b0f43db97/users/65c0789aabf74875985235644d9191a7/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:11.716119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b097-2905-4d6e-9efd-35403611468c None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.716408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b097-2905-4d6e-9efd-35403611468c None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.716677 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b097-2905-4d6e-9efd-35403611468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.736766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:11.745062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-e285b097-2905-4d6e-9efd-35403611468c None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:11.746685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e285b097-2905-4d6e-9efd-35403611468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:11.812218 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4520/9047] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:11.816700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.878125 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935be29-ff86-47ea-9529-34e26f758b4b admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.882987 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.883584 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.883861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.884130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.884743 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.886691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:11.912819 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4528/9048] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:07:11.916815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b097-2905-4d6e-9efd-35403611468c None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:11.927475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b097-2905-4d6e-9efd-35403611468c None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:11.982499 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:11.983095 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:11.983374 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:11.983645 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:11.984256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:11.986184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.007134 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4521/9049] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:07:11 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:07:12.011097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:12.021881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624d829-743f-4307-8042-f84093b81cf8 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:12.026447 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:12.027041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.027317 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.027587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.028233 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:12.029838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.040324 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4529/9050] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:07:12.044505 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:12.054984 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e0c3e-9bbf-4ee1-9cdd-3398b6e01356 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:12.059610 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:12.060251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.060530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.061438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] PATH_INFO: `/v3/projects/b43759c2520047b981acf76cb715c496/users/01b0fbe8085b45bea1796d9d29922d94/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.076171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43759c2520047b981acf76cb715c496, user_id=01b0fbe8085b45bea1796d9d29922d94, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:12.079105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.091424 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4522/9051] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:07:12 2022] PUT /identity/v3/projects/b43759c2520047b981acf76cb715c496/users/01b0fbe8085b45bea1796d9d29922d94/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:12.095263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:12.105284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e8d66-fd64-447e-b3b6-4d5d12604ce3 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:12.162222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:12.162828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.163107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.163379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.164008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:12.165639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520dd00-0af1-4bcd-819c-2ff92d253647 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.175730 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4530/9052] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:07:12.179854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:12.190788 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f816e18-4e3e-41bb-acb6-01d982448ba4 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:12.195413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:12.196052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.196330 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.196603 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] PATH_INFO: `/v3/projects/b43759c2520047b981acf76cb715c496/users/01b0fbe8085b45bea1796d9d29922d94/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.198576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43759c2520047b981acf76cb715c496, user_id=01b0fbe8085b45bea1796d9d29922d94, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:12.201221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.211455 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4523/9053] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:07:12 2022] PUT /identity/v3/projects/b43759c2520047b981acf76cb715c496/users/01b0fbe8085b45bea1796d9d29922d94/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:07:12.222500 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.222782 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.223053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.251186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] MFA Rules not processed for user `01b0fbe8085b45bea1796d9d29922d94`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:12.252395 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:12.284999 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:12.319931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4531/9054] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:12.334444 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:12.336167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:12.387858 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:12.418852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281cdee-c28b-4b16-a5f9-74ec4437f5ef admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:12.425000 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:12.425604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:12.425884 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:12.426155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:12.481585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:12.483763 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:12.493032 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4524/9055] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:13.965781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:13.967719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:14.038226 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee0f9a-6de7-45e3-b2dc-395cc4052316 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:14.043853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:14.044471 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:14.044805 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:14.045687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:14.047477 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:14.059509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:14.062277 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7e71-bd8d-485d-88c7-db82b1feec14 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:14.075201 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4532/9056] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:15.158217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:15.159856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:15.229881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337ec-5a32-4b2e-8abd-92e5f176948c service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:15.234105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:15.234710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:15.234987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:15.235256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:15.244500 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:15.245973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:15.256312 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4525/9057] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:18.161146 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e3c2-7d40-424a-a894-ba50f2b09ea0 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:18.163227 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e3c2-7d40-424a-a894-ba50f2b09ea0 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:18.163869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e3c2-7d40-424a-a894-ba50f2b09ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:18.200581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-7ae2e3c2-7d40-424a-a894-ba50f2b09ea0 None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:07:18.202324 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7ae2e3c2-7d40-424a-a894-ba50f2b09ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:18.210237 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4533/9058] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:07:19.032334 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:19.044692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d717-44cc-4b0c-ac0d-fd092a0bf28f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:19.052147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:19.052999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:19.053607 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:19.054138 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:19.056195 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:19.071848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:19.073745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:19.086990 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4526/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:28.181467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=48 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:29.081136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=74 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:51.796711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:08:51.797256 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:08:51.797366 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:08:51.835025 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:08:51.836312 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:08:51.875056 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4534/9060] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:09:01.872595 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=15 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:25.966209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:09:25.978621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556cc1f-6ed4-43b9-b977-bb06448e8b2d service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:09:25.982256 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:09:25.982848 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:09:25.983129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:09:25.983400 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:09:25.985116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:09:25.995068 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:09:25.996471 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:09:26.004836 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4527/9061] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:09:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:09:36.000786 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=8 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:09.028100 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:10:09.029613 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:10:09.061518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c08c96-ace5-49e6-be94-3b81fb68e5b3 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:10:09.065148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:10:09.065757 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:10:09.066041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:10:09.066336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:10:09.068127 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:10:09.095943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:10:09.097781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:10:09.111338 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4535/9062] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:10:10.298652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:10:10.313711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de01e8-23ac-4941-b0c7-df1a7a5f55c0 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:10:10.317265 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:10:10.317852 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:10:10.318126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:10:10.318389 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:10:10.320580 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:10:10.333702 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:10:10.335828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39161c73-c8e8-4a50-b095-531ccfd64724 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:10:10.346299 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4528/9063] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:10:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:10:19.105795 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=16 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:20.341685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:10.513687 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:11:10.527329 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ced7-d983-4932-acf1-2469db3e2ce8 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:11:10.534024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:11:10.534632 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:10.534912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:10.535192 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:10.537040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:10.551180 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:11:10.553077 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:11:10.564764 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4536/9064] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:11:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:11:20.559402 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:22.906501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:22.906997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:22.907102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:22.929774 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:11:22.931075 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:22.938307 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4529/9065] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:11:23.323728 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:11:23.335246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347043e7-d2e8-40e9-9eb2-9ab9367e1e28 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:11:23.339658 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:11:23.340618 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:23.341301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:23.341989 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:23.344362 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:23.357768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:11:23.359445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:11:23.386638 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4537/9066] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:11:32.924660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:33.042619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:11:33.045194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:33.065087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe738c2-b296-4836-aaa9-ff15b5599779 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:11:33.071998 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:11:33.072815 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:33.073113 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:33.073261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:33.074921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:33.088280 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:11:33.090620 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:11:33.103442 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4530/9067] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:11:33.364679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:37.230571 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:11:37.245582 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fa21-8fb2-4e55-b586-fa2de59741a7 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:11:37.251306 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:11:37.251916 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:37.252188 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:37.252465 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:37.254179 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:37.268052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:11:37.269830 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:11:37.281795 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4538/9068] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:11:42.237621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:11:42.248696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90facee-75be-4b14-9925-0e7393d90a0f service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:11:42.253707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:11:42.254401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:11:42.254688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:11:42.254961 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:11:42.256671 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:11:42.281200 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:11:42.282771 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:11:42.293151 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4531/9069] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:11:47.277622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:52.288412 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=17 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:19.041839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:19.043260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:19.056851 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a5f65-5e07-488f-9330-0ed51324a59d service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:19.062375 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:19.062963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:19.063239 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:19.063522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:19.071769 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:19.074010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22e803-d4cb-4c94-adf5-856a625ccb6f service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:19.083884 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4539/9070] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:29.079575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:38.964161 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:38.977266 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba4e01-a1a9-4c8f-8865-054f36b60d7e service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:38.982747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:38.983345 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:38.983624 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:38.983894 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:38.991481 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:38.993117 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:39.002448 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4532/9071] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:39.181852 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89651b4-3ff4-47eb-9b44-de796cf70d61 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.182484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89651b4-3ff4-47eb-9b44-de796cf70d61 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.182484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89651b4-3ff4-47eb-9b44-de796cf70d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.233049 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f89651b4-3ff4-47eb-9b44-de796cf70d61 None None] MFA Rules not processed for user `051db56282044b44934f4db7ce8cd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:12:39.234187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f89651b4-3ff4-47eb-9b44-de796cf70d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:39.241665 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4540/9072] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:12:39.255914 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:39.265724 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6120d-ef7e-4f07-b822-ea98100aedf5 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:39.269394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:39.269990 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.270261 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.270544 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.278442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:39.279854 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:39.288345 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4533/9073] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:39.366888 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0ca8-940d-462b-9cb0-e508d7e46d26 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.367175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0ca8-940d-462b-9cb0-e508d7e46d26 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.367472 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0ca8-940d-462b-9cb0-e508d7e46d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.405756 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ebae0ca8-940d-462b-9cb0-e508d7e46d26 None None] MFA Rules not processed for user `f8d91f2fd8b44f6790078a7c19984b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:12:39.407524 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ebae0ca8-940d-462b-9cb0-e508d7e46d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:39.416148 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4541/9074] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:12:39.427791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:39.439642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976299f-8c7e-494b-973e-4ec2849d9a7a service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:39.444531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:39.445146 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.445421 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.445685 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.454542 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:39.456332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:39.465921 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4534/9075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:39.637027 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.637315 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.637587 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.677267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:12:39.678846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:39.689088 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4542/9076] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:12:39.699917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:39.709881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfd357-2626-4193-af9d-d37db3736f3a service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:39.713419 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:39.714010 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.714289 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.714560 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.725062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:39.726590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:39.737112 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4535/9077] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:39.797741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:39.809592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291513-404d-45d7-bc3a-678ae5480c8a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:39.815152 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:39.815744 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:39.816022 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:39.816292 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:39.818019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:39.829839 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:39.831671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:39.841352 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4543/9078] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:12:49.732515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=24 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:49.837360 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=37 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:53.383367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:12:53.392140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c901-ddb8-4eb5-9ce2-d2b012d974e7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:12:53.395732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:12:53.396787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:12:53.396787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:12:53.397048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:12:53.398926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:12:53.408714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:12:53.410170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:12:53.418030 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4536/9079] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:13:03.414497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:34.822734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:13:34.833526 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dac6-39a9-4488-ad54-3f2a9b0ead49 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:13:34.838510 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:13:34.839097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:13:34.839377 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:13:34.839642 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:13:34.841339 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:13:34.852521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:13:34.854110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9b7ea-a641-4f79-82b3-9026c495ab29 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:13:34.864325 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4544/9080] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:13:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:13:39.978373 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:13:39.986933 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361708-76f7-410e-a629-514c52e51cc0 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:13:39.990640 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:13:39.991308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:13:39.991642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:13:39.991975 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:13:40.002016 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:13:40.003697 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:13:40.013345 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4537/9081] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:13:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:13:42.839708 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:13:42.840967 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:13:42.841480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:13:42.865054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:13:42.866527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:13:42.889678 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4545/9082] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:13:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:13:43.276282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:13:43.286391 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1dab6-c964-4d4a-b950-11aa8795d8a7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:13:43.290886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:13:43.291936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:13:43.292317 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:13:43.292690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:13:43.294676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:13:43.306779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:13:43.308479 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:13:43.318553 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4538/9083] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:13:44.685221 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:13:44.699186 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f578cd-3442-48ae-afc4-3ad043ea4907 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:13:44.708695 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:13:44.709352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:13:44.709630 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:13:44.709898 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:13:44.721224 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:13:44.723345 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:13:44.745268 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4546/9084] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:13:53.314543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:54.740283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=15 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:32.000930 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:14:32.009354 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e76910-e4ad-4743-9a72-685b0ff70b42 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:14:32.013007 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:14:32.013631 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:14:32.013911 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:14:32.014182 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:14:32.021683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:14:32.023093 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:14:32.030874 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4539/9085] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:14:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:14:42.027338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:15:09.115633 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:15:09.125075 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ef011-7d84-4eea-8056-9e20bfc03678 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:15:09.129352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:15:09.129958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:15:09.130238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:15:09.130505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:15:09.150575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:15:09.152015 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd5f50-69ac-427a-a4d0-ae934041705b service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:15:09.163544 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4547/9086] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:15:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:15:10.594110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:15:10.603132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e5b6-b29c-4d54-939b-fd0e55af2c3f service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:15:10.608041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:15:10.608643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:15:10.608943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:15:10.609246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:15:10.620181 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:15:10.621565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:15:10.634627 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4540/9087] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:15:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:15:19.158107 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=9 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:15:20.628667 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:15.688561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:16:15.689176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:16:15.689176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:16:15.709860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] MFA Rules not processed for user `65c0789aabf74875985235644d9191a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:16:15.711108 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:16:15.720209 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4548/9088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:16:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:16:25.704026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:47.256110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:16:47.277230 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f21-f4d8-4067-8021-6421a4d04513 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:16:47.282405 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:16:47.282993 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:16:47.283271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:16:47.283540 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:16:47.292623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:16:47.294209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:16:47.304080 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4541/9089] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:16:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:16:57.299754 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:25.057247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:25.124267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbee5d7-0c29-4347-9e12-b5a43a6fd6ae None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:25.129278 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:25.129878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:25.130155 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:25.130423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:25.132260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:25.144210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:25.145870 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:25.155663 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4549/9090] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:35.151466 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=32 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:39.210339 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:39.212577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:39.289621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546a325-7d6b-4c3c-a2cf-31ef72e334d7 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:39.293311 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:39.293908 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:39.294185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:39.294455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:39.296254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:39.374716 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:39.376134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:39.395434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4542/9091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:40.538003 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:40.539674 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:40.648502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fa432-41bd-4d19-9ab8-dcb4b7ce419d service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:40.656652 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:40.657383 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:40.657699 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:40.658130 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:40.670532 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:40.672070 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:40.684277 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4550/9092] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:46.891268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:46.892845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:46.908023 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b69d8-8ef3-4170-8f00-0d9a3dbc221e service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:46.912997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:46.913595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:46.913939 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:46.914205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:46.916552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:46.928057 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:46.929656 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ab46-432c-4b29-8cd6-34eeba5a006e service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:46.940146 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4543/9093] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:47.197288 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:47.198347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:47.301917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326bf73-91a0-484f-93db-fc339400537a service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:47.307389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:47.308032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:47.308311 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:47.308581 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] PATH_INFO: `/v3/users/65c0789aabf74875985235644d9191a7` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:47.309812 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c0789aabf74875985235644d9191a7)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:47.311767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:47.355367 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:47.362207 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c0789aabf74875985235644d9191a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.362866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c0789aabf74875985235644d9191a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.369790 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c0789aabf74875985235644d9191a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.376834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c0789aabf74875985235644d9191a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.377501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c0789aabf74875985235644d9191a7'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.395174 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4551/9094] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:17:47 2022] DELETE /identity/v3/users/65c0789aabf74875985235644d9191a7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:17:47.400454 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:47.400737 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:47.401049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:47.429590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:47.430777 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:47.472768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:47.490210 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4544/9095] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:17:47.500024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:47.501454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:47.557958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711caab8-6e3d-4e82-b882-14ea0276b144 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:47.561604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:47.562208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:47.562484 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:47.562754 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:47.572218 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:47.573679 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:47.583626 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4552/9096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:47.751103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:47.752690 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:47.770103 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb6ec7-d208-462e-972d-b919eadcc26f None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:47.775618 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:47.776332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:47.776520 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:47.777324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] PATH_INFO: `/v3/projects/19a924fff2a74cd489ec2f9b0f43db97` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:47.778844 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a924fff2a74cd489ec2f9b0f43db97)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:47.780674 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:47.827511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a924fff2a74cd489ec2f9b0f43db97', 'request_id': 'req-ff75a3aa-d78b-436f-a589-9cfc709ec640'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.833348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a924fff2a74cd489ec2f9b0f43db97', 'request_id': 'req-ff75a3aa-d78b-436f-a589-9cfc709ec640'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.840206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a924fff2a74cd489ec2f9b0f43db97', 'request_id': 'req-ff75a3aa-d78b-436f-a589-9cfc709ec640'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.851464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] The token cache is being invalidate because project 19a924fff2a74cd489ec2f9b0f43db97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:17:47.851766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.852361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.853927 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4545/9097] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:17:47 2022] DELETE /identity/v3/projects/19a924fff2a74cd489ec2f9b0f43db97 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:17:47.858019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:47.867452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24589-3968-4753-a1fb-1257174853ac service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:47.923272 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:47.923900 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:47.924181 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:47.924452 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] PATH_INFO: `/v3/users/01b0fbe8085b45bea1796d9d29922d94` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:47.939046 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b0fbe8085b45bea1796d9d29922d94)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:47.940995 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:47.985859 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b0fbe8085b45bea1796d9d29922d94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.986509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b0fbe8085b45bea1796d9d29922d94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:47.988970 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:47.994492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b0fbe8085b45bea1796d9d29922d94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.002749 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b0fbe8085b45bea1796d9d29922d94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.003390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-951b0c12-8ab0-458e-80a0-3a0e96d9822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b0fbe8085b45bea1796d9d29922d94'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.021082 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4553/9098] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:17:47 2022] DELETE /identity/v3/users/01b0fbe8085b45bea1796d9d29922d94 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:17:48.290206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.291719 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:48.305055 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3aa-d78b-436f-a589-9cfc709ec640 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.363269 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.363903 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.364185 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.364455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] PATH_INFO: `/v3/projects/b43759c2520047b981acf76cb715c496` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.375174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43759c2520047b981acf76cb715c496)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.377125 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.423639 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43759c2520047b981acf76cb715c496', 'request_id': 'req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.429175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43759c2520047b981acf76cb715c496', 'request_id': 'req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.432732 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:48.437530 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43759c2520047b981acf76cb715c496', 'request_id': 'req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.450324 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] The token cache is being invalidate because project b43759c2520047b981acf76cb715c496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:17:48.450611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.451246 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-72a9cf6d-05e7-47b6-b5e7-57ad341c4f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:17:48.452722 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4546/9099] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:17:48 2022] DELETE /identity/v3/projects/b43759c2520047b981acf76cb715c496 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:17:48.458332 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.458829 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.458949 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.497154 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:48.498462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:48.556395 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4554/9100] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:17:48.564793 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.565104 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.565381 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.585948 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:48.587646 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:48.595854 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4547/9101] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:17:48.600078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.610424 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f68d8-a488-4e19-9ff6-a8fa395dd084 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.614932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.615533 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.615810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.616080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] PATH_INFO: `/v3/domains` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.616719 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 11:17:48.617346 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.618962 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.630528 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4555/9102] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 11:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 11:17:48.634846 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.644332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844e73-b717-4026-b8a4-9243ba418039 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.649569 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.650164 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.650441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.650711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.651338 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.653290 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.690033 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4548/9103] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:17:48 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 11:17:48.694091 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.703956 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ef1d-1cf7-460e-9368-26eb1343297c admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.762575 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.763175 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.763448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.763715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.764349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.766285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.788326 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4556/9104] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:17:48 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:17:48.792394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.802718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb1b3f-8219-4019-9969-3afb891b13c7 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.807357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.807951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.808229 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.808501 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.809170 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.810765 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.820494 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4549/9105] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:17:48.824929 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.835065 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464edbf3-f2a8-40fc-8f3f-090fd7a65689 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.840603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.841235 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.841539 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.841809 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.842442 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.844035 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bba58-160d-4f25-aad9-255dff31d173 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.854792 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4557/9106] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 11:17:48.858783 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:48.868599 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878b961-ee51-4957-9d25-3836a64c4cfa admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:48.873293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:48.873931 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.874209 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.874478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] PATH_INFO: `/v3/projects/ac5d7744d6c24245af328843551dac5d/users/1696563726cc4d289edacece3fd2aef9/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.889450 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5d7744d6c24245af328843551dac5d, user_id=1696563726cc4d289edacece3fd2aef9, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:48.892102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:48.905695 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4550/9107] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:17:48 2022] PUT /identity/v3/projects/ac5d7744d6c24245af328843551dac5d/users/1696563726cc4d289edacece3fd2aef9/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:17:48.910413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634402-2d17-490c-a2f6-76d88303b294 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:48.910739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634402-2d17-490c-a2f6-76d88303b294 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:48.910957 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2634402-2d17-490c-a2f6-76d88303b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:48.929955 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-f2634402-2d17-490c-a2f6-76d88303b294 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:48.931193 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f2634402-2d17-490c-a2f6-76d88303b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:48.943231 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:48.992344 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4558/9108] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:17:49.002004 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:49.003739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:49.061926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e060-a495-46c7-ae74-e3650dc46e09 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:49.065622 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:49.066236 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:49.066514 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:49.066787 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:49.076304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:49.077779 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:49.088063 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4551/9109] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:53.128314 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.128866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.128866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.163300 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] MFA Rules not processed for user `1696563726cc4d289edacece3fd2aef9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:53.164211 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:53.245009 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4559/9110] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:17:53.248849 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.259511 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee54b9-29f9-4121-b6fa-84870ad84855 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.264139 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.264746 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.265059 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.265333 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] PATH_INFO: `/v3/projects` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.265965 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.267902 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.296736 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4552/9111] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:17:53 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:17:53.300837 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.312137 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851303-dfa5-497e-96ae-1e664234cb9b None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.373110 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.373720 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.373996 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.374276 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] PATH_INFO: `/v3/users` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.374883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.376819 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.400815 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4560/9112] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:17:53 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:17:53.405043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.415735 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdbf3f-cad3-48ec-b06b-2e0800b9d57d admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.420747 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.421469 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.421748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.422020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.422665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.424271 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.435750 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4553/9113] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:17:53.440066 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.452624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4cdb-23be-4312-bc95-d0cc724c8a00 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.457592 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.458559 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.458838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.459114 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] PATH_INFO: `/v3/projects/a521541838744699811d61b3ab42a0b2/users/1e86ec813c8640f499d39ba9d92f4f1f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.475677 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a521541838744699811d61b3ab42a0b2, user_id=1e86ec813c8640f499d39ba9d92f4f1f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.478458 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.492340 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4561/9114] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:17:53 2022] PUT /identity/v3/projects/a521541838744699811d61b3ab42a0b2/users/1e86ec813c8640f499d39ba9d92f4f1f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:17:53.496385 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.506497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d006aa-5026-4a63-a57a-82f9918625db admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.552649 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:53.566742 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.567367 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.567648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.567922 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.568565 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.570206 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e13656-a2ba-4d45-b413-cbd0ea1bca6c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.581675 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4554/9115] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:17:53.589670 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:53.601116 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f00d5-4944-4d39-9d2a-987d79e6938a admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:53.606625 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:53.607285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:53.607591 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:53.607861 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] PATH_INFO: `/v3/projects/a521541838744699811d61b3ab42a0b2/users/1e86ec813c8640f499d39ba9d92f4f1f/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:53.609881 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a521541838744699811d61b3ab42a0b2, user_id=1e86ec813c8640f499d39ba9d92f4f1f, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:53.612552 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:53.619926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:53.625418 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4562/9116] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:17:53 2022] PUT /identity/v3/projects/a521541838744699811d61b3ab42a0b2/users/1e86ec813c8640f499d39ba9d92f4f1f/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:17:58.207906 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea22a5-7867-438b-b8bc-cf6712125962 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:58.208738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea22a5-7867-438b-b8bc-cf6712125962 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:58.208738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea22a5-7867-438b-b8bc-cf6712125962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:58.248003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-89ea22a5-7867-438b-b8bc-cf6712125962 None None] MFA Rules not processed for user `1e86ec813c8640f499d39ba9d92f4f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:58.249281 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-89ea22a5-7867-438b-b8bc-cf6712125962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:58.352441 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4555/9117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:17:58.371266 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:17:58.373296 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:58.476504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0017cde-c61e-4632-aa07-274d809429e1 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:17:58.483041 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:17:58.483748 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:58.484084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:58.484426 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:58.548727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:17:58.550502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:17:58.561380 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4563/9118] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:17:59.591167 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:17:59.591641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:17:59.591748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:17:59.611660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] MFA Rules not processed for user `1696563726cc4d289edacece3fd2aef9`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:17:59.612856 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:17:59.620444 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4556/9119] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:18:08.556860 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=56 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:09.010922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:18:09.012376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:18:09.028969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b0873-8e4a-42dd-9216-e44f27412b47 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:18:09.034573 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:18:09.035225 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:18:09.035492 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:18:09.035759 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:18:09.037508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:18:09.054176 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:18:09.056429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:18:09.068226 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4564/9120] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:18:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:18:09.606790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=44 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:11.094171 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:18:11.095707 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:18:11.152459 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b1f13-b6e3-42f9-b650-a5c48fb61ef6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:18:11.156062 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:18:11.156664 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:18:11.156973 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:18:11.157251 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:18:11.166086 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:18:11.167496 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:18:11.176738 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4557/9121] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:18:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:18:12.986255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:18:12.997871 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893e2d-4f63-4865-9e23-8e4b55382c24 service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:18:13.003380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:18:13.003980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:18:13.004260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:18:13.004527 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:18:13.006391 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:18:13.018460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:18:13.020023 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:18:13.030521 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4565/9122] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:18:21.172710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=26 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:23.026092 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=12 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:19:38.979590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:19:38.990944 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39e5b-5d8d-4218-8165-eee358fb3795 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:19:38.994517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:19:38.995101 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:19:38.995376 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:19:38.995642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:19:38.997349 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:19:39.016785 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:19:39.018220 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:19:39.026535 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4558/9123] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:19:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:19:49.022478 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:38.764200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:20:38.765701 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:20:38.868747 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c7613-0273-4ec6-99b4-c2de99af917f service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:20:38.872246 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:20:38.872838 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:20:38.873143 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:20:38.873411 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:20:38.875096 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:20:38.908090 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:20:38.909534 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80242db-2bed-4f9a-ac1d-6e27db349a31 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:20:38.920498 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4566/9124] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:20:39.112696 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:20:39.128574 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ac1a-f86a-4445-9d24-1754a07df8f4 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:20:39.132126 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:20:39.132715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:20:39.133020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:20:39.133316 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:20:39.135012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:20:39.152748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:20:39.154449 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:20:39.168525 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4559/9125] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:20:48.915899 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=57 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:49.162329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=9 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:55.178403 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:20:55.178914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:20:55.178914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:20:55.238753 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:20:55.239953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:20:55.304257 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4567/9126] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:20:55.350288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:20:55.351715 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:20:55.444110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1b6b-010b-4f36-954b-1f95094c477c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:20:55.449080 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:20:55.449678 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:20:55.449951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:20:55.450217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:20:55.458174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:20:55.460046 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad671f-232c-4e31-91f7-b3ace761c780 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:20:55.468015 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4560/9127] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:21:05.301286 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=44 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:05.464748 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=41 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:07.874397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:07.883636 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfcfe9-e565-4dea-8b5b-e228c8e8abd8 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:07.887291 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:07.887889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:07.888165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:07.888435 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:07.890151 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:07.901698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:07.903279 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:07.912931 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4568/9128] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:21:09.042564 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:09.043114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:09.043114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:09.201828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] MFA Rules not processed for user `5e0030a2c94142b0af1fe8bf0ac671f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:21:09.203021 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:09.215108 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4561/9129] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Oct 28 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:21:09.229698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:09.241981 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cc093-829e-4db1-ab8e-1a9851980021 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:09.245736 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:09.246327 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:09.246605 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:09.246872 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:09.256832 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:09.258765 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:09.272486 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4569/9130] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:21:09.343710 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:09.352861 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaabc4e-813d-46bf-88e6-3b913effc8e9 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:09.356366 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:09.356981 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:09.357254 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:09.357517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:09.359451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:09.369336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:09.370727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:09.378282 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4562/9131] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:21:09.450389 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:09.460299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c6fb-578a-40b8-be42-201379d7bb40 service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:09.463773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:09.464361 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:09.464634 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:09.464922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:09.466624 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:09.484459 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:09.486103 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa443e7-83ab-49ed-a67f-e9ab43535a11 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:09.502717 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4570/9132] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:21:09.569608 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:09.571621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:09.644845 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd269ca-dd70-45be-aa3a-1f3435b62d1c service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:09.649770 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:09.650369 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:09.650644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:09.650913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:09.652612 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:09.663600 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:09.665727 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:09.675258 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4563/9133] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:21:11.294340 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aafb1-8e46-4d5c-a7bc-47834ad28794 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:11.294789 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aafb1-8e46-4d5c-a7bc-47834ad28794 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:11.294910 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aafb1-8e46-4d5c-a7bc-47834ad28794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:11.313623 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-e11aafb1-8e46-4d5c-a7bc-47834ad28794 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:21:11.314794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-e11aafb1-8e46-4d5c-a7bc-47834ad28794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:11.322331 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4571/9134] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:21:11.334020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:11.346008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618d78-a90f-47c6-af38-f4aa412e07e0 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:11.351022 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:11.351615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:11.351890 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:11.352155 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:11.360002 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:11.361596 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:11.369486 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4564/9135] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:21:21.308698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=21 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:21.366233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=47 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:33.836631 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:33.837208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:33.837208 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:33.856400 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:21:33.857612 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:33.864545 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4572/9136] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:21:33.877186 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:33.887577 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09074c85-2f7c-47df-8519-8149d401e0e1 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:33.892790 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:33.893414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:33.893688 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:33.893954 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:33.901987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:33.903567 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:33.911380 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4565/9137] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:21:43.850718 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:43.908166 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:52.216308 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:21:52.228974 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f014d-ea72-44a3-9070-0df797741c4a None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:21:52.234597 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:21:52.235223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:21:52.235502 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:21:52.235773 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:21:52.237520 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:21:52.261258 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:21:52.262791 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:21:52.273168 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4573/9138] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:21:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:22:02.268990 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=11 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:22:31.988223 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:22:31.989679 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:22:32.003594 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc64cd7-6749-4719-b257-402e96808f1a service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:22:32.008406 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:22:32.009048 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:22:32.009319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:22:32.009583 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:22:32.011205 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:22:32.022438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:22:32.023969 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:22:32.034413 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4566/9139] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:22:42.029455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:11.052196 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:11.061643 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4ffff-f5a0-4f6d-849c-faeb65cbc11d service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:11.065283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:11.066441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:11.066715 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:11.066982 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:11.075200 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:11.077054 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959abd-3745-424f-aaef-ad77a3056e47 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:11.085708 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4574/9140] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:14.370711 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:14.384043 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38130cc5-46a5-480f-ae3b-6dc465be9373 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:14.389446 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:14.390040 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:14.390319 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:14.390590 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:14.401683 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:14.403244 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:14.414577 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4567/9141] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:16.998961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:16.999478 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:16.999598 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:17.019716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] MFA Rules not processed for user `1696563726cc4d289edacece3fd2aef9`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:23:17.020887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:23:17.028293 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4575/9142] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:23:24.409637 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:27.014243 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=9 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:32.539941 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:32.549003 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae273-d620-44e5-8431-5e610cc614b8 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:32.553072 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:32.553660 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:32.553936 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:32.554264 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:32.555997 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:23:32.565360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:32.566780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:32.575428 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4568/9143] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:33.030347 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:33.043843 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b932f4-e01d-4fbf-b997-61f408b8cd41 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:33.051189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:33.051189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:33.051189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:33.051189 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:33.054157 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:23:33.066313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:33.068008 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:33.078680 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4576/9144] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:35.883174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:35.892935 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56b9a1-bc24-45d8-b2d5-900f13cf6933 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:35.897129 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:35.897772 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:35.898051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:35.898320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:35.900341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:23:35.912038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:35.914887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:35.927227 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4569/9145] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:43.074109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:45.922832 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=12 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:50.542659 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:50.554865 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd5f79-6bd2-4691-8154-c784051ba9dc service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:50.560825 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:50.561455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:50.561733 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:50.562002 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:50.571828 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:50.573441 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:50.593833 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4577/9146] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:23:52.193005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:23:52.202347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f86e9-96a4-4165-97f5-8089831f77fa service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:23:52.205972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:23:52.206566 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:23:52.206840 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:23:52.207105 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:23:52.216153 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:23:52.217593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:23:52.226985 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4570/9147] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:24:00.579487 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:24:02.222718 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:46.546105 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:25:46.555622 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96fc48-e895-41a2-88d5-0631a22633af service nova] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:25:46.559867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:25:46.560456 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:25:46.560734 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:25:46.561045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:25:46.577846 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:25:46.579280 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:25:46.591320 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4578/9148] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:25:47.778887 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:25:47.787606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601be9-cf35-4464-9700-3ddbe62451e7 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:25:47.791359 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:25:47.791950 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:25:47.792733 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:25:47.793039 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:25:47.803447 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:25:47.804888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:25:47.816366 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4571/9149] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:25:56.585448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=9 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:57.811570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=6 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:08.195601 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:26:08.204535 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba84a-fd26-4895-8031-d23d7e1e76df service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:26:08.208238 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:26:08.208889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:26:08.209197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:26:08.209467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:26:08.217040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:26:08.218467 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:26:08.226480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4579/9150] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:26:18.222847 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:57.257487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:26:57.277910 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03ec6-9114-4693-8b1c-9f1262af02e6 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:26:57.283360 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:26:57.283942 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:26:57.284218 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:26:57.284487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:26:57.292740 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:26:57.294348 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:26:57.304583 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4572/9151] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:27:07.300551 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=10 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:36.033453 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:36.045363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120bb99-84ce-4337-b752-21ef1243abfc service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:36.051053 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:36.051641 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:36.051922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:36.052197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:36.060434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:36.062042 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:36.071935 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4580/9152] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:27:40.174377 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:40.187455 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df1e9-3f83-49d0-a27b-d080afafc7c4 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:40.193768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:40.194606 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:40.194877 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:40.195147 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:40.196885 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:40.210916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:40.212507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:40.224434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4573/9153] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:27:46.067735 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:46.105504 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:46.129303 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8e1b-d5d4-4299-a9c4-72cbbda448a5 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:46.133963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:46.134650 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:46.135032 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:46.135363 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:46.199024 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:46.200480 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:46.211501 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4581/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:27:49.393099 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:49.404686 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c17bef-3cb4-4210-a774-e688baa016e6 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:49.410296 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:49.410897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:49.411174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:49.411442 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:49.413175 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:49.425184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:49.426738 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:49.438062 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4574/9155] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:27:52.276669 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:52.288522 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec683-9e12-401b-baf0-6f7918d283cb service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:52.293794 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:52.294406 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:52.294878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:52.295153 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:52.297438 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:52.311076 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:52.312700 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:52.324183 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4582/9156] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:27:52.355692 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:52.358149 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:52.413512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8f83a-6f0c-45cc-9a07-8a758d02546d service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:52.418020 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:52.418644 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:52.418917 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:52.419184 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] PATH_INFO: `/v3/users/1696563726cc4d289edacece3fd2aef9` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:52.433214 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1696563726cc4d289edacece3fd2aef9)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:52.435131 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:52.481357 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1696563726cc4d289edacece3fd2aef9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.482005 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1696563726cc4d289edacece3fd2aef9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.482614 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1696563726cc4d289edacece3fd2aef9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.503515 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1696563726cc4d289edacece3fd2aef9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.526638 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1696563726cc4d289edacece3fd2aef9'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.544404 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4575/9157] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:27:52 2022] DELETE /identity/v3/users/1696563726cc4d289edacece3fd2aef9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:27:52.718664 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:52.730028 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e5b9-2997-48cd-998e-6df4baa90191 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:52.787867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:52.788427 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:52.788711 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:52.789018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] PATH_INFO: `/v3/projects/ac5d7744d6c24245af328843551dac5d` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:52.799379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5d7744d6c24245af328843551dac5d)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:52.801349 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:52.847019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5d7744d6c24245af328843551dac5d', 'request_id': 'req-89be762a-2a24-484d-b0a0-a8ab93a3081f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.852541 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5d7744d6c24245af328843551dac5d', 'request_id': 'req-89be762a-2a24-484d-b0a0-a8ab93a3081f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.859845 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5d7744d6c24245af328843551dac5d', 'request_id': 'req-89be762a-2a24-484d-b0a0-a8ab93a3081f'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.860980 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:52.874098 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] The token cache is being invalidate because project ac5d7744d6c24245af328843551dac5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:27:52.874413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.875043 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:52.876546 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4583/9158] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:27:52 2022] DELETE /identity/v3/projects/ac5d7744d6c24245af328843551dac5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:27:52.881025 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:52.882439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:52.896049 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96ae1-7267-4486-9967-bee911e5b0ca admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:52.950972 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:52.951593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:52.951868 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:52.952132 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] PATH_INFO: `/v3/users/1e86ec813c8640f499d39ba9d92f4f1f` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:52.953286 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e86ec813c8640f499d39ba9d92f4f1f)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:52.955676 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:52.960869 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:53.001780 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e86ec813c8640f499d39ba9d92f4f1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.002418 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e86ec813c8640f499d39ba9d92f4f1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.003019 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e86ec813c8640f499d39ba9d92f4f1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.009828 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e86ec813c8640f499d39ba9d92f4f1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.016579 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-80eaadec-a1bd-4b07-8cc4-2d18d82daf9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e86ec813c8640f499d39ba9d92f4f1f'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.034187 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4576/9159] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:27:52 2022] DELETE /identity/v3/users/1e86ec813c8640f499d39ba9d92f4f1f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:27:53.206394 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.208097 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:53.221963 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be762a-2a24-484d-b0a0-a8ab93a3081f admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.280434 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.281209 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.281585 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.281952 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] PATH_INFO: `/v3/projects/a521541838744699811d61b3ab42a0b2` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.283858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a521541838744699811d61b3ab42a0b2)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.286628 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.341222 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a521541838744699811d61b3ab42a0b2', 'request_id': 'req-b1dc7199-08bb-466c-8c22-cbb80d8ff794'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.348141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a521541838744699811d61b3ab42a0b2', 'request_id': 'req-b1dc7199-08bb-466c-8c22-cbb80d8ff794'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.357178 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a521541838744699811d61b3ab42a0b2', 'request_id': 'req-b1dc7199-08bb-466c-8c22-cbb80d8ff794'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.373407 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] The token cache is being invalidate because project a521541838744699811d61b3ab42a0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:27:53.373922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.374513 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-b1dc7199-08bb-466c-8c22-cbb80d8ff794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:27:53.375990 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4584/9160] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:27:53 2022] DELETE /identity/v3/projects/a521541838744699811d61b3ab42a0b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:27:53.382714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.382714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.383210 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.442895 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:27:53.444087 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:53.501701 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4577/9161] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:27:53.510373 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.510655 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.510924 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.531251 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:27:53.532448 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:53.541068 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4585/9162] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:27:53.545408 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.554916 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c0063-e554-4767-aec0-d6b69fb6b9f6 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.559486 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.560074 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.560355 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.560621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.561287 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 11:27:53.561587 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.563233 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.574480 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4578/9163] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Oct 28 11:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 11:27:53.578557 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.588167 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412e379-0347-4bcb-84ac-82b34ff52794 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.593014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.593608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.593883 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.594148 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.594764 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.596698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.632844 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4586/9164] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:27:53 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:27:53.637891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.648617 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344379a-9bca-4e12-a85d-0461a60a3a86 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.689204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:53.707238 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.707833 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.708110 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.708407 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.709052 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.710952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.731230 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4579/9165] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:27:53 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:27:53.735454 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.745707 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a11a2-57ca-40c6-ac2b-9e2a9fbd8320 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.750223 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.750810 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.751084 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.751348 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.751969 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.753671 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.763616 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4587/9166] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:27:53.768038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.778159 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15e7a4-932e-4a34-a797-e94bcce4d4b0 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.782799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.784234 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.784512 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.784784 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] PATH_INFO: `/v3/roles` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.785475 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.787085 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa999-b4b2-4b11-90bd-df0582aaa993 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.796876 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4580/9167] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:27:53.800971 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.810914 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cfa1-23d7-4bc1-92d8-000cf1d5dbf2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:53.815399 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:53.816029 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] REQUEST_METHOD: `PUT` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.816302 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.816568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] PATH_INFO: `/v3/projects/94a59548e7fb4bef903c6c719e7dad37/users/ed30b4137a904cf6ad1705c03f43cb86/roles/5c0f3bf97ca0422cb9f85126cf037e6a` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.831555 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a59548e7fb4bef903c6c719e7dad37, user_id=ed30b4137a904cf6ad1705c03f43cb86, role_id=5c0f3bf97ca0422cb9f85126cf037e6a)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:53.834214 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:53.847854 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4588/9168] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:27:53 2022] PUT /identity/v3/projects/94a59548e7fb4bef903c6c719e7dad37/users/ed30b4137a904cf6ad1705c03f43cb86/roles/5c0f3bf97ca0422cb9f85126cf037e6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:27:53.852799 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63490a-01cd-426b-bfd6-cfaf081dcc38 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:53.853121 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63490a-01cd-426b-bfd6-cfaf081dcc38 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:53.853417 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63490a-01cd-426b-bfd6-cfaf081dcc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:53.872411 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-2c63490a-01cd-426b-bfd6-cfaf081dcc38 None None] MFA Rules not processed for user `b2e4136eee3b43878593830db499a951`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:27:53.873652 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2c63490a-01cd-426b-bfd6-cfaf081dcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:53.932563 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4581/9169] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:27:53.942958 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:53.944681 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:53.958739 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:54.016237 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41fb30-2c1f-4687-90e9-494c8a1ac17e admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:54.020565 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:54.021183 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:54.021460 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:54.021727 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:54.030676 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:54.032113 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:54.041638 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4589/9170] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:27:58.110221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.110762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.110762 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.140297 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] MFA Rules not processed for user `ed30b4137a904cf6ad1705c03f43cb86`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:27:58.141595 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:27:58.218938 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4582/9171] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:27:58.223866 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.234247 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8ce2-e320-4e42-8822-4f8531c8c0ae service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.239553 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.240165 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.240445 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.240716 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] PATH_INFO: `/v3/projects` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.241376 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.243301 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.276564 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4590/9172] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Oct 28 11:27:58 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:27:58.278112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.289282 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfabe-b2c3-46db-860a-9171f15a0dbb None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.340268 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:58.351538 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.352070 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.352347 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.352616 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] PATH_INFO: `/v3/users` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.353293 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.355198 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.378542 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4583/9173] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Oct 28 11:27:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 11:27:58.382558 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.393580 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c4f42-1962-4ce8-a6b7-24b76ea22edf admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.398730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.399462 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.399767 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.400040 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.400682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.402385 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.413864 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4591/9174] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 11:27:58.418078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.429642 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174e6d-e0c9-468c-a8e9-a31f0ba5fdd3 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.434913 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.435769 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.436045 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.436308 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] PATH_INFO: `/v3/projects/6614192001c645beb403fac3f813ce04/users/10bc8562191d4523a8e08170e98791a1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.451611 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6614192001c645beb403fac3f813ce04, user_id=10bc8562191d4523a8e08170e98791a1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.454288 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.469076 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4584/9175] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:27:58 2022] PUT /identity/v3/projects/6614192001c645beb403fac3f813ce04/users/10bc8562191d4523a8e08170e98791a1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:27:58.473697 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.484509 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a267-6c8a-4b81-93f7-8ea1e40f8720 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.546104 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.546726 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.547011 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.547283 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.547930 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.550161 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a8bc-06c8-41fb-b7c8-27d82676abfc admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.561210 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4592/9176] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 11:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 11:27:58.565318 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:27:58.576517 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4f42-f144-4ee0-abc7-07aacabcf995 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:27:58.581328 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:27:58.581992 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] REQUEST_METHOD: `PUT` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:27:58.582267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:27:58.582531 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] PATH_INFO: `/v3/projects/6614192001c645beb403fac3f813ce04/users/10bc8562191d4523a8e08170e98791a1/roles/2f6026da89244dcf8bb34fbb1d317246` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:27:58.584523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6614192001c645beb403fac3f813ce04, user_id=10bc8562191d4523a8e08170e98791a1, role_id=2f6026da89244dcf8bb34fbb1d317246)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:27:58.587552 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:27:58.599468 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4585/9177] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Oct 28 11:27:58 2022] PUT /identity/v3/projects/6614192001c645beb403fac3f813ce04/users/10bc8562191d4523a8e08170e98791a1/roles/2f6026da89244dcf8bb34fbb1d317246 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:28:03.259313 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f61-7b28-4b1e-a0d3-341770b5e8ec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:28:03.260206 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f61-7b28-4b1e-a0d3-341770b5e8ec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:28:03.260647 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f61-7b28-4b1e-a0d3-341770b5e8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:28:03.312412 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-8cee2f61-7b28-4b1e-a0d3-341770b5e8ec None None] MFA Rules not processed for user `10bc8562191d4523a8e08170e98791a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:28:03.314912 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-8cee2f61-7b28-4b1e-a0d3-341770b5e8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:28:03.401009 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:03.437970 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4593/9178] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:28:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:28:03.454451 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:28:03.456621 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:28:03.596051 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc81d99-41ae-4679-8556-9ca0bcc15473 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:28:03.604753 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:28:03.605497 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:28:03.605773 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:28:03.606038 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:28:03.705361 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:28:03.706989 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:28:03.719393 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4586/9179] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:28:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:28:04.733136 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:28:04.733615 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:28:04.733933 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:28:04.754689 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] MFA Rules not processed for user `ed30b4137a904cf6ad1705c03f43cb86`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:28:04.755932 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:28:04.763308 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4594/9180] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:28:05.089932 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:28:05.091456 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:28:05.113897 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:05.152925 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc373a-c37d-4e9f-8b90-97d5c85f2edc service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:28:05.156585 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:28:05.157222 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:28:05.157495 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:28:05.157801 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:28:05.159518 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:28:05.169619 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:28:05.171041 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:28:05.179042 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4587/9181] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:28:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:28:14.747702 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=7 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:15.175464 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=17 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:18.710603 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:28:18.720381 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b043f5-777d-4b74-9f9e-bba1a6315121 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:28:18.724012 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:28:18.724608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:28:18.724887 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:28:18.725191 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:28:18.733973 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:28:18.735668 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fef9cd-09bf-4e16-8a71-070ed387a356 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:28:18.745631 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4595/9182] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:28:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:28:28.741263 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:30:54.588054 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:30:54.592648 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:30:54.659713 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a0f0a-5c4f-4062-a114-890cfc593fd6 service neutron] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:30:54.665327 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:30:54.665926 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:30:54.666204 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:30:54.666474 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:30:54.668853 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:30:54.680791 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:30:54.682336 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:30:54.693028 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4588/9183] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:30:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:30:56.274721 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda920af-c852-47f7-b30a-50a22137b9ec None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:30:56.275253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda920af-c852-47f7-b30a-50a22137b9ec None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:30:56.275253 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda920af-c852-47f7-b30a-50a22137b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:30:56.333730 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-bda920af-c852-47f7-b30a-50a22137b9ec None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:30:56.334946 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-bda920af-c852-47f7-b30a-50a22137b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:30:56.397809 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4596/9184] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:30:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:30:56.444841 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:30:56.446396 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:30:56.536999 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335805-c15b-4372-99c0-6c74ac75462f service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:30:56.541994 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:30:56.542593 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:30:56.542870 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:30:56.543140 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:30:56.551067 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:30:56.553111 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:30:56.561232 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4589/9185] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:30:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:31:06.135853 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:06.136379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:06.136379 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:06.155123 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] MFA Rules not processed for user `ed30b4137a904cf6ad1705c03f43cb86`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:31:06.156505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:06.163330 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4597/9186] 10.222.0.16 () {58 vars in 958 bytes} [Fri Oct 28 11:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:31:06.204980 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:06.206368 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:06.280134 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=100 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:06.282905 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78ad3a-36c1-49ca-95a0-f09a9da3cb08 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:06.287509 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:06.288116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:06.288394 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:06.288665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:06.290482 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:06.304543 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:06.305987 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:06.316616 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4590/9187] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:06.596421 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:06.606045 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ac3cc-a4d8-489e-a131-a68670bf5681 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:06.609784 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:06.610380 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:06.610656 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:06.610926 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:06.612640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:06.621787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:06.623205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:06.631011 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4598/9188] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:06.970888 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:06.972438 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:06.990358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:07.000698 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5ff9-6f68-4240-8005-76e3d2f286f1 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:07.007493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:07.008521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:07.009020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:07.009475 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:07.012052 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:07.034429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:07.036250 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2b8d-5c62-4947-9c81-96bb085d50d2 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:07.054369 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4599/9189] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 11:31:07.060194 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c2bc-c246-424b-a937-d2c288a84aa2 service glance] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:07.066440 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:07.067346 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:07.067921 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:07.068401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:07.070576 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:07.083078 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:07.084766 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:07.095434 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4591/9190] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:08.398909 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:08.399423 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:08.399551 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:08.419255 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:31:08.420455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:08.427725 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4600/9191] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:31:08.440305 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:08.451488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8748cc6-1fd6-4892-b5a1-5fc037160cc1 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:08.457012 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:08.457604 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:08.457886 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:08.458180 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:08.466745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:08.468432 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:08.477004 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4592/9192] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 11:31:16.328455 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:16.338014 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee9d6-6b32-44d2-a1d8-7308a7a0d3c6 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:16.341922 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:16.342521 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:16.342799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:16.343069 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:16.344820 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:16.354109 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:16.355536 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:16.363840 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4601/9193] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:17.083636 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:17.098813 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3a181-ef47-4995-a262-8674772b5b15 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:17.104881 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:17.105467 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:17.105745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:17.106011 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:17.107745 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:17.122332 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:17.124267 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:17.135541 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4593/9194] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:26.359885 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=68 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:27.131402 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=48 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:45.946493 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:31:45.955905 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518c8f2-a476-41ae-befa-2b1d463bf269 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:31:45.959741 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:31:45.960338 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:31:45.960619 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:31:45.960889 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:31:45.962640 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:31:45.972336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:31:45.973787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:31:45.981646 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4602/9195] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:31:55.978129 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:32:02.227951 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:32:02.229414 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:32:02.256259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea4b0-44e9-4288-a6de-548fbaf639f5 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:32:02.261428 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:32:02.262028 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:32:02.262304 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:32:02.262570 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:32:02.264219 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:32:02.275114 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:32:02.276651 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aafef-548f-4b66-a8c0-fae3ae6767da service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:32:02.286082 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4594/9196] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:32:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:32:12.282116 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=11 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:32:39.956604 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:32:39.968997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c20aa-fa38-48cd-a639-4696917b1609 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:32:39.974429 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:32:39.975020 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:32:39.975293 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:32:39.975556 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:32:39.977284 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:32:39.989019 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:32:39.990586 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:32:40.000159 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4603/9197] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:32:49.996057 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:01.110365 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ba56-7dc0-45f0-981c-c0cc9b0faa66 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:01.110874 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ba56-7dc0-45f0-981c-c0cc9b0faa66 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:01.110991 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ba56-7dc0-45f0-981c-c0cc9b0faa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:01.130425 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-7022ba56-7dc0-45f0-981c-c0cc9b0faa66 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:33:01.131623 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-7022ba56-7dc0-45f0-981c-c0cc9b0faa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:01.139215 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4595/9198] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Oct 28 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:33:01.183988 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:01.195352 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63212f3b-3574-4527-a906-dd7ef542e9b5 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:01.200961 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:01.201518 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:01.201787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:01.202086 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:01.211309 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:01.212917 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:01.221524 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4604/9199] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:33:03.190320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5b8b-5b9c-44b7-a425-5372b6705ae7 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:03.191413 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5b8b-5b9c-44b7-a425-5372b6705ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:03.191879 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5b8b-5b9c-44b7-a425-5372b6705ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:03.243240 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-921f5b8b-5b9c-44b7-a425-5372b6705ae7 None None] MFA Rules not processed for user `b6f23fb45ed14020a6d15f834881d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:33:03.244541 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-921f5b8b-5b9c-44b7-a425-5372b6705ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:03.254403 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4596/9200] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Oct 28 11:33:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:33:03.261691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:03.274561 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c8599-e322-43cc-aa21-671e751af52d service swift] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:03.278244 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f23fb45ed14020a6d15f834881d50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:03.278878 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:03.279150 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:03.279413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:03.291841 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:03.293978 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:03.306446 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4605/9201] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:33:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:33:10.591018 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] REQUEST_METHOD: `POST` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:10.591488 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:10.591635 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:10.611291 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.auth.core [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:33:10.612628 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:10.620409 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4597/9202] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:33:10.633078 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:10.644608 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a604-7c70-459c-8df2-f98c6b8d14b4 service glance] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:10.650616 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:10.651210 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:10.651486 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:10.651750 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:10.659799 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:10.661413 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b28bc-04f9-4a08-a619-404874a9bb59 service swift] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:10.669480 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4606/9203] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:33:11.789830 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:11.805962 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbab88-a678-41f1-b4f8-8e83d1f3ec14 None None] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:11.814241 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0030a2c94142b0af1fe8bf0ac671f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:11.814864 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:11.815136 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:11.815615 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:11.817714 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:11.830597 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:11.832172 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:11.843824 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4598/9204] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:33:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:33:15.502787 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] REQUEST_METHOD: `POST` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:15.503285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:15.503416 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:15.522476 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.auth.core [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] MFA Rules not processed for user `557422469bd844e6ba2ea08c1db83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=88452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:33:15.523675 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:15.530796 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4607/9205] 10.222.0.16 () {58 vars in 967 bytes} [Fri Oct 28 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 11:33:15.543329 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:15.555024 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10ab1-877c-41dd-acc6-1c5f2582e5a3 service nova] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:15.559943 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c19dc65ad64a8eaa5d0f64e7e14079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:15.560536 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:15.560817 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:15.561119 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:15.569123 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:15.570687 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:15.578649 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4599/9206] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Oct 28 11:33:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:33:19.543397 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:19.553781 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643e46-47f8-4e1c-a6a9-c272a8e86831 None None] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:19.557358 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051db56282044b44934f4db7ce8cd08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:19.557953 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:19.558230 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:19.558501 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:19.618691 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:19.620141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:19.629577 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4608/9207] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:33:22.697441 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:22.703559 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=28 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:22.710982 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95affb9f-decd-4724-8d71-793f15a7b7a3 service swift] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:22.716641 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:22.717898 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:22.718252 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:22.718528 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:22.720439 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:22.735752 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:22.737401 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:22.758324 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4600/9208] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:33:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:33:25.990508 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:26.004387 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598311b7-5d27-4faa-b3c2-a7b93dfb0c34 service neutron] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:26.011869 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:26.012943 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:26.013568 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:26.014834 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:26.018390 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:26.042505 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:26.045093 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:26.062709 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:26.075739 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c003d-eaa0-4de3-ad75-60fc4b5a73de service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:26.080699 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:26.081847 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:26.082130 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:26.082487 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] PATH_INFO: `/v3/users/ed30b4137a904cf6ad1705c03f43cb86` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:26.084174 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed30b4137a904cf6ad1705c03f43cb86)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:26.086060 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4609/9209] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:33:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:33:26.086221 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:26.141706 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed30b4137a904cf6ad1705c03f43cb86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.142643 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed30b4137a904cf6ad1705c03f43cb86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.143563 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed30b4137a904cf6ad1705c03f43cb86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.157262 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed30b4137a904cf6ad1705c03f43cb86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.165386 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed30b4137a904cf6ad1705c03f43cb86'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.185293 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4601/9210] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:33:26 2022] DELETE /identity/v3/users/ed30b4137a904cf6ad1705c03f43cb86 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:33:26.365566 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:26.377299 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afb0ad-9770-4cdd-b1cf-f946bfbd2f76 service placement] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:26.436018 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:26.436639 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:26.436936 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:26.437205 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] PATH_INFO: `/v3/projects/94a59548e7fb4bef903c6c719e7dad37` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:26.438285 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a59548e7fb4bef903c6c719e7dad37)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:26.440197 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:26.478388 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:26.488026 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a59548e7fb4bef903c6c719e7dad37', 'request_id': 'req-ad1deae3-1e25-47b8-965d-0e14b532bbe2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.493893 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a59548e7fb4bef903c6c719e7dad37', 'request_id': 'req-ad1deae3-1e25-47b8-965d-0e14b532bbe2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.500722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a59548e7fb4bef903c6c719e7dad37', 'request_id': 'req-ad1deae3-1e25-47b8-965d-0e14b532bbe2'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.512010 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] The token cache is being invalidate because project 94a59548e7fb4bef903c6c719e7dad37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:33:26.512290 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.512997 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.514467 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4610/9211] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:33:26 2022] DELETE /identity/v3/projects/94a59548e7fb4bef903c6c719e7dad37 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:33:26.518427 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:26.519829 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:26.532698 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddd11-ac84-4883-ac1f-d1ac851850c8 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:26.587891 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:26.588523 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:26.588802 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:26.589102 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] PATH_INFO: `/v3/users/10bc8562191d4523a8e08170e98791a1` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:26.590224 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bc8562191d4523a8e08170e98791a1)` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:26.592124 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:26.639768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bc8562191d4523a8e08170e98791a1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.640452 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bc8562191d4523a8e08170e98791a1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.641207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bc8562191d4523a8e08170e98791a1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.649079 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bc8562191d4523a8e08170e98791a1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.656112 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.notifications [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bc8562191d4523a8e08170e98791a1'} {{(pid=88451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.657320 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:26.676221 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4602/9212] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 11:33:26 2022] DELETE /identity/v3/users/10bc8562191d4523a8e08170e98791a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:33:26.848913 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:33:26.850370 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:33:26.863260 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deae3-1e25-47b8-965d-0e14b532bbe2 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:33:26.920439 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e4136eee3b43878593830db499a951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04a62e1ae96e4c8e9b9228e06dc65dee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:33:26.921102 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:33:26.921382 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:33:26.921654 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] PATH_INFO: `/v3/projects/6614192001c645beb403fac3f813ce04` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:33:26.922758 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6614192001c645beb403fac3f813ce04)` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:33:26.924682 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:33:26.973282 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6614192001c645beb403fac3f813ce04', 'request_id': 'req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.978858 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6614192001c645beb403fac3f813ce04', 'request_id': 'req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.986141 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6614192001c645beb403fac3f813ce04', 'request_id': 'req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33'} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.997722 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] The token cache is being invalidate because project 6614192001c645beb403fac3f813ce04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:33:26.998336 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:26.998672 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.notifications [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:33:27.000148 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4611/9213] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 11:33:26 2022] DELETE /identity/v3/projects/6614192001c645beb403fac3f813ce04 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:33:36.672663 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:36.994080 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:37:11.223781 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:37:11.225217 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:37:11.304250 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92df3-bd62-4ebb-a1f9-f99f4e8b5507 admin admin] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:37:11.363768 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:37:11.364375 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:37:11.364654 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:37:11.364952 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:37:11.366665 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.fernet_utils [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:37:11.378276 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:37:11.379819 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:37:11.389451 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4603/9214] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:37:21.385409 n-d-zed-1 devstack@keystone.service[88451]: DEBUG dbcounter [-] [88451] Writing DB stats keystone:SELECT=62 {{(pid=88451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:37:46.968680 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Authenticating user token {{(pid=88452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:37:46.970112 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:37:46.987187 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70e193-1d38-4a7c-b6fb-4b9d91b82c33 admin admin] Validating token access rules against request {{(pid=88452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:37:46.992768 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:37:46.993422 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] REQUEST_METHOD: `GET` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:37:46.993704 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] SCRIPT_NAME: `/identity` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:37:46.993977 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:37:46.995646 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.fernet_utils [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:37:47.008867 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:37:47.010483 n-d-zed-1 devstack@keystone.service[88452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57accf5b-527f-4901-8458-7ed5e54051b9 service placement] RBAC: Authorization granted {{(pid=88452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:37:47.020510 n-d-zed-1 devstack@keystone.service[88452]: [pid: 88452|app: 0|req: 4612/9215] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:37:57.016267 n-d-zed-1 devstack@keystone.service[88452]: DEBUG dbcounter [-] [88452] Writing DB stats keystone:SELECT=6 {{(pid=88452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:42:15.215259 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] Authenticating user token {{(pid=88451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:42:15.259207 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cb1c-f4f8-4849-90b8-73df695aa779 service placement] Validating token access rules against request {{(pid=88451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:42:15.264341 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d91f2fd8b44f6790078a7c19984b11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52d3f7dfc41a456fa04ca6bb3a8a803e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:42:15.264959 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] REQUEST_METHOD: `GET` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:42:15.265239 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] SCRIPT_NAME: `/identity` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:42:15.265507 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:42:15.273945 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:42:15.276008 n-d-zed-1 devstack@keystone.service[88451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0f95-a590-46f1-a1d9-9030892e7b65 service placement] RBAC: Authorization granted {{(pid=88451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:42:15.285660 n-d-zed-1 devstack@keystone.service[88451]: [pid: 88451|app: 0|req: 4604/9216] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Oct 28 11:42:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)